Intermittent crashes on new install

stefanhartman · 2015-01-11 23:37:18

Hi,

I am seeing intermittent crashes on a new install of Arch.
I see different messages on crash, quite often

INFO: rcu_preempt_state detected stalls on CPUs/tasks:

also

BUG: Bad page map in process bash

and other processes.
sometimes:

CPU: 1 PID: 1 Comm: shutdown tainted

I am vague here in the specific messages because it's not always the same and partly because I usually lose the logs due to hard restarting the machine.

I realize that the information here is somewhat lacking so I don't expect a magic answer to solve the problem. I am looking for advice on where to go from here to try and get it fixed.

The system seems normal most of the time then crashes without warning. When it does happen it will almost certainly get stuck at what seems to be the very last stage of shutdown (that is if it allowed me to use the shell). It might or might not go wrong after reboot then.

I've done 2 cycles of test using memtest, both passing.

Any advice? Could a faulty hard drive possible be the cause?

stefanhartman · 2015-01-14 00:50:41

UPDATE:
I can now post some more complete logs and more information.

As I mentioned above problems occurred on a fresh install of Arch.
All partitions (/, home and boot) were ext4 filesystems on an old WD hard drive. There was a swap partition at /dev/sda2 with a corresponding fstab entry (that was generated by genfstab).
DOS partition table was used with GRUB as the bootloader.
Processor is AMD FX 4100.
Samba and OpenSSH were installed, not necessarily running when crashes occurred.

The "detected stalls on CPU" log entries were displayed on screen at some time on a number of occasions. On those occasions I was not able to get a full log.

"Bad page map in process XX" were also quite common.
These made me suspect RAM, I did 2 loops of memtest (I guess I should do more), both passed.

I then started suspecting a hard drive problem since many Call Trace lines in the errors referred to ext4 (I couldn't make sense of most of them, but they didn't look particularly suspicious). I replaced the hard drive with a new WD Green 2TB drive and started from scratch reinstalling the whole system. This time with GPT/UEIFI. Install went smoothly.

Trying to reproduce the errors, I tried to stress the RAM and swap as much as possible. Previous occurrences were also during activity, albeit not very intensive.
I ran the following:

#include <stdlib.h>
#include <stdio.h>
#include <string.h>

int main(int argc, char** argv) {
    int max = -1;
    int mb = 0;
    char* buffer;

    if(argc > 1)
        max = atoi(argv[1]);

    while((buffer=malloc(1024*1024)) != NULL && mb != max) {
        memset(buffer, 0, 1024*1http://www.linuxatemyram.com/play.html024);
        mb++;
        printf("Allocated %d MB\n", mb);
    }
    
    return 0;
}

(see http://www.linuxatemyram.com/play.html)
which gradually eats memory. I ran it several times without incident. To confirm it was hard drive related, I then switched swap to the old swap partition in the suspect drive and re-ran. While it was eating memory I tried to hurt it even more by copying files through samba. System crashed almost immediately with:

[ 1149.950484] ------------[ cut here ]------------
[ 1149.950488] kernel BUG at mm/filemap.c:764!
[ 1149.950494] invalid opcode: 0000 [#1] PREEMPT SMP
[ 1149.950554] Modules linked in: cfg80211 rfkill nls_iso8859_1 nls_cp437 vfat fat snd_hda_codec_hdmi kvm_amd kvm crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel aesni_intel evdev snd_hda_codec_realtek snd_hda_codec_generic nouveau video ttm drm_kms_helper drm snd_hda_intel mac_hid mxm_wmi snd_hda_controller edac_core sp5100_tco k10temp snd_hda_codec pcspkr serio_raw aes_x86_64 lrw gf128mul i2c_algo_bit i2c_piix4 r8169 i2c_core fam15h_power snd_hwdep snd_pcm snd_timer snd edac_mce_amd hwmon glue_helper ablk_helper cryptd mii tpm_infineon tpm_tis tpm shpchp wmi soundcore button acpi_cpufreq processor sch_fq_codel ext4 crc16 mbcache jbd2 sd_mod crc_t10dif crct10dif_common atkbd libps2 firewire_ohci firewire_core crc_itu_t ohci_pci ohci_hcd ehci_pci ehci_hcd i8042 serio ahci xhci_hcd libahci
[ 1149.950558]  libata usbcore scsi_mod usb_common
[ 1149.950563] CPU: 3 PID: 0 Comm: swapper/3 Not tainted 3.17.6-1-ARCH #1
[ 1149.950565] Hardware name: Gigabyte Technology Co., Ltd. To be filled by O.E.M./990FXA-UD3, BIOS FC 02/05/2013
[ 1149.950567] task: ffff880138400a10 ti: ffff88013840c000 task.ti: ffff88013840c000
[ 1149.950577] RIP: 0010:[<ffffffff81151f3c>]  [<ffffffff81151f3c>] end_page_writeback+0x4c/0x50
[ 1149.950579] RSP: 0018:ffff88013ed83d38  EFLAGS: 00010246
[ 1149.950581] RAX: 0000000000000000 RBX: ffffea00028924c0 RCX: 0000000000000000
[ 1149.950583] RDX: ffffffff81153eb7 RSI: 0000000000000000 RDI: ffff88013a010800
[ 1149.950584] RBP: ffff88013ed83d40 R08: 0000000000000000 R09: ffff88013a001701
[ 1149.950586] R10: ffff88013ed96460 R11: ffffea0002d7b800 R12: ffffea00028924c0
[ 1149.950587] R13: 0000000000000000 R14: 0000000000022000 R15: ffff8800bd1da000
[ 1149.950591] FS:  00007f71ef035700(0000) GS:ffff88013ed80000(0000) knlGS:0000000000000000
[ 1149.950593] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 1149.950594] CR2: 00007f70ec853000 CR3: 000000001f7c6000 CR4: 00000000000407e0
[ 1149.950596] Stack:
[ 1149.950600]  ffff8800b5ee0000 ffff88013ed83d60 ffffffff81192e76 ffff8800b5ee0000
[ 1149.950604]  00000000fffffffb ffff88013ed83d88 ffffffff81275c5b ffff8800b5ee0000
[ 1149.950608]  ffff8800b5ee0000 0000000000001000 ffff88013ed83dd0 ffffffff8127cd64
[ 1149.950609] Call Trace:
[ 1149.950613]  <IRQ>
[ 1149.950620]  [<ffffffff81192e76>] end_swap_bio_write+0x26/0x80
[ 1149.950626]  [<ffffffff81275c5b>] bio_endio+0x6b/0xa0
[ 1149.950631]  [<ffffffff8127cd64>] blk_update_request+0x94/0x380
[ 1149.950649]  [<ffffffffa0011e97>] scsi_end_request+0x37/0x1e0 [scsi_mod]
[ 1149.950666]  [<ffffffffa001215a>] scsi_io_completion+0xba/0x620 [scsi_mod]
[ 1149.950680]  [<ffffffffa000933e>] scsi_finish_command+0xbe/0x100 [scsi_mod]
[ 1149.950696]  [<ffffffffa00117fe>] scsi_softirq_done+0x10e/0x130 [scsi_mod]
[ 1149.950702]  [<ffffffff81283cfb>] blk_done_softirq+0x8b/0xb0
[ 1149.950708]  [<ffffffff81074662>] __do_softirq+0xf2/0x2e0
[ 1149.950713]  [<ffffffff810749a6>] irq_exit+0x86/0xb0
[ 1149.950718]  [<ffffffff815406f6>] do_IRQ+0x56/0xe0
[ 1149.950724]  [<ffffffff8153e6ed>] common_interrupt+0x6d/0x6d
[ 1149.950726]  <EOI>
[ 1149.950731]  [<ffffffff8101eae9>] ? sched_clock+0x9/0x10
[ 1149.950741]  [<ffffffff813f3192>] ? cpuidle_enter_state+0x62/0x1a0
[ 1149.950748]  [<ffffffff813f33b7>] cpuidle_enter+0x17/0x20
[ 1149.950754]  [<ffffffff810affdc>] cpu_startup_entry+0x3dc/0x430
[ 1149.950759]  [<ffffffff8104943e>] start_secondary+0x22e/0x2b0
[ 1149.950801] Code: 74 29 48 89 df e8 85 e5 ff ff 48 89 de ba 0d 00 00 00 48 89 c7 e8 b5 d5 f5 ff 5b 5d c3 66 90 f0 80 67 02 fb e8 f6 eb 00 00 eb cb <0f> 0b 66 90 66 66 66 66 90 55 85 f6 48 89 e5 75 13 85 d2 74 3f
[ 1149.950805] RIP  [<ffffffff81151f3c>] end_page_writeback+0x4c/0x50
[ 1149.950806]  RSP <ffff88013ed83d38>
[ 1149.950828] ---[ end trace 8edd938caee01b8a ]---
[ 1149.950830] Kernel panic - not syncing: Fatal exception in interrupt
[ 1149.950972] Kernel Offset: 0x0 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffff9fffffff)
[ 1149.950974] drm_kms_helper: panic occurred, switching back to text console
[ 1149.950999] bad: scheduling from the idle thread!
[ 1149.951002] CPU: 3 PID: 0 Comm: swapper/3 Tainted: G      D        3.17.6-1-ARCH #1
[ 1149.951004] Hardware name: Gigabyte Technology Co., Ltd. To be filled by O.E.M./990FXA-UD3, BIOS FC 02/05/2013
[ 1149.951008]  0000000000000000 6581ce0dc28146d2 ffff88013ed835a8 ffffffff81537c3e
[ 1149.951011]  ffff88013ed935c0 ffff88013ed835c0 ffffffff8109f9b5 ffff88013ed935c0
[ 1149.951014]  ffff88013ed835e8 ffffffff8109782d 0000000000000003 ffff88013ed935c0
[ 1149.951015] Call Trace:
[ 1149.951021]  <IRQ>  [<ffffffff81537c3e>] dump_stack+0x4d/0x6f
[ 1149.951026]  [<ffffffff8109f9b5>] dequeue_task_idle+0x25/0x30
[ 1149.951029]  [<ffffffff8109782d>] dequeue_task+0x5d/0x80
[ 1149.951032]  [<ffffffff81098b43>] deactivate_task+0x23/0x30
[ 1149.951035]  [<ffffffff81539097>] __schedule+0x4d7/0xa60
[ 1149.951040]  [<ffffffff8101e4a9>] ? read_tsc+0x9/0x10
[ 1149.951043]  [<ffffffff810dd2fb>] ? ktime_get+0x3b/0xb0
[ 1149.951046]  [<ffffffff8104ac0d>] ? lapic_next_event+0x1d/0x30
[ 1149.951050]  [<ffffffff810e4882>] ? clockevents_program_event+0x72/0x100
[ 1149.951055]  [<ffffffff810d8076>] ? __hrtimer_start_range_ns+0x1f6/0x420
[ 1149.951059]  [<ffffffff81539649>] schedule+0x29/0x70
[ 1149.951063]  [<ffffffff8153caec>] schedule_hrtimeout_range_clock.part.25+0xec/0x100
[ 1149.951067]  [<ffffffff810d7ba0>] ? __run_hrtimer+0x250/0x250
[ 1149.951071]  [<ffffffff810d82b4>] ? hrtimer_start_range_ns+0x14/0x20
[ 1149.951099]  [<ffffffffa04813f0>] ? nv50_display_flip_wait+0x50/0x50 [nouveau]
[ 1149.951103]  [<ffffffff8153cb19>] schedule_hrtimeout_range_clock+0x19/0x60
[ 1149.951107]  [<ffffffff8153cb73>] schedule_hrtimeout_range+0x13/0x20
[ 1149.951110]  [<ffffffff810d62af>] usleep_range+0x4f/0x70
[ 1149.951131]  [<ffffffffa0481418>] evo_sync_wait+0x28/0x30 [nouveau]
[ 1149.951156]  [<ffffffffa040b815>] nouveau_timer_wait_cb+0x65/0x80 [nouveau]
[ 1149.951178]  [<ffffffffa04804e5>] evo_sync+0xb5/0xd0 [nouveau]
[ 1149.951199]  [<ffffffffa0480768>] nv50_crtc_disable+0x28/0x90 [nouveau]
[ 1149.951206]  [<ffffffffa039c5c7>] __drm_helper_disable_unused_functions+0xb7/0xf0 [drm_kms_helper]
[ 1149.951212]  [<ffffffffa039ce0a>] drm_crtc_helper_set_config+0xfa/0xb40 [drm_kms_helper]
[ 1149.951235]  [<ffffffffa046d868>] nouveau_crtc_set_config+0x58/0x130 [nouveau]

I felt almost happy thinking I proved it was the old drive, however trying it several times over I got the same result with the swap partition in the new drive.
No swap is much better and the chances of the system crashing is much reduced. I'm guessing these errors are unrelated to the occasional errors I've been seeing and are simply due to overuse of memory (though disappointing that the whole system crashes when using memory too fast).

Anyway, shortly afterwards I start seeing the unprovoked "bad page" errors again:

Jan 13 20:25:31 engserv systemd[1]: Got automount request for /proc/sys/fs/binfmt_misc, triggered by 384 (find)
Jan 13 20:25:31 engserv systemd[1]: Mounting Arbitrary Executable File Formats File System...
Jan 13 20:25:31 engserv systemd[1]: Mounted Arbitrary Executable File Formats File System.
Jan 13 20:35:06 engserv sudo[4612]: pam_unix(sudo:auth): conversation failed
Jan 13 20:35:06 engserv sudo[4612]: pam_unix(sudo:auth): auth could not identify password for [sth]
Jan 13 20:38:05 engserv systemd[1]: Starting Cleanup of Temporary Directories...
Jan 13 20:38:06 engserv systemd[1]: Started Cleanup of Temporary Directories.
Jan 13 20:47:25 engserv kernel: BUG: Bad page map in process find  pte:08c21025 pmd:b2b64067
Jan 13 20:47:25 engserv kernel: page:ffffea0000230840 count:3 mapcount:-1 mapping:ffff8800b5908208 index:0x22
Jan 13 20:47:25 engserv kernel: page flags: 0x1fffe0000000828(uptodate|lru|private)
Jan 13 20:47:25 engserv kernel: page dumped because: bad pte
Jan 13 20:47:25 engserv kernel: addr:0000000000410000 vm_flags:00000875 anon_vma:          (null) mapping:ffff8800b8d41978 index:10
Jan 13 20:47:25 engserv kernel: vma->vm_ops->fault: filemap_fault+0x0/0x400
Jan 13 20:47:26 engserv kernel: vma->vm_file->f_op->mmap: ext4_file_mmap+0x0/0x30 [ext4]
Jan 13 20:47:26 engserv kernel: CPU: 3 PID: 11655 Comm: find Not tainted 3.17.6-1-ARCH #1
Jan 13 20:47:26 engserv kernel: Hardware name: Gigabyte Technology Co., Ltd. To be filled by O.E.M./990FXA-UD3, BIOS FC 02/05/2013
Jan 13 20:47:26 engserv kernel:  0000000000000000 0000000001134b5b ffff8800bd2d7c90 ffffffff81537c3e
Jan 13 20:47:26 engserv kernel:  0000000000410000 ffff8800bd2d7cd8 ffffffff8117d331 ffffffff8118c6a0
Jan 13 20:47:26 engserv kernel:  ffff8800b8d41978 ffff8800b2b64080 ffffea0000230840 0000000000410000
Jan 13 20:47:26 engserv kernel: Call Trace:
Jan 13 20:47:26 engserv kernel:  [<ffffffff81537c3e>] dump_stack+0x4d/0x6f
Jan 13 20:47:26 engserv kernel:  [<ffffffff8117d331>] print_bad_pte+0x1c1/0x290
Jan 13 20:47:26 engserv kernel:  [<ffffffff8118c6a0>] ? page_remove_rmap+0x130/0x170
Jan 13 20:47:26 engserv kernel:  [<ffffffff8117ee43>] unmap_single_vma+0x783/0x8b0
Jan 13 20:47:26 engserv kernel:  [<ffffffff8117fca4>] unmap_vmas+0x54/0xb0
Jan 13 20:47:26 engserv kernel:  [<ffffffff8118928c>] exit_mmap+0xac/0x1a0
Jan 13 20:47:26 engserv kernel:  [<ffffffff8105e9bb>] ? __do_page_fault+0x2eb/0x600
Jan 13 20:47:26 engserv kernel:  [<ffffffff8106d781>] mmput+0x51/0x120
Jan 13 20:47:26 engserv kernel:  [<ffffffff81072f95>] do_exit+0x345/0xb30
Jan 13 20:47:26 engserv kernel:  [<ffffffff81187fd0>] ? do_munmap+0x260/0x400
Jan 13 20:47:26 engserv kernel:  [<ffffffff81073803>] do_group_exit+0x43/0xc0
Jan 13 20:47:26 engserv kernel:  [<ffffffff81073894>] SyS_exit_group+0x14/0x20
Jan 13 20:47:26 engserv kernel:  [<ffffffff8153dc69>] system_call_fastpath+0x16/0x1b
Jan 13 20:47:26 engserv kernel: Disabling lock debugging due to kernel taint
Jan 13 20:47:26 engserv kernel: BUG: Bad page map in process find  pte:08c22025 pmd:b2b64067
Jan 13 20:47:26 engserv kernel: page:ffffea0000230880 count:3 mapcount:-1 mapping:ffff8800b5908208 index:0x23
Jan 13 20:47:26 engserv kernel: page flags: 0x1fffe0000000828(uptodate|lru|private)
Jan 13 20:47:26 engserv kernel: page dumped because: bad pte
Jan 13 20:47:26 engserv kernel: addr:0000000000411000 vm_flags:00000875 anon_vma:          (null) mapping:ffff8800b8d41978 index:11
Jan 13 20:47:26 engserv kernel: vma->vm_ops->fault: filemap_fault+0x0/0x400
Jan 13 20:47:26 engserv kernel: vma->vm_file->f_op->mmap: ext4_file_mmap+0x0/0x30 [ext4]
Jan 13 20:47:27 engserv kernel: CPU: 3 PID: 11655 Comm: find Tainted: G    B          3.17.6-1-ARCH #1
Jan 13 20:47:27 engserv kernel: Hardware name: Gigabyte Technology Co., Ltd. To be filled by O.E.M./990FXA-UD3, BIOS FC 02/05/2013
Jan 13 20:47:27 engserv kernel:  0000000000000000 0000000001134b5b ffff8800bd2d7c90 ffffffff81537c3e
Jan 13 20:47:27 engserv kernel:  0000000000411000 ffff8800bd2d7cd8 ffffffff8117d331 ffffffff8118c6a0
Jan 13 20:47:27 engserv kernel:  ffff8800b8d41978 ffff8800b2b64088 ffffea0000230880 0000000000411000
Jan 13 20:47:27 engserv kernel: Call Trace:
Jan 13 20:47:27 engserv kernel:  [<ffffffff81537c3e>] dump_stack+0x4d/0x6f
Jan 13 20:47:27 engserv kernel:  [<ffffffff8117d331>] print_bad_pte+0x1c1/0x290
Jan 13 20:47:27 engserv kernel:  [<ffffffff8118c6a0>] ? page_remove_rmap+0x130/0x170
Jan 13 20:47:27 engserv kernel:  [<ffffffff8117ee43>] unmap_single_vma+0x783/0x8b0
Jan 13 20:47:27 engserv kernel:  [<ffffffff8117fca4>] unmap_vmas+0x54/0xb0
Jan 13 20:47:27 engserv kernel:  [<ffffffff8118928c>] exit_mmap+0xac/0x1a0
Jan 13 20:47:27 engserv kernel:  [<ffffffff8105e9bb>] ? __do_page_fault+0x2eb/0x600
Jan 13 20:47:27 engserv kernel:  [<ffffffff8106d781>] mmput+0x51/0x120
Jan 13 20:47:27 engserv kernel:  [<ffffffff81072f95>] do_exit+0x345/0xb30
Jan 13 20:47:27 engserv kernel:  [<ffffffff81187fd0>] ? do_munmap+0x260/0x400
Jan 13 20:47:27 engserv kernel:  [<ffffffff81073803>] do_group_exit+0x43/0xc0
Jan 13 20:47:27 engserv kernel:  [<ffffffff81073894>] SyS_exit_group+0x14/0x20
Jan 13 20:47:27 engserv kernel:  [<ffffffff8153dc69>] system_call_fastpath+0x16/0x1b
Jan 13 20:48:29 engserv sudo[12206]: sth : TTY=tty4 ; PWD=/media/data/ ; USER=root ; COMMAND=/usr/bin/journalctl -b --no-pager
Jan 13 20:48:29 engserv sudo[12206]: pam_unix(sudo:session): session opened for user root by sth(uid=0)

On this particular occasion I was looping through output of find (8 or so lines, IFS set to $'\n') to create files.
On another occasion, no swap was even present but while running the memory eating program:

Jan 13 20:07:18 engserv kernel: BUG: Bad page map in process a.out  pte:80000000a6094047 pmd:b6478067
Jan 13 20:07:18 engserv kernel: page:ffffea0002982500 count:1 mapcount:-1 mapping:ffff88007fdcd559 index:0x7f380cf13
Jan 13 20:07:18 engserv kernel: page flags: 0x1fffe0000080028(uptodate|lru|swapbacked)
Jan 13 20:07:19 engserv kernel: page dumped because: bad pte
Jan 13 20:07:19 engserv kernel: addr:00007f380cf13000 vm_flags:00100073 anon_vma:ffff88007fdcd558 mapping:          (null) index:7f380cf13
Jan 13 20:07:20 engserv kernel: CPU: 2 PID: 397 Comm: a.out Not tainted 3.17.6-1-ARCH #1
Jan 13 20:07:20 engserv kernel: Hardware name: Gigabyte Technology Co., Ltd. To be filled by O.E.M./990FXA-UD3, BIOS FC 02/05/2013
Jan 13 20:07:20 engserv kernel:  0000000000000000 000000003a5f60f9 ffff880029fa3c90 ffffffff81537c3e
Jan 13 20:07:20 engserv kernel:  00007f380cf13000 ffff880029fa3cd8 ffffffff8117d331 ffffffff8118c63d
Jan 13 20:07:20 engserv kernel:  0000000000000000 ffff8800b6478898 ffffea0002982500 00007f380cf13000
Jan 13 20:07:20 engserv kernel: Call Trace:
Jan 13 20:07:20 engserv kernel:  [<ffffffff81537c3e>] dump_stack+0x4d/0x6f
Jan 13 20:07:20 engserv kernel:  [<ffffffff8117d331>] print_bad_pte+0x1c1/0x290
Jan 13 20:07:20 engserv kernel:  [<ffffffff8118c63d>] ? page_remove_rmap+0xcd/0x170
Jan 13 20:07:20 engserv kernel:  [<ffffffff8117ee43>] unmap_single_vma+0x783/0x8b0
Jan 13 20:07:20 engserv kernel:  [<ffffffff8117fca4>] unmap_vmas+0x54/0xb0
Jan 13 20:07:20 engserv kernel:  [<ffffffff8118928c>] exit_mmap+0xac/0x1a0
Jan 13 20:07:20 engserv kernel:  [<ffffffff8106d781>] mmput+0x51/0x120
Jan 13 20:07:20 engserv kernel:  [<ffffffff81072f95>] do_exit+0x345/0xb30
Jan 13 20:07:20 engserv kernel:  [<ffffffff81073803>] do_group_exit+0x43/0xc0
Jan 13 20:07:20 engserv kernel:  [<ffffffff81073894>] SyS_exit_group+0x14/0x20
Jan 13 20:07:20 engserv kernel:  [<ffffffff8153dc69>] system_call_fastpath+0x16/0x1b
Jan 13 20:07:20 engserv kernel: Disabling lock debugging due to kernel taint
Jan 13 20:07:20 engserv kernel: BUG: Bad page state in process a.out  pfn:a6094
Jan 13 20:07:20 engserv kernel: page:ffffea0002982500 count:0 mapcount:-1 mapping:          (null) index:0x7f380cf13
Jan 13 20:07:20 engserv kernel: page flags: 0x1fffe0000080008(uptodate|swapbacked)
Jan 13 20:07:20 engserv kernel: page dumped because: nonzero mapcount
Jan 13 20:07:20 engserv kernel: Modules linked in: cfg80211 rfkill nls_iso8859_1 nls_cp437 vfat fat nouveau video ttm snd_hda_codec_hdmi drm_kms_helper mxm_wmi drm edac_core kvm_amd kvm pcspkr serio_raw crct10dif_pclmul crc32_pclmul crc32c_intel evdev fam15h_power ghash_clmulni_intel mac_hid sp5100_tco edac_mce_amd r8169 aesni_intel i2c_piix4 i2c_algo_bit aes_x86_64 lrw gf128mul glue_helper k10temp ablk_helper i2c_core hwmon cryptd mii snd_hda_codec_realtek snd_hda_codec_generic shpchp snd_hda_intel snd_hda_controller snd_hda_codec snd_hwdep snd_pcm snd_timer snd soundcore tpm_infineon wmi tpm_tis tpm button acpi_cpufreq processor sch_fq_codel ext4 crc16 mbcache jbd2 sd_mod crc_t10dif crct10dif_common atkbd libps2 firewire_ohci firewire_core crc_itu_t ehci_pci ohci_pci ohci_hcd ahci libahci ehci_hcd libata xhci_hcd
Jan 13 20:07:20 engserv kernel:  scsi_mod usbcore usb_common i8042 serio
Jan 13 20:07:20 engserv kernel: CPU: 2 PID: 397 Comm: a.out Tainted: G    B          3.17.6-1-ARCH #1
Jan 13 20:07:20 engserv kernel: Hardware name: Gigabyte Technology Co., Ltd. To be filled by O.E.M./990FXA-UD3, BIOS FC 02/05/2013
Jan 13 20:07:20 engserv kernel:  0000000000000000 000000003a5f60f9 ffff880029fa3b10 ffffffff81537c3e
Jan 13 20:07:20 engserv kernel:  ffffea0002982500 ffff880029fa3b38 ffffffff811592c0 ffffea0002982500
Jan 13 20:07:20 engserv kernel:  0000000000000000 ffffea0002982540 ffff880029fa3b80 ffffffff8115b710
Jan 13 20:07:20 engserv kernel: Call Trace:
Jan 13 20:07:20 engserv kernel:  [<ffffffff81537c3e>] dump_stack+0x4d/0x6f
Jan 13 20:07:20 engserv kernel:  [<ffffffff811592c0>] bad_page.part.72+0xb0/0x100
Jan 13 20:07:20 engserv kernel:  [<ffffffff8115b710>] free_pages_prepare+0x190/0x210
Jan 13 20:07:20 engserv kernel:  [<ffffffff8115b8b5>] free_hot_cold_page+0x35/0x1d0
Jan 13 20:07:20 engserv kernel:  [<ffffffff8115ba93>] free_hot_cold_page_list+0x43/0xc0
Jan 13 20:07:20 engserv kernel:  [<ffffffff81160329>] release_pages+0xc9/0x280
Jan 13 20:07:20 engserv kernel:  [<ffffffff81193b19>] free_pages_and_swap_cache+0xb9/0xe0
Jan 13 20:07:20 engserv kernel:  [<ffffffff8117d14c>] tlb_flush_mmu_free+0x2c/0x50
Jan 13 20:07:20 engserv kernel:  [<ffffffff8117eed7>] unmap_single_vma+0x817/0x8b0
Jan 13 20:07:20 engserv kernel:  [<ffffffff8117fca4>] unmap_vmas+0x54/0xb0
Jan 13 20:07:20 engserv kernel:  [<ffffffff8118928c>] exit_mmap+0xac/0x1a0
Jan 13 20:07:20 engserv kernel:  [<ffffffff8106d781>] mmput+0x51/0x120
Jan 13 20:07:20 engserv kernel:  [<ffffffff81072f95>] do_exit+0x345/0xb30
Jan 13 20:07:20 engserv kernel:  [<ffffffff81073803>] do_group_exit+0x43/0xc0
Jan 13 20:07:20 engserv kernel:  [<ffffffff81073894>] SyS_exit_group+0x14/0x20
Jan 13 20:07:20 engserv kernel:  [<ffffffff8153dc69>] system_call_fastpath+0x16/0x1b

At this stage I feel completely lost. This server is required urgently and needs to be stable. My employers are beginning to regret considering a linux machine. I'm convinced it can't be a bug in any software since this is a fresh install and I'm sure more people would've written about it. I can only think it's hardware related but have no proof.

Any advice much appreciated.

Last edited by stefanhartman (2015-01-14 16:32:41)

TheSaint · 2015-01-14 01:37:51

For production server purpose I'd not suggest a rolling distro like Arch (debian may dictate in that). In this case you may try to set up a LTS kernel for your server.
So you may go for it and add it to the boot loader's menu entries, without new re-installation.
Then you should go back in the time when you started having these problem, then check with the pacman.log what new installation would be a candidate to make you troubles. First is the kernel.

PS, your reports may be better in a file hosting, I feel that here they are obstructing readability.

Last edited by TheSaint (2015-01-14 01:40:25)

stefanhartman · 2015-01-14 08:09:49

Just installed LTS kernel. Will see if it makes any difference.

I am skeptical though since you'd have thought there'd be many similar issues reported here by others starting with a fresh install (unless I've got rare unsupported hardware or something, which I don't).

Regarding suspect packages:
This is a fresh install, 1 day old. So far I've installed only base and base-devel groups (using pacstrap) and then Samba and OpenSSH (with their dependencies, of course). I can try to perform the same tests again with smbd and sshd stopped, though I'm skeptical on that as well.
Besides, the crashes are not reliably reproducible (apart from the total system crash when running low on memory, is that normal?).

Thanks for the help. Any more is greatly appreciated.

Trilby · 2015-01-14 13:06:47

TheSaint wrote:

PS, your reports may be better in a file hosting, I feel that here they are obstructing readability.

They are a bit long - but I suspect the real problem is they should be in code tags, not quote tags. Stefan, would you mind editing to replace those with code tags.

stefanhartman · 2015-01-14 17:48:57

Trilby wrote:

TheSaint wrote:
PS, your reports may be better in a file hosting, I feel that here they are obstructing readability.
They are a bit long - but I suspect the real problem is they should be in code tags, not quote tags. Stefan, would you mind editing to replace those with code tags.

Done.
Sorry, I was going by the idea that they are quotes and code is for code, like the code I pasted. I didn't know the code boxes scroll and the others don't. I left it in the post as the guideline post in Newbie Corner suggested.

Spider.007 · 2015-01-14 18:12:52

What does 'cat /proc/sys/kernel/tainted' output? I'd definitely try a longer memtest run (eg, a few days) since all signs point towards memory problems. You might also check for a bios update

stefanhartman · 2015-01-14 20:05:18

Spider.007 wrote:

What does 'cat /proc/sys/kernel/tainted' output? I'd definitely try a longer memtest run (eg, a few days) since all signs point towards memory problems. You might also check for a bios update

/proc/sys/kernel/tainted contains "0"
From what I just read (here https://www.kernel.org/doc/Documentatio … acing.txt), "tainted" refers to the presence of abnormal/unsupported things, all identified by flags. Presumably the "0" here means not tainted? I also suppose this file is reset at boot?

Is there a way for me to keep these files (including journal files) alive after a crash so that I can read them afterwards? I know of 'kdump' but I have limited internet now and thus can't get the ABS tree for linux to compile with support.

I will try memtest over the weekend.

So far today during normal use (mostly read/write on a Samba share) and some heavy use of 'find' I have not had any problems.
If I use memory aggresively using the program posted above I can cause it to crash with the error seen in my first log, ie:

kernel BUG at mm/filecap.c 
... 
CPU: X PID: X Comm: swapper/3

This is especially likely to happen if I do something else while this program is running (for example, running "find /" ). If I leave it running on it's own, the program is usually stopped when it runs out of memory without the system crashing.
Is this behaviour normal at all? Does it happen normally when memory is completely exhausted while several processes require it?

I have tried using the linux-lts kernel. The tests using the memory eating program and "find" give the same results, however the system becomes much slower during heavy memory use - so much so that I can't do anything while it is using swap and only while it's using RAM.

TheSaint · 2015-01-14 21:42:21

How much big is your RAM and swap ?
Perhaps you may add one more swap file, for testing purposes.
I suspect the most problem starts within swapping. You may look at this for references.

stefanhartman · 2015-01-15 23:49:17

TheSaint wrote:

How much big is your RAM and swap ?
Perhaps you may add one more swap file, for testing purposes.
I suspect the most problem starts within swapping. You may look at this for references.

I've 4GB RAM and another 4GB swap partition.
I've tried using swapfile instead of the partition already to no avail.
I've also played with the swap performance settings, again, to no avail.

I've some more information to add now:

I left the system on last night and using it normally to see whether the hard drive replacement actually fixed the crashes (assuming the swap issues were separate). After 24 hours and some fair use, I was optimistic that the drive was in fact at fault. I then made some changes to a smb.conf file and restarted using:

sudo systemctl restart smbd.service

The systemd returned with an error saying smbd failed to start. I checked the logs and smbd reported a segfault. I try again several times, leave it a few minutes and try again (having reverted to the last working smb.conf), segfault still occurs. I then checked "free -m" and noticed that the memory is mostly unused but the entire RAM is used for cache (which I guess is normal anyway). I then cleared the cache:

echo 3 | tee /proc/sys/vm/drop_caches

and immediately I was able to restart smbd.

A few hours go by and I do some rsync'ing to a CIFS mounted share. Partway through I get the following:

Jan 15 18:17:01 engserv sudo[7859]: sth : TTY=pts/0 ; PWD=/mnt/smb/share2 ; USER=root ; COMMAND=/usr/bin/rsync --info=PROGRESS2 -a /mnt/smb/pc1/Proj/All/ /media/data/Proj/All/
Jan 15 18:17:01 engserv sudo[7859]: pam_unix(sudo:session): session opened for user root by sth(uid=0)
Jan 15 18:36:00 engserv kernel: INFO: task jbd2/sdb1-8:215 blocked for more than 120 seconds.
Jan 15 18:36:01 engserv kernel:       Not tainted 3.17.6-1-ARCH #1
Jan 15 18:36:01 engserv kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 15 18:36:01 engserv kernel: jbd2/sdb1-8     D 0000000000000000     0   215      2 0x00000000
Jan 15 18:36:01 engserv kernel:  ffff8800bcc27c90 0000000000000046 ffff8800bd24c670 00000000000135c0
Jan 15 18:36:01 engserv kernel:  ffff8800bcc27fd8 00000000000135c0 ffff88003b934670 ffff8800bd24c670
Jan 15 18:36:01 engserv kernel:  ffff8800bcc27be0 ffff8800bcc27bf8 ffff8800bcc27be0 ffffffffa024b3c7
Jan 15 18:36:01 engserv kernel: Call Trace:
Jan 15 18:36:01 engserv kernel:  [<ffffffffa024b3c7>] ? ext4_mb_unload_buddy.isra.18+0x27/0x30 [ext4]
Jan 15 18:36:01 engserv kernel:  [<ffffffff810b5f30>] ? cpuacct_charge+0x50/0x60
Jan 15 18:36:01 engserv kernel:  [<ffffffff810a4c9c>] ? update_curr+0xec/0x1b0
Jan 15 18:36:01 engserv kernel:  [<ffffffff810a51ff>] ? dequeue_entity+0x13f/0x580
Jan 15 18:36:01 engserv kernel:  [<ffffffff81539649>] schedule+0x29/0x70
Jan 15 18:36:01 engserv kernel:  [<ffffffffa00fb806>] jbd2_journal_commit_transaction+0x236/0x19c0 [jbd2]
Jan 15 18:36:01 engserv kernel:  [<ffffffff810a9954>] ? pick_next_task_fair+0x144/0x520
Jan 15 18:36:01 engserv kernel:  [<ffffffff810136b2>] ? __switch_to+0x1b2/0x5e0
Jan 15 18:36:01 engserv kernel:  [<ffffffff810af960>] ? __wake_up_sync+0x20/0x20
Jan 15 18:36:01 engserv kernel:  [<ffffffff810d659e>] ? try_to_del_timer_sync+0x5e/0x90
Jan 15 18:36:01 engserv kernel:  [<ffffffffa010280c>] kjournald2+0xec/0x2a0 [jbd2]
Jan 15 18:36:01 engserv kernel:  [<ffffffff810af960>] ? __wake_up_sync+0x20/0x20
Jan 15 18:36:01 engserv kernel:  [<ffffffffa0102720>] ? commit_timeout+0x10/0x10 [jbd2]
Jan 15 18:36:01 engserv kernel:  [<ffffffff8108e2ea>] kthread+0xea/0x100
Jan 15 18:36:01 engserv kernel:  [<ffffffff8108e200>] ? kthread_create_on_node+0x1b0/0x1b0
Jan 15 18:36:01 engserv kernel:  [<ffffffff8153dbbc>] ret_from_fork+0x7c/0xb0
Jan 15 18:36:01 engserv kernel:  [<ffffffff8108e200>] ? kthread_create_on_node+0x1b0/0x1b0
Jan 15 18:36:01 engserv kernel: INFO: task rsync:7862 blocked for more than 120 seconds.
Jan 15 18:36:01 engserv kernel:       Not tainted 3.17.6-1-ARCH #1
Jan 15 18:36:01 engserv kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 15 18:36:01 engserv kernel: rsync           D 0000000000000002     0  7862   7861 0x00000000
Jan 15 18:36:01 engserv kernel:  ffff8800bd337a80 0000000000000086 ffff88003b934670 00000000000135c0
Jan 15 18:36:01 engserv kernel:  ffff8800bd337fd8 00000000000135c0 ffff880138400000 ffff88003b934670
Jan 15 18:36:01 engserv kernel:  ffffffff00000e00 00000000010200da 0000000000000246 ffff88013eff96c0
Jan 15 18:36:01 engserv kernel: Call Trace:
Jan 15 18:36:01 engserv kernel:  [<ffffffff8115ab54>] ? __alloc_pages_nodemask+0x174/0xb40
Jan 15 18:36:01 engserv kernel:  [<ffffffff81539649>] schedule+0x29/0x70
Jan 15 18:36:01 engserv kernel:  [<ffffffffa00f808d>] wait_transaction_locked+0x8d/0xd0 [jbd2]
Jan 15 18:36:01 engserv kernel:  [<ffffffff810af960>] ? __wake_up_sync+0x20/0x20
Jan 15 18:36:01 engserv kernel:  [<ffffffffa00f83c2>] start_this_handle+0x262/0x610 [jbd2]
Jan 15 18:36:01 engserv kernel:  [<ffffffff81150c1e>] ? __add_to_page_cache_locked+0x24e/0x2c0
Jan 15 18:36:01 engserv kernel:  [<ffffffff811ab9da>] ? kmem_cache_alloc+0x16a/0x170
Jan 15 18:36:01 engserv kernel:  [<ffffffffa00f8b6b>] jbd2__journal_start+0xfb/0x210 [jbd2]
Jan 15 18:36:01 engserv kernel:  [<ffffffffa021ce4f>] ? ext4_da_write_begin+0x10f/0x350 [ext4]
Jan 15 18:36:01 engserv kernel:  [<ffffffffa02486cd>] __ext4_journal_start_sb+0x6d/0x110 [ext4]
Jan 15 18:36:01 engserv kernel:  [<ffffffffa021ce4f>] ext4_da_write_begin+0x10f/0x350 [ext4]
Jan 15 18:36:01 engserv kernel:  [<ffffffff8115191a>] generic_perform_write+0xca/0x1e0
Jan 15 18:36:01 engserv kernel:  [<ffffffff81153345>] __generic_file_write_iter+0x1e5/0x3b0
Jan 15 18:36:01 engserv kernel:  [<ffffffffa0211eba>] ext4_file_write_iter+0x11a/0x3f0 [ext4]
Jan 15 18:36:01 engserv kernel:  [<ffffffff811dc05b>] ? core_sys_select+0x2cb/0x330
Jan 15 18:36:01 engserv kernel:  [<ffffffff8142935b>] ? sock_aio_read.part.29+0xcb/0x100
Jan 15 18:36:01 engserv kernel:  [<ffffffff811c71ee>] new_sync_write+0x8e/0xd0
Jan 15 18:36:01 engserv kernel:  [<ffffffff811c7967>] vfs_write+0xb7/0x200
Jan 15 18:36:01 engserv kernel:  [<ffffffff811c787c>] ? vfs_read+0x13c/0x170
Jan 15 18:36:01 engserv kernel:  [<ffffffff811c85d9>] SyS_write+0x59/0xd0
Jan 15 18:36:01 engserv kernel:  [<ffffffff8153dc69>] system_call_fastpath+0x16/0x1b
Jan 15 18:38:00 engserv kernel: INFO: task jbd2/sdb1-8:215 blocked for more than 120 seconds.
Jan 15 18:38:00 engserv kernel:       Not tainted 3.17.6-1-ARCH #1
Jan 15 18:38:00 engserv kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 15 18:38:00 engserv kernel: jbd2/sdb1-8     D 0000000000000000     0   215      2 0x00000000
Jan 15 18:38:00 engserv kernel:  ffff8800bcc27c90 0000000000000046 ffff8800bd24c670 00000000000135c0
Jan 15 18:38:00 engserv kernel:  ffff8800bcc27fd8 00000000000135c0 ffff88003b934670 ffff8800bd24c670
Jan 15 18:38:00 engserv kernel:  ffff8800bcc27be0 ffff8800bcc27bf8 ffff8800bcc27be0 ffffffffa024b3c7
Jan 15 18:38:00 engserv kernel: Call Trace:
Jan 15 18:38:00 engserv kernel:  [<ffffffffa024b3c7>] ? ext4_mb_unload_buddy.isra.18+0x27/0x30 [ext4]
Jan 15 18:38:00 engserv kernel:  [<ffffffff810b5f30>] ? cpuacct_charge+0x50/0x60
Jan 15 18:38:00 engserv kernel:  [<ffffffff810a4c9c>] ? update_curr+0xec/0x1b0
Jan 15 18:38:00 engserv kernel:  [<ffffffff810a51ff>] ? dequeue_entity+0x13f/0x580
Jan 15 18:38:00 engserv kernel:  [<ffffffff81539649>] schedule+0x29/0x70
Jan 15 18:38:00 engserv kernel:  [<ffffffffa00fb806>] jbd2_journal_commit_transaction+0x236/0x19c0 [jbd2]
Jan 15 18:38:00 engserv kernel:  [<ffffffff810a9954>] ? pick_next_task_fair+0x144/0x520
Jan 15 18:38:00 engserv kernel:  [<ffffffff810136b2>] ? __switch_to+0x1b2/0x5e0
Jan 15 18:38:00 engserv kernel:  [<ffffffff810af960>] ? __wake_up_sync+0x20/0x20
Jan 15 18:38:00 engserv kernel:  [<ffffffff810d659e>] ? try_to_del_timer_sync+0x5e/0x90
Jan 15 18:38:00 engserv kernel:  [<ffffffffa010280c>] kjournald2+0xec/0x2a0 [jbd2]
Jan 15 18:38:00 engserv kernel:  [<ffffffff810af960>] ? __wake_up_sync+0x20/0x20
Jan 15 18:38:00 engserv kernel:  [<ffffffffa0102720>] ? commit_timeout+0x10/0x10 [jbd2]
Jan 15 18:38:00 engserv kernel:  [<ffffffff8108e2ea>] kthread+0xea/0x100
Jan 15 18:38:00 engserv kernel:  [<ffffffff8108e200>] ? kthread_create_on_node+0x1b0/0x1b0
Jan 15 18:38:00 engserv kernel:  [<ffffffff8153dbbc>] ret_from_fork+0x7c/0xb0
Jan 15 18:38:00 engserv kernel:  [<ffffffff8108e200>] ? kthread_create_on_node+0x1b0/0x1b0
Jan 15 18:38:00 engserv kernel: INFO: task rsync:7862 blocked for more than 120 seconds.
Jan 15 18:38:00 engserv kernel:       Not tainted 3.17.6-1-ARCH #1
Jan 15 18:38:00 engserv kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 15 18:38:00 engserv kernel: rsync           D 0000000000000002     0  7862   7861 0x00000000
Jan 15 18:38:00 engserv kernel:  ffff8800bd337a80 0000000000000086 ffff88003b934670 00000000000135c0
Jan 15 18:38:00 engserv kernel:  ffff8800bd337fd8 00000000000135c0 ffff880138400000 ffff88003b934670
Jan 15 18:38:00 engserv kernel:  ffffffff00000e00 00000000010200da 0000000000000246 ffff88013eff96c0
Jan 15 18:38:00 engserv kernel: Call Trace:
Jan 15 18:38:00 engserv kernel:  [<ffffffff8115ab54>] ? __alloc_pages_nodemask+0x174/0xb40
Jan 15 18:38:00 engserv kernel:  [<ffffffff81539649>] schedule+0x29/0x70
Jan 15 18:38:00 engserv kernel:  [<ffffffffa00f808d>] wait_transaction_locked+0x8d/0xd0 [jbd2]
Jan 15 18:38:00 engserv kernel:  [<ffffffff810af960>] ? __wake_up_sync+0x20/0x20
Jan 15 18:38:00 engserv kernel:  [<ffffffffa00f83c2>] start_this_handle+0x262/0x610 [jbd2]
Jan 15 18:38:00 engserv kernel:  [<ffffffff81150c1e>] ? __add_to_page_cache_locked+0x24e/0x2c0
Jan 15 18:38:01 engserv kernel:  [<ffffffff811ab9da>] ? kmem_cache_alloc+0x16a/0x170
Jan 15 18:38:01 engserv kernel:  [<ffffffffa00f8b6b>] jbd2__journal_start+0xfb/0x210 [jbd2]
Jan 15 18:38:01 engserv kernel:  [<ffffffffa021ce4f>] ? ext4_da_write_begin+0x10f/0x350 [ext4]
Jan 15 18:38:01 engserv kernel:  [<ffffffffa02486cd>] __ext4_journal_start_sb+0x6d/0x110 [ext4]
Jan 15 18:38:01 engserv kernel:  [<ffffffffa021ce4f>] ext4_da_write_begin+0x10f/0x350 [ext4]
Jan 15 18:38:01 engserv kernel:  [<ffffffff8115191a>] generic_perform_write+0xca/0x1e0
Jan 15 18:38:01 engserv kernel:  [<ffffffff81153345>] __generic_file_write_iter+0x1e5/0x3b0
Jan 15 18:38:01 engserv kernel:  [<ffffffffa0211eba>] ext4_file_write_iter+0x11a/0x3f0 [ext4]
Jan 15 18:38:01 engserv kernel:  [<ffffffff811dc05b>] ? core_sys_select+0x2cb/0x330
Jan 15 18:38:01 engserv kernel:  [<ffffffff8142935b>] ? sock_aio_read.part.29+0xcb/0x100
Jan 15 18:38:01 engserv kernel:  [<ffffffff811c71ee>] new_sync_write+0x8e/0xd0
Jan 15 18:38:01 engserv kernel:  [<ffffffff811c7967>] vfs_write+0xb7/0x200
Jan 15 18:38:01 engserv kernel:  [<ffffffff811c787c>] ? vfs_read+0x13c/0x170
Jan 15 18:38:01 engserv kernel:  [<ffffffff811c85d9>] SyS_write+0x59/0xd0
Jan 15 18:38:01 engserv kernel:  [<ffffffff8153dc69>] system_call_fastpath+0x16/0x1b
Jan 15 18:40:00 engserv kernel: INFO: task jbd2/sdb1-8:215 blocked for more than 120 seconds.
Jan 15 18:40:00 engserv kernel:       Not tainted 3.17.6-1-ARCH #1
Jan 15 18:40:00 engserv kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 15 18:40:00 engserv kernel: jbd2/sdb1-8     D 0000000000000000     0   215      2 0x00000000
Jan 15 18:40:00 engserv kernel:  ffff8800bcc27c90 0000000000000046 ffff8800bd24c670 00000000000135c0
Jan 15 18:40:00 engserv kernel:  ffff8800bcc27fd8 00000000000135c0 ffff88003b934670 ffff8800bd24c670
Jan 15 18:40:00 engserv kernel:  ffff8800bcc27be0 ffff8800bcc27bf8 ffff8800bcc27be0 ffffffffa024b3c7
Jan 15 18:40:00 engserv kernel: Call Trace:
Jan 15 18:40:00 engserv kernel:  [<ffffffffa024b3c7>] ? ext4_mb_unload_buddy.isra.18+0x27/0x30 [ext4]
Jan 15 18:40:00 engserv kernel:  [<ffffffff810b5f30>] ? cpuacct_charge+0x50/0x60
Jan 15 18:40:00 engserv kernel:  [<ffffffff810a4c9c>] ? update_curr+0xec/0x1b0
Jan 15 18:40:00 engserv kernel:  [<ffffffff810a51ff>] ? dequeue_entity+0x13f/0x580
Jan 15 18:40:00 engserv kernel:  [<ffffffff81539649>] schedule+0x29/0x70
Jan 15 18:40:00 engserv kernel:  [<ffffffffa00fb806>] jbd2_journal_commit_transaction+0x236/0x19c0 [jbd2]
Jan 15 18:40:00 engserv kernel:  [<ffffffff810a9954>] ? pick_next_task_fair+0x144/0x520
Jan 15 18:40:01 engserv kernel:  [<ffffffff810136b2>] ? __switch_to+0x1b2/0x5e0
Jan 15 18:40:01 engserv kernel:  [<ffffffff810af960>] ? __wake_up_sync+0x20/0x20
Jan 15 18:40:01 engserv kernel:  [<ffffffff810d659e>] ? try_to_del_timer_sync+0x5e/0x90
Jan 15 18:40:01 engserv kernel:  [<ffffffffa010280c>] kjournald2+0xec/0x2a0 [jbd2]
Jan 15 18:40:01 engserv kernel:  [<ffffffff810af960>] ? __wake_up_sync+0x20/0x20
Jan 15 18:40:01 engserv kernel:  [<ffffffffa0102720>] ? commit_timeout+0x10/0x10 [jbd2]
Jan 15 18:40:01 engserv kernel:  [<ffffffff8108e2ea>] kthread+0xea/0x100
Jan 15 18:40:01 engserv kernel:  [<ffffffff8108e200>] ? kthread_create_on_node+0x1b0/0x1b0
Jan 15 18:40:01 engserv kernel:  [<ffffffff8153dbbc>] ret_from_fork+0x7c/0xb0
Jan 15 18:40:01 engserv kernel:  [<ffffffff8108e200>] ? kthread_create_on_node+0x1b0/0x1b0
Jan 15 18:40:01 engserv kernel: INFO: task rsync:7862 blocked for more than 120 seconds.
Jan 15 18:40:01 engserv kernel:       Not tainted 3.17.6-1-ARCH #1
Jan 15 18:40:01 engserv kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 15 18:40:01 engserv kernel: rsync           D 0000000000000002     0  7862   7861 0x00000000
Jan 15 18:40:01 engserv kernel:  ffff8800bd337a80 0000000000000086 ffff88003b934670 00000000000135c0
Jan 15 18:40:01 engserv kernel:  ffff8800bd337fd8 00000000000135c0 ffff880138400000 ffff88003b934670
Jan 15 18:40:01 engserv kernel:  ffffffff00000e00 00000000010200da 0000000000000246 ffff88013eff96c0
Jan 15 18:40:01 engserv kernel: Call Trace:
Jan 15 18:40:01 engserv kernel:  [<ffffffff8115ab54>] ? __alloc_pages_nodemask+0x174/0xb40
Jan 15 18:40:01 engserv kernel:  [<ffffffff81539649>] schedule+0x29/0x70
Jan 15 18:40:01 engserv kernel:  [<ffffffffa00f808d>] wait_transaction_locked+0x8d/0xd0 [jbd2]
Jan 15 18:40:01 engserv kernel:  [<ffffffff810af960>] ? __wake_up_sync+0x20/0x20
Jan 15 18:40:01 engserv kernel:  [<ffffffffa00f83c2>] start_this_handle+0x262/0x610 [jbd2]
Jan 15 18:40:01 engserv kernel:  [<ffffffff81150c1e>] ? __add_to_page_cache_locked+0x24e/0x2c0
Jan 15 18:40:01 engserv kernel:  [<ffffffff811ab9da>] ? kmem_cache_alloc+0x16a/0x170
Jan 15 18:40:01 engserv kernel:  [<ffffffffa00f8b6b>] jbd2__journal_start+0xfb/0x210 [jbd2]
Jan 15 18:40:01 engserv kernel:  [<ffffffffa021ce4f>] ? ext4_da_write_begin+0x10f/0x350 [ext4]
Jan 15 18:40:01 engserv kernel:  [<ffffffffa02486cd>] __ext4_journal_start_sb+0x6d/0x110 [ext4]
Jan 15 18:40:01 engserv kernel:  [<ffffffffa021ce4f>] ext4_da_write_begin+0x10f/0x350 [ext4]
Jan 15 18:40:01 engserv kernel:  [<ffffffff8115191a>] generic_perform_write+0xca/0x1e0
Jan 15 18:40:01 engserv kernel:  [<ffffffff81153345>] __generic_file_write_iter+0x1e5/0x3b0
Jan 15 18:40:01 engserv kernel:  [<ffffffffa0211eba>] ext4_file_write_iter+0x11a/0x3f0 [ext4]
Jan 15 18:40:01 engserv kernel:  [<ffffffff811dc05b>] ? core_sys_select+0x2cb/0x330
Jan 15 18:40:01 engserv kernel:  [<ffffffff8142935b>] ? sock_aio_read.part.29+0xcb/0x100
Jan 15 18:40:01 engserv kernel:  [<ffffffff811c71ee>] new_sync_write+0x8e/0xd0
Jan 15 18:40:01 engserv kernel:  [<ffffffff811c7967>] vfs_write+0xb7/0x200
Jan 15 18:40:01 engserv kernel:  [<ffffffff811c787c>] ? vfs_read+0x13c/0x170
Jan 15 18:40:01 engserv kernel:  [<ffffffff811c85d9>] SyS_write+0x59/0xd0
Jan 15 18:40:01 engserv kernel:  [<ffffffff8153dc69>] system_call_fastpath+0x16/0x1b
Jan 15 18:42:00 engserv kernel: INFO: task jbd2/sdb1-8:215 blocked for more than 120 seconds.
Jan 15 18:42:01 engserv kernel:       Not tainted 3.17.6-1-ARCH #1
Jan 15 18:42:01 engserv kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 15 18:42:01 engserv kernel: jbd2/sdb1-8     D 0000000000000000     0   215      2 0x00000000
Jan 15 18:42:01 engserv kernel:  ffff8800bcc27c90 0000000000000046 ffff8800bd24c670 00000000000135c0
Jan 15 18:42:01 engserv kernel:  ffff8800bcc27fd8 00000000000135c0 ffff88003b934670 ffff8800bd24c670
Jan 15 18:42:01 engserv kernel:  ffff8800bcc27be0 ffff8800bcc27bf8 ffff8800bcc27be0 ffffffffa024b3c7
Jan 15 18:42:01 engserv kernel: Call Trace:
Jan 15 18:42:01 engserv kernel:  [<ffffffffa024b3c7>] ? ext4_mb_unload_buddy.isra.18+0x27/0x30 [ext4]
Jan 15 18:42:01 engserv kernel:  [<ffffffff810b5f30>] ? cpuacct_charge+0x50/0x60
Jan 15 18:42:01 engserv kernel:  [<ffffffff810a4c9c>] ? update_curr+0xec/0x1b0
Jan 15 18:42:01 engserv kernel:  [<ffffffff810a51ff>] ? dequeue_entity+0x13f/0x580
Jan 15 18:42:01 engserv kernel:  [<ffffffff81539649>] schedule+0x29/0x70
Jan 15 18:42:01 engserv kernel:  [<ffffffffa00fb806>] jbd2_journal_commit_transaction+0x236/0x19c0 [jbd2]
Jan 15 18:42:01 engserv kernel:  [<ffffffff810a9954>] ? pick_next_task_fair+0x144/0x520
Jan 15 18:42:01 engserv kernel:  [<ffffffff810136b2>] ? __switch_to+0x1b2/0x5e0
Jan 15 18:42:01 engserv kernel:  [<ffffffff810af960>] ? __wake_up_sync+0x20/0x20
Jan 15 18:42:01 engserv kernel:  [<ffffffff810d659e>] ? try_to_del_timer_sync+0x5e/0x90
Jan 15 18:42:01 engserv kernel:  [<ffffffffa010280c>] kjournald2+0xec/0x2a0 [jbd2]
Jan 15 18:42:01 engserv kernel:  [<ffffffff810af960>] ? __wake_up_sync+0x20/0x20
Jan 15 18:42:01 engserv kernel:  [<ffffffffa0102720>] ? commit_timeout+0x10/0x10 [jbd2]
Jan 15 18:42:01 engserv kernel:  [<ffffffff8108e2ea>] kthread+0xea/0x100
Jan 15 18:42:01 engserv kernel:  [<ffffffff8108e200>] ? kthread_create_on_node+0x1b0/0x1b0
Jan 15 18:42:01 engserv kernel:  [<ffffffff8153dbbc>] ret_from_fork+0x7c/0xb0
Jan 15 18:42:01 engserv kernel:  [<ffffffff8108e200>] ? kthread_create_on_node+0x1b0/0x1b0
Jan 15 18:42:01 engserv kernel: INFO: task rsync:7862 blocked for more than 120 seconds.
Jan 15 18:42:01 engserv kernel:       Not tainted 3.17.6-1-ARCH #1
Jan 15 18:42:01 engserv kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 15 18:42:01 engserv kernel: rsync           D 0000000000000002     0  7862   7861 0x00000000
Jan 15 18:42:01 engserv kernel:  ffff8800bd337a80 0000000000000086 ffff88003b934670 00000000000135c0
Jan 15 18:42:01 engserv kernel:  ffff8800bd337fd8 00000000000135c0 ffff880138400000 ffff88003b934670
Jan 15 18:42:01 engserv kernel:  ffffffff00000e00 00000000010200da 0000000000000246 ffff88013eff96c0
Jan 15 18:42:01 engserv kernel: Call Trace:
Jan 15 18:42:01 engserv kernel:  [<ffffffff8115ab54>] ? __alloc_pages_nodemask+0x174/0xb40
Jan 15 18:42:01 engserv kernel:  [<ffffffff81539649>] schedule+0x29/0x70
Jan 15 18:42:01 engserv kernel:  [<ffffffffa00f808d>] wait_transaction_locked+0x8d/0xd0 [jbd2]
Jan 15 18:42:01 engserv kernel:  [<ffffffff810af960>] ? __wake_up_sync+0x20/0x20
Jan 15 18:42:01 engserv kernel:  [<ffffffffa00f83c2>] start_this_handle+0x262/0x610 [jbd2]
Jan 15 18:42:01 engserv kernel:  [<ffffffff81150c1e>] ? __add_to_page_cache_locked+0x24e/0x2c0
Jan 15 18:42:01 engserv kernel:  [<ffffffff811ab9da>] ? kmem_cache_alloc+0x16a/0x170
Jan 15 18:42:01 engserv kernel:  [<ffffffffa00f8b6b>] jbd2__journal_start+0xfb/0x210 [jbd2]
Jan 15 18:42:01 engserv kernel:  [<ffffffffa021ce4f>] ? ext4_da_write_begin+0x10f/0x350 [ext4]
Jan 15 18:42:01 engserv kernel:  [<ffffffffa02486cd>] __ext4_journal_start_sb+0x6d/0x110 [ext4]
Jan 15 18:42:01 engserv kernel:  [<ffffffffa021ce4f>] ext4_da_write_begin+0x10f/0x350 [ext4]
Jan 15 18:42:01 engserv kernel:  [<ffffffff8115191a>] generic_perform_write+0xca/0x1e0
Jan 15 18:42:01 engserv kernel:  [<ffffffff81153345>] __generic_file_write_iter+0x1e5/0x3b0
Jan 15 18:42:01 engserv kernel:  [<ffffffffa0211eba>] ext4_file_write_iter+0x11a/0x3f0 [ext4]
Jan 15 18:42:01 engserv kernel:  [<ffffffff811dc05b>] ? core_sys_select+0x2cb/0x330
Jan 15 18:42:01 engserv kernel:  [<ffffffff8142935b>] ? sock_aio_read.part.29+0xcb/0x100
Jan 15 18:42:01 engserv kernel:  [<ffffffff811c71ee>] new_sync_write+0x8e/0xd0
Jan 15 18:42:01 engserv kernel:  [<ffffffff811c7967>] vfs_write+0xb7/0x200
Jan 15 18:42:01 engserv kernel:  [<ffffffff811c787c>] ? vfs_read+0x13c/0x170
Jan 15 18:42:01 engserv kernel:  [<ffffffff811c85d9>] SyS_write+0x59/0xd0
Jan 15 18:42:01 engserv kernel:  [<ffffffff8153dc69>] system_call_fastpath+0x16/0x1b
Jan 15 18:44:00 engserv kernel: INFO: task jbd2/sdb1-8:215 blocked for more than 120 seconds.
Jan 15 18:44:00 engserv kernel:       Not tainted 3.17.6-1-ARCH #1
Jan 15 18:44:00 engserv kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 15 18:44:00 engserv kernel: jbd2/sdb1-8     D 0000000000000000     0   215      2 0x00000000
Jan 15 18:44:00 engserv kernel:  ffff8800bcc27c90 0000000000000046 ffff8800bd24c670 00000000000135c0
Jan 15 18:44:00 engserv kernel:  ffff8800bcc27fd8 00000000000135c0 ffff88003b934670 ffff8800bd24c670
Jan 15 18:44:00 engserv kernel:  ffff8800bcc27be0 ffff8800bcc27bf8 ffff8800bcc27be0 ffffffffa024b3c7
Jan 15 18:44:00 engserv kernel: Call Trace:
Jan 15 18:44:00 engserv kernel:  [<ffffffffa024b3c7>] ? ext4_mb_unload_buddy.isra.18+0x27/0x30 [ext4]
Jan 15 18:44:00 engserv kernel:  [<ffffffff810b5f30>] ? cpuacct_charge+0x50/0x60
Jan 15 18:44:00 engserv kernel:  [<ffffffff810a4c9c>] ? update_curr+0xec/0x1b0
Jan 15 18:44:00 engserv kernel:  [<ffffffff810a51ff>] ? dequeue_entity+0x13f/0x580
Jan 15 18:44:00 engserv kernel:  [<ffffffff81539649>] schedule+0x29/0x70
Jan 15 18:44:00 engserv kernel:  [<ffffffffa00fb806>] jbd2_journal_commit_transaction+0x236/0x19c0 [jbd2]
Jan 15 18:44:00 engserv kernel:  [<ffffffff810a9954>] ? pick_next_task_fair+0x144/0x520
Jan 15 18:44:00 engserv kernel:  [<ffffffff810136b2>] ? __switch_to+0x1b2/0x5e0
Jan 15 18:44:00 engserv kernel:  [<ffffffff810af960>] ? __wake_up_sync+0x20/0x20
Jan 15 18:44:00 engserv kernel:  [<ffffffff810d659e>] ? try_to_del_timer_sync+0x5e/0x90
Jan 15 18:44:00 engserv kernel:  [<ffffffffa010280c>] kjournald2+0xec/0x2a0 [jbd2]
Jan 15 18:44:00 engserv kernel:  [<ffffffff810af960>] ? __wake_up_sync+0x20/0x20
Jan 15 18:44:00 engserv kernel:  [<ffffffffa0102720>] ? commit_timeout+0x10/0x10 [jbd2]
Jan 15 18:44:00 engserv kernel:  [<ffffffff8108e2ea>] kthread+0xea/0x100
Jan 15 18:44:00 engserv kernel:  [<ffffffff8108e200>] ? kthread_create_on_node+0x1b0/0x1b0
Jan 15 18:44:00 engserv kernel:  [<ffffffff8153dbbc>] ret_from_fork+0x7c/0xb0
Jan 15 18:44:00 engserv kernel:  [<ffffffff8108e200>] ? kthread_create_on_node+0x1b0/0x1b0
Jan 15 18:44:00 engserv kernel: INFO: task rsync:7862 blocked for more than 120 seconds.
Jan 15 18:44:00 engserv kernel:       Not tainted 3.17.6-1-ARCH #1
Jan 15 18:44:00 engserv kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 15 18:44:00 engserv kernel: rsync           D 0000000000000002     0  7862   7861 0x00000000
Jan 15 18:44:00 engserv kernel:  ffff8800bd337a80 0000000000000086 ffff88003b934670 00000000000135c0
Jan 15 18:44:00 engserv kernel:  ffff8800bd337fd8 00000000000135c0 ffff880138400000 ffff88003b934670
Jan 15 18:44:00 engserv kernel:  ffffffff00000e00 00000000010200da 0000000000000246 ffff88013eff96c0
Jan 15 18:44:00 engserv kernel: Call Trace:
Jan 15 18:44:01 engserv kernel:  [<ffffffff8115ab54>] ? __alloc_pages_nodemask+0x174/0xb40
Jan 15 18:44:01 engserv kernel:  [<ffffffff81539649>] schedule+0x29/0x70
Jan 15 18:44:01 engserv kernel:  [<ffffffffa00f808d>] wait_transaction_locked+0x8d/0xd0 [jbd2]
Jan 15 18:44:01 engserv kernel:  [<ffffffff810af960>] ? __wake_up_sync+0x20/0x20
Jan 15 18:44:01 engserv kernel:  [<ffffffffa00f83c2>] start_this_handle+0x262/0x610 [jbd2]
Jan 15 18:44:01 engserv kernel:  [<ffffffff81150c1e>] ? __add_to_page_cache_locked+0x24e/0x2c0
Jan 15 18:44:01 engserv kernel:  [<ffffffff811ab9da>] ? kmem_cache_alloc+0x16a/0x170
Jan 15 18:44:01 engserv kernel:  [<ffffffffa00f8b6b>] jbd2__journal_start+0xfb/0x210 [jbd2]
Jan 15 18:44:01 engserv kernel:  [<ffffffffa021ce4f>] ? ext4_da_write_begin+0x10f/0x350 [ext4]
Jan 15 18:44:01 engserv kernel:  [<ffffffffa02486cd>] __ext4_journal_start_sb+0x6d/0x110 [ext4]
Jan 15 18:44:01 engserv kernel:  [<ffffffffa021ce4f>] ext4_da_write_begin+0x10f/0x350 [ext4]
Jan 15 18:44:01 engserv kernel:  [<ffffffff8115191a>] generic_perform_write+0xca/0x1e0
Jan 15 18:44:01 engserv kernel:  [<ffffffff81153345>] __generic_file_write_iter+0x1e5/0x3b0
Jan 15 18:44:01 engserv kernel:  [<ffffffffa0211eba>] ext4_file_write_iter+0x11a/0x3f0 [ext4]
Jan 15 18:44:01 engserv kernel:  [<ffffffff811dc05b>] ? core_sys_select+0x2cb/0x330
Jan 15 18:44:01 engserv kernel:  [<ffffffff8142935b>] ? sock_aio_read.part.29+0xcb/0x100
Jan 15 18:44:01 engserv kernel:  [<ffffffff811c71ee>] new_sync_write+0x8e/0xd0
Jan 15 18:44:01 engserv kernel:  [<ffffffff811c7967>] vfs_write+0xb7/0x200
Jan 15 18:44:01 engserv kernel:  [<ffffffff811c787c>] ? vfs_read+0x13c/0x170
Jan 15 18:44:01 engserv kernel:  [<ffffffff811c85d9>] SyS_write+0x59/0xd0
Jan 15 18:44:01 engserv kernel:  [<ffffffff8153dc69>] system_call_fastpath+0x16/0x1b
Jan 15 18:48:48 engserv sudo[7897]: sth : TTY=tty1 ; PWD=/home/sth ; USER=root ; COMMAND=/usr/bin/journalctl -xb --no-pager
Jan 15 18:48:48 engserv sudo[7897]: pam_unix(sudo:session): session opened for user root by sth(uid=0)
Jan 15 18:48:49 engserv sudo[7897]: pam_unix(sudo:session): session closed for user root
Jan 15 18:51:45 engserv sudo[7859]: pam_unix(sudo:session): session closed for user root
Jan 15 18:52:38 engserv sudo[7911]: sth : TTY=pts/0 ; PWD=/mnt/smb/share2 ; USER=root ; COMMAND=/usr/bin/pkill rsync
Jan 15 18:52:38 engserv sudo[7911]: pam_unix(sudo:session): session opened for user root by sth(uid=0)
Jan 15 18:52:38 engserv sudo[7911]: pam_unix(sudo:session): session closed for user root
Jan 15 18:52:50 engserv sudo[7916]: sth : TTY=pts/0 ; PWD=/mnt/smb/share2 ; USER=root ; COMMAND=/usr/bin/pkill rsync
Jan 15 18:52:50 engserv sudo[7916]: pam_unix(sudo:session): session opened for user root by sth(uid=0)
Jan 15 18:52:50 engserv sudo[7916]: pam_unix(sudo:session): session closed for user root
Jan 15 18:53:06 engserv sudo[7918]: sth : TTY=pts/0 ; PWD=/mnt/smb/share2 ; USER=root ; COMMAND=/usr/bin/pkill -9 rsync
Jan 15 18:53:06 engserv sudo[7918]: pam_unix(sudo:session): session opened for user root by sth(uid=0)
Jan 15 18:53:06 engserv sudo[7918]: pam_unix(sudo:session): session closed for user root
Jan 15 18:55:59 engserv sudo[7949]: sth : TTY=pts/0 ; PWD=/mnt/smb/share2 ; USER=root ; COMMAND=/usr/bin/pkill -9 rsync
Jan 15 18:55:59 engserv sudo[7949]: pam_unix(sudo:session): session opened for user root by sth(uid=0)
Jan 15 18:55:59 engserv sudo[7949]: pam_unix(sudo:session): session closed for user root
Jan 15 18:56:21 engserv systemd[1]: Starting Getty on tty2...
-- Subject: Unit getty@tty2.service has begun with start-up
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit getty@tty2.service has begun starting up.
Jan 15 18:56:21 engserv systemd[1]: Started Getty on tty2.
-- Subject: Unit getty@tty2.service has finished start-up
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit getty@tty2.service has finished starting up.
-- 
-- The start-up result is done.
Jan 15 18:56:25 engserv login[7954]: pam_unix(login:session): session opened for user sth by LOGIN(uid=0)
Jan 15 18:56:25 engserv systemd[1]: Starting Session c4 of user sth.
-- Subject: Unit session-c4.scope has begun with start-up
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit session-c4.scope has begun starting up.
Jan 15 18:56:25 engserv systemd-logind[275]: New session c4 of user sth.
-- Subject: A new session c4 has been created for user sth
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- Documentation: http://www.freedesktop.org/wiki/Software/systemd/multiseat
-- 
-- A new session with the ID c4 has been created for the user sth.
-- 
-- The leading process of the session is 7954.
Jan 15 18:56:25 engserv systemd[1]: Started Session c4 of user sth.
-- Subject: Unit session-c4.scope has finished start-up
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit session-c4.scope has finished starting up.
-- 
-- The start-up result is done.
Jan 15 18:56:25 engserv login[7954]: LOGIN ON tty2 BY sth
Jan 15 18:56:39 engserv sudo[7960]: sth : TTY=tty2 ; PWD=/home/sth ; USER=root ; COMMAND=/usr/bin/umount /media/data/
Jan 15 18:56:39 engserv sudo[7960]: pam_unix(sudo:session): session opened for user root by sth(uid=0)
Jan 15 18:56:39 engserv sudo[7960]: pam_unix(sudo:session): session closed for user root
Jan 15 19:02:43 engserv sudo[7984]: sth : TTY=pts/0 ; PWD=/mnt/smb/share2 ; USER=root ; COMMAND=/usr/bin/tee /proc/sys/vm/drop_caches
Jan 15 19:02:43 engserv sudo[7984]: pam_unix(sudo:session): session opened for user root by sth(uid=0)
Jan 15 19:02:43 engserv kernel: ------------[ cut here ]------------
Jan 15 19:02:43 engserv kernel: WARNING: CPU: 3 PID: 7985 at mm/truncate.c:508 invalidate_mapping_pages+0x1c1/0x1f0()
Jan 15 19:02:43 engserv kernel: Modules linked in: des3_ede_x86_64 des_generic arc4 ecb md4 md5 hmac nls_utf8 cifs dns_resolver fscache cfg80211 rfkill nls_iso8859_1 nls_cp437 vfat fat nouveau video ttm drm_kms_helper drm kvm_amd r8169 i2c_algo_bit kvm crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel aesni_intel mxm_wmi evdev snd_hda_codec_realtek snd_hda_codec_hdmi sp5100_tco aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd mac_hid pcspkr serio_raw edac_core snd_hda_codec_generic edac_mce_amd mii fam15h_power i2c_piix4 k10temp hwmon i2c_core shpchp tpm_infineon snd_hda_intel snd_hda_controller snd_hda_codec snd_hwdep snd_pcm snd_timer snd soundcore wmi tpm_tis tpm button acpi_cpufreq processor sch_fq_codel ext4 crc16 mbcache jbd2 sd_mod crc_t10dif crct10dif_common atkbd libps2 ahci firewire_ohci
Jan 15 19:02:43 engserv kernel:  ehci_pci libahci ohci_pci firewire_core ohci_hcd libata crc_itu_t xhci_hcd ehci_hcd scsi_mod usbcore usb_common i8042 serio
Jan 15 19:02:43 engserv kernel: CPU: 3 PID: 7985 Comm: tee Not tainted 3.17.6-1-ARCH #1
Jan 15 19:02:43 engserv kernel: Hardware name: Gigabyte Technology Co., Ltd. To be filled by O.E.M./990FXA-UD3, BIOS FC 02/05/2013
Jan 15 19:02:43 engserv kernel:  0000000000000000 000000008e7f3f05 ffff8800b9727c58 ffffffff81537c3e
Jan 15 19:02:43 engserv kernel:  0000000000000000 ffff8800b9727c90 ffffffff8107079d 0000000000000003
Jan 15 19:02:43 engserv kernel:  0000000000000003 ffff880137e2c0a8 ffffffffffffffff ffffea0000637e00
Jan 15 19:02:43 engserv kernel: Call Trace:
Jan 15 19:02:43 engserv kernel:  [<ffffffff81537c3e>] dump_stack+0x4d/0x6f
Jan 15 19:02:43 engserv kernel:  [<ffffffff8107079d>] warn_slowpath_common+0x7d/0xa0
Jan 15 19:02:43 engserv kernel:  [<ffffffff810708ca>] warn_slowpath_null+0x1a/0x20
Jan 15 19:02:43 engserv kernel:  [<ffffffff811627c1>] invalidate_mapping_pages+0x1c1/0x1f0
Jan 15 19:02:43 engserv kernel:  [<ffffffff81224e0c>] drop_pagecache_sb+0xac/0xf0
Jan 15 19:02:43 engserv kernel:  [<ffffffff81224d60>] ? do_coredump+0xec0/0xec0
Jan 15 19:02:43 engserv kernel:  [<ffffffff811cb432>] iterate_supers+0xb2/0x110
Jan 15 19:02:43 engserv kernel:  [<ffffffff81224ed6>] drop_caches_sysctl_handler+0x86/0x140
Jan 15 19:02:43 engserv kernel:  [<ffffffff81206dac>] ? fsnotify+0x28c/0x370
Jan 15 19:02:43 engserv kernel:  [<ffffffff812387a3>] proc_sys_call_handler+0xd3/0xf0
Jan 15 19:02:43 engserv kernel:  [<ffffffff812387d4>] proc_sys_write+0x14/0x20
Jan 15 19:02:43 engserv kernel:  [<ffffffff811c7967>] vfs_write+0xb7/0x200
Jan 15 19:02:43 engserv kernel:  [<ffffffff811c787c>] ? vfs_read+0x13c/0x170
Jan 15 19:02:43 engserv kernel:  [<ffffffff811c85d9>] SyS_write+0x59/0xd0
Jan 15 19:02:43 engserv kernel:  [<ffffffff8153dc69>] system_call_fastpath+0x16/0x1b
Jan 15 19:02:43 engserv kernel: ---[ end trace 2601969f96a93148 ]---
Jan 15 19:02:44 engserv kernel: tee (7985): drop_caches: 3
Jan 15 19:08:04 engserv sudo[8011]: sth : TTY=tty2 ; PWD=/home/sth ; USER=root ; COMMAND=/usr/bin/reboot
Jan 15 19:08:04 engserv sudo[8011]: pam_unix(sudo:session): session opened for user root by sth(uid=0)
Jan 15 19:08:04 engserv systemd[1]: Unmounting /media/data...
-- Subject: Unit media-data.mount has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit media-data.mount has begun shutting down.
Jan 15 19:08:04 engserv systemd[1]: Stopping Timers.
-- Subject: Unit timers.target has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit timers.target has begun shutting down.
Jan 15 19:08:04 engserv systemd[1]: Stopped target Timers.
-- Subject: Unit timers.target has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit timers.target has finished shutting down.
Jan 15 19:08:04 engserv systemd[1]: Stopping Session c3 of user sth.
-- Subject: Unit session-c3.scope has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit session-c3.scope has begun shutting down.
Jan 15 19:08:04 engserv systemd[1]: Stopped Session c3 of user sth.
-- Subject: Unit session-c3.scope has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit session-c3.scope has finished shutting down.
Jan 15 19:08:04 engserv systemd[1]: Stopping system-systemd\x2dfsck.slice.
-- Subject: Unit system-systemd\x2dfsck.slice has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit system-systemd\x2dfsck.slice has begun shutting down.
Jan 15 19:08:04 engserv systemd[1]: Removed slice system-systemd\x2dfsck.slice.
-- Subject: Unit system-systemd\x2dfsck.slice has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit system-systemd\x2dfsck.slice has finished shutting down.
Jan 15 19:08:04 engserv systemd[1]: Stopping Sound Card.
-- Subject: Unit sound.target has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit sound.target has begun shutting down.
Jan 15 19:08:04 engserv systemd[1]: Stopped target Sound Card.
-- Subject: Unit sound.target has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit sound.target has finished shutting down.
Jan 15 19:08:04 engserv systemd[1]: Deactivating swap Swap Partition...
-- Subject: Unit dev-sda3.swap has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit dev-sda3.swap has begun shutting down.
Jan 15 19:08:04 engserv systemd[1]: Stopping Graphical Interface.
-- Subject: Unit graphical.target has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit graphical.target has begun shutting down.
Jan 15 19:08:04 engserv systemd[1]: Stopped target Graphical Interface.
-- Subject: Unit graphical.target has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit graphical.target has finished shutting down.
Jan 15 19:08:04 engserv systemd[1]: Deactivating swap Swap Partition...
-- Subject: Unit dev-sda3.swap has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit dev-sda3.swap has begun shutting down.
Jan 15 19:08:04 engserv systemd[1]: Stopping Daily Cleanup of Temporary Directories.
-- Subject: Unit systemd-tmpfiles-clean.timer has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit systemd-tmpfiles-clean.timer has begun shutting down.
Jan 15 19:08:04 engserv systemd[1]: Stopped Daily Cleanup of Temporary Directories.
-- Subject: Unit systemd-tmpfiles-clean.timer has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit systemd-tmpfiles-clean.timer has finished shutting down.
Jan 15 19:08:04 engserv systemd[1]: Stopping Session c1 of user sth.
-- Subject: Unit session-c1.scope has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit session-c1.scope has begun shutting down.
Jan 15 19:08:04 engserv systemd[1]: Stopped Session c1 of user sth.
-- Subject: Unit session-c1.scope has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit session-c1.scope has finished shutting down.
Jan 15 19:08:04 engserv systemd[1]: Stopping User Manager for UID 1000...
-- Subject: Unit user@1000.service has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit user@1000.service has begun shutting down.
Jan 15 19:08:04 engserv systemd[1]: Stopping Avahi mDNS/DNS-SD Stack...
-- Subject: Unit avahi-daemon.service has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit avahi-daemon.service has begun shutting down.
Jan 15 19:08:04 engserv systemd[1]: Deactivating swap Swap Partition...
-- Subject: Unit dev-sda3.swap has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit dev-sda3.swap has begun shutting down.
Jan 15 19:08:04 engserv systemd[1]: Stopping Session c4 of user sth.
-- Subject: Unit session-c4.scope has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit session-c4.scope has begun shutting down.
Jan 15 19:08:04 engserv login[276]: pam_unix(login:session): session closed for user sth
Jan 15 19:08:04 engserv login[276]: pam_systemd(login:session): Failed to release session: Interrupted system call
Jan 15 19:08:04 engserv avahi-daemon[411]: Got SIGTERM, quitting.
Jan 15 19:08:04 engserv avahi-daemon[411]: Leaving mDNS multicast group on interface enp5s0.IPv4 with address 172.16.1.2.
Jan 15 19:08:04 engserv avahi-daemon[411]: avahi-daemon 0.6.31 exiting.
Jan 15 19:08:04 engserv sshd[359]: Received signal 15; terminating.
Jan 15 19:08:04 engserv systemd[1]: Stopped Session c4 of user sth.
-- Subject: Unit session-c4.scope has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit session-c4.scope has finished shutting down.
Jan 15 19:08:04 engserv systemd[1]: Stopping Multi-User System.
-- Subject: Unit multi-user.target has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit multi-user.target has begun shutting down.
Jan 15 19:08:04 engserv systemd[1]: Stopped target Multi-User System.
-- Subject: Unit multi-user.target has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit multi-user.target has finished shutting down.
Jan 15 19:08:04 engserv systemd[1]: Stopping Daily verification of password and group files.
-- Subject: Unit shadow.timer has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit shadow.timer has begun shutting down.
Jan 15 19:08:04 engserv systemd[1]: Stopped Daily verification of password and group files.
-- Subject: Unit shadow.timer has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit shadow.timer has finished shutting down.
Jan 15 19:08:04 engserv systemd[1]: Stopping D-Bus System Message Bus...
-- Subject: Unit dbus.service has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit dbus.service has begun shutting down.
Jan 15 19:08:04 engserv systemd[1]: Stopping Daily man-db cache update.
-- Subject: Unit man-db.timer has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit man-db.timer has begun shutting down.
Jan 15 19:08:04 engserv systemd[1]: Stopped Daily man-db cache update.
-- Subject: Unit man-db.timer has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit man-db.timer has finished shutting down.
Jan 15 19:08:04 engserv systemd[1]: Stopping Login Prompts.
-- Subject: Unit getty.target has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit getty.target has begun shutting down.
Jan 15 19:08:04 engserv systemd[1]: Stopped target Login Prompts.
-- Subject: Unit getty.target has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit getty.target has finished shutting down.
Jan 15 19:08:04 engserv systemd[1]: Stopping Getty on tty1...
-- Subject: Unit getty@tty1.service has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit getty@tty1.service has begun shutting down.
Jan 15 19:08:04 engserv systemd-logind[275]: Failed to abandon session scope: Transport endpoint is not connected
Jan 15 19:08:04 engserv systemd[364]: Stopping Default.
-- Subject: Unit UNIT has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit UNIT has begun shutting down.
Jan 15 19:08:04 engserv systemd[364]: Stopped target Default.
-- Subject: Unit UNIT has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit UNIT has finished shutting down.
Jan 15 19:08:04 engserv systemd[1]: Starting Generate shutdown-ramfs...
-- Subject: Unit mkinitcpio-generate-shutdown-ramfs.service has begun with start-up
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit mkinitcpio-generate-shutdown-ramfs.service has begun starting up.
Jan 15 19:08:04 engserv systemd[364]: Stopping Basic System.
-- Subject: Unit UNIT has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit UNIT has begun shutting down.
Jan 15 19:08:04 engserv systemd[364]: Stopped target Basic System.
-- Subject: Unit UNIT has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit UNIT has finished shutting down.
Jan 15 19:08:04 engserv systemd[364]: Stopping Timers.
-- Subject: Unit UNIT has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit UNIT has begun shutting down.
Jan 15 19:08:04 engserv systemd[364]: Stopped target Timers.
-- Subject: Unit UNIT has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit UNIT has finished shutting down.
Jan 15 19:08:04 engserv systemd[364]: Stopping Paths.
-- Subject: Unit UNIT has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit UNIT has begun shutting down.
Jan 15 19:08:04 engserv systemd[364]: Stopped target Paths.
-- Subject: Unit UNIT has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit UNIT has finished shutting down.
Jan 15 19:08:04 engserv systemd[364]: Stopping Sockets.
-- Subject: Unit UNIT has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit UNIT has begun shutting down.
Jan 15 19:08:04 engserv systemd[1]: Stopping Samba SMB/CIFS server...
-- Subject: Unit smbd.service has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit smbd.service has begun shutting down.
Jan 15 19:08:04 engserv systemd[364]: Stopped target Sockets.
-- Subject: Unit UNIT has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit UNIT has finished shutting down.
Jan 15 19:08:04 engserv systemd[364]: Starting Shutdown.
-- Subject: Unit UNIT has begun with start-up
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit UNIT has begun starting up.
Jan 15 19:08:04 engserv systemd[364]: Reached target Shutdown.
-- Subject: Unit UNIT has finished start-up
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit UNIT has finished starting up.
-- 
-- The start-up result is done.
Jan 15 19:08:04 engserv systemd[364]: Starting Exit the Session...
-- Subject: Unit UNIT has begun with start-up
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit UNIT has begun starting up.
Jan 15 19:08:04 engserv systemd[364]: Received SIGRTMIN+24 from PID 8032 (kill).
Jan 15 19:08:04 engserv systemd[1]: Stopped User Manager for UID 1000.
-- Subject: Unit user@1000.service has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit user@1000.service has finished shutting down.
Jan 15 19:08:04 engserv systemd[1]: Stopping user-1000.slice.
-- Subject: Unit user-1000.slice has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit user-1000.slice has begun shutting down.
Jan 15 19:08:04 engserv systemd[1]: Removed slice user-1000.slice.
-- Subject: Unit user-1000.slice has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit user-1000.slice has finished shutting down.
Jan 15 19:08:04 engserv systemd[1]: Stopping Permit User Sessions...
-- Subject: Unit systemd-user-sessions.service has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit systemd-user-sessions.service has begun shutting down.
Jan 15 19:08:04 engserv systemd[1]: Stopped Permit User Sessions.
-- Subject: Unit systemd-user-sessions.service has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit systemd-user-sessions.service has finished shutting down.
Jan 15 19:08:04 engserv systemd[1]: Stopping Remote File Systems.
-- Subject: Unit remote-fs.target has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit remote-fs.target has begun shutting down.
Jan 15 19:08:04 engserv systemd[1]: Stopped target Remote File Systems.
-- Subject: Unit remote-fs.target has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit remote-fs.target has finished shutting down.
Jan 15 19:08:04 engserv systemd[1]: Unmounting /mnt/smb/share2...
-- Subject: Unit mnt-smb-share2.mount has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit mnt-smb-share2.mount has begun shutting down.
Jan 15 19:08:04 engserv systemd[1]: Unmounting /mnt/smb/share1...
-- Subject: Unit mnt-smb-share1.mount has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit mnt-smb-share1.mount has begun shutting down.
Jan 15 19:08:05 engserv systemd[1]: media-data.mount mount process exited, code=exited status=32
Jan 15 19:08:04 engserv nmbd[7459]: STATUS=daemon 'nmbd' finished starting up and ready to serve connectionsGot SIGTERM: going down...
Jan 15 19:08:04 engserv systemd[366]: pam_unix(systemd-user:session): session closed for user sth
Jan 15 19:08:05 engserv umount[8015]: umount: /media/data: target is busy
Jan 15 19:08:05 engserv umount[8015]: (In some cases useful info about processes that
Jan 15 19:08:05 engserv umount[8015]: use the device is found by lsof(8) or fuser(1).)
Jan 15 19:08:05 engserv systemd[1]: Unmounted /mnt/smb/share2.
-- Subject: Unit mnt-smb-share2.mount has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit mnt-smb-share2.mount has finished shutting down.
Jan 15 19:08:05 engserv systemd[1]: Unmounted /mnt/smb/share1.
-- Subject: Unit mnt-smb-share1.mount has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit mnt-smb-share1.mount has finished shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopping Network.
-- Subject: Unit network.target has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit network.target has begun shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopped target Network.
-- Subject: Unit network.target has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit network.target has finished shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopping dhcpcd on enp5s0...
-- Subject: Unit dhcpcd@enp5s0.service has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit dhcpcd@enp5s0.service has begun shutting down.
Jan 15 19:08:05 engserv dhcpcd[8049]: dhcpcd[8049]: sending signal TERM to pid 358
Jan 15 19:08:05 engserv dhcpcd[8049]: sending signal TERM to pid 358
Jan 15 19:08:05 engserv dhcpcd[8049]: waiting for pid 358 to exit
Jan 15 19:08:05 engserv dhcpcd[358]: received signal TERM from PID 8049, stopping
Jan 15 19:08:05 engserv dhcpcd[358]: enp5s0: removing interface
Jan 15 19:08:05 engserv dhcpcd[8049]: dhcpcd[8049]: waiting for pid 358 to exit
Jan 15 19:08:05 engserv mkinitcpio[8024]: ==> Starting build: none
Jan 15 19:08:05 engserv dhcpcd[358]: exited
Jan 15 19:08:05 engserv systemd[1]: dhcpcd@enp5s0.service: main process exited, code=exited, status=1/FAILURE
Jan 15 19:08:05 engserv mkinitcpio[8024]: -> Running build hook: [sd-shutdown]
Jan 15 19:08:05 engserv systemd[1]: Stopped dhcpcd on enp5s0.
-- Subject: Unit dhcpcd@enp5s0.service has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit dhcpcd@enp5s0.service has finished shutting down.
Jan 15 19:08:05 engserv systemd[1]: Unit dhcpcd@enp5s0.service entered failed state.
Jan 15 19:08:05 engserv systemd[1]: dhcpcd@enp5s0.service failed.
Jan 15 19:08:05 engserv systemd[1]: Stopping system-dhcpcd.slice.
-- Subject: Unit system-dhcpcd.slice has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit system-dhcpcd.slice has begun shutting down.
Jan 15 19:08:05 engserv systemd[1]: Removed slice system-dhcpcd.slice.
-- Subject: Unit system-dhcpcd.slice has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit system-dhcpcd.slice has finished shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopping Basic System.
-- Subject: Unit basic.target has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit basic.target has begun shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopped target Basic System.
-- Subject: Unit basic.target has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit basic.target has finished shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopping Paths.
-- Subject: Unit paths.target has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit paths.target has begun shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopped target Paths.
-- Subject: Unit paths.target has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit paths.target has finished shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopping Forward Password Requests to Wall Directory Watch.
-- Subject: Unit systemd-ask-password-wall.path has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit systemd-ask-password-wall.path has begun shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopped Forward Password Requests to Wall Directory Watch.
-- Subject: Unit systemd-ask-password-wall.path has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit systemd-ask-password-wall.path has finished shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopping Dispatch Password Requests to Console Directory Watch.
-- Subject: Unit systemd-ask-password-console.path has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit systemd-ask-password-console.path has begun shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.
-- Subject: Unit systemd-ask-password-console.path has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit systemd-ask-password-console.path has finished shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopping Slices.
-- Subject: Unit slices.target has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit slices.target has begun shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopped target Slices.
-- Subject: Unit slices.target has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit slices.target has finished shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopping User and Session Slice.
-- Subject: Unit user.slice has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit user.slice has begun shutting down.
Jan 15 19:08:05 engserv systemd[1]: Removed slice User and Session Slice.
-- Subject: Unit user.slice has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit user.slice has finished shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopping Sockets.
-- Subject: Unit sockets.target has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit sockets.target has begun shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopped target Sockets.
-- Subject: Unit sockets.target has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit sockets.target has finished shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopping D-Bus System Message Bus Socket.
-- Subject: Unit dbus.socket has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit dbus.socket has begun shutting down.
Jan 15 19:08:05 engserv systemd[1]: Closed D-Bus System Message Bus Socket.
-- Subject: Unit dbus.socket has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit dbus.socket has finished shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopping Avahi mDNS/DNS-SD Stack Activation Socket.
-- Subject: Unit avahi-daemon.socket has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit avahi-daemon.socket has begun shutting down.
Jan 15 19:08:05 engserv systemd[1]: Closed Avahi mDNS/DNS-SD Stack Activation Socket.
-- Subject: Unit avahi-daemon.socket has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit avahi-daemon.socket has finished shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopping System Initialization.
-- Subject: Unit sysinit.target has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit sysinit.target has begun shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopped target System Initialization.
-- Subject: Unit sysinit.target has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit sysinit.target has finished shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopping Swap.
-- Subject: Unit swap.target has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit swap.target has begun shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopped target Swap.
-- Subject: Unit swap.target has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit swap.target has finished shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopping Encrypted Volumes.
-- Subject: Unit cryptsetup.target has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit cryptsetup.target has begun shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopped target Encrypted Volumes.
-- Subject: Unit cryptsetup.target has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit cryptsetup.target has finished shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopping Update UTMP about System Boot/Shutdown...
-- Subject: Unit systemd-update-utmp.service has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit systemd-update-utmp.service has begun shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopping Load/Save Random Seed...
-- Subject: Unit systemd-random-seed.service has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit systemd-random-seed.service has begun shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopping Setup Virtual Console...
-- Subject: Unit systemd-vconsole-setup.service has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit systemd-vconsole-setup.service has begun shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopped Setup Virtual Console.
-- Subject: Unit systemd-vconsole-setup.service has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit systemd-vconsole-setup.service has finished shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopping Apply Kernel Variables...
-- Subject: Unit systemd-sysctl.service has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit systemd-sysctl.service has begun shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopped Apply Kernel Variables.
-- Subject: Unit systemd-sysctl.service has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit systemd-sysctl.service has finished shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopped Update UTMP about System Boot/Shutdown.
-- Subject: Unit systemd-update-utmp.service has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit systemd-update-utmp.service has finished shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopping Create Volatile Files and Directories...
-- Subject: Unit systemd-tmpfiles-setup.service has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit systemd-tmpfiles-setup.service has begun shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopped Create Volatile Files and Directories.
-- Subject: Unit systemd-tmpfiles-setup.service has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit systemd-tmpfiles-setup.service has finished shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopping Local File Systems.
-- Subject: Unit local-fs.target has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit local-fs.target has begun shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopped target Local File Systems.
-- Subject: Unit local-fs.target has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit local-fs.target has finished shutting down.
Jan 15 19:08:05 engserv systemd[1]: Unmounting /home...
-- Subject: Unit home.mount has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit home.mount has begun shutting down.
Jan 15 19:08:05 engserv systemd[1]: Unmounting /run/user/1000...
-- Subject: Unit run-user-1000.mount has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit run-user-1000.mount has begun shutting down.
Jan 15 19:08:05 engserv systemd[1]: Unmounting /boot...
-- Subject: Unit boot.mount has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit boot.mount has begun shutting down.
Jan 15 19:08:05 engserv systemd[1]: Unmounting Temporary Directory...
-- Subject: Unit tmp.mount has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit tmp.mount has begun shutting down.
Jan 15 19:08:05 engserv umount[8075]: umount: /home: target is busy
Jan 15 19:08:05 engserv umount[8075]: (In some cases useful info about processes that
Jan 15 19:08:05 engserv umount[8075]: use the device is found by lsof(8) or fuser(1).)
Jan 15 19:08:05 engserv systemd[1]: home.mount mount process exited, code=exited status=32
Jan 15 19:08:05 engserv systemd[1]: Failed unmounting /home.
-- Subject: Unit home.mount has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit home.mount has finished shutting down.
Jan 15 19:08:05 engserv systemd[1]: Unmounted Temporary Directory.
-- Subject: Unit tmp.mount has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit tmp.mount has finished shutting down.
Jan 15 19:08:05 engserv systemd[1]: Unmounted /run/user/1000.
-- Subject: Unit run-user-1000.mount has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit run-user-1000.mount has finished shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopped Load/Save Random Seed.
-- Subject: Unit systemd-random-seed.service has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit systemd-random-seed.service has finished shutting down.
Jan 15 19:08:05 engserv systemd[1]: Unmounted /boot.
-- Subject: Unit boot.mount has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit boot.mount has finished shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopping Local File Systems (Pre).
-- Subject: Unit local-fs-pre.target has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit local-fs-pre.target has begun shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopped target Local File Systems (Pre).
-- Subject: Unit local-fs-pre.target has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit local-fs-pre.target has finished shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopping Create Static Device Nodes in /dev...
-- Subject: Unit systemd-tmpfiles-setup-dev.service has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit systemd-tmpfiles-setup-dev.service has begun shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopped Create Static Device Nodes in /dev.
-- Subject: Unit systemd-tmpfiles-setup-dev.service has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit systemd-tmpfiles-setup-dev.service has finished shutting down.
Jan 15 19:08:05 engserv systemd[1]: Stopping EFI System Partition Automount.
-- Subject: Unit boot.automount has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit boot.automount has begun shutting down.
Jan 15 19:08:05 engserv systemd[1]: Unset automount EFI System Partition Automount.
-- Subject: Unit boot.automount has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit boot.automount has finished shutting down.
Jan 15 19:08:05 engserv systemd[1]: Starting Unmount All Filesystems.
-- Subject: Unit umount.target has begun with start-up
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit umount.target has begun starting up.
Jan 15 19:08:05 engserv systemd[1]: Reached target Unmount All Filesystems.
-- Subject: Unit umount.target has finished start-up
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit umount.target has finished starting up.
-- 
-- The start-up result is done.
Jan 15 19:08:05 engserv systemd[1]: Stopping Remount Root and Kernel File Systems...
-- Subject: Unit systemd-remount-fs.service has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit systemd-remount-fs.service has begun shutting down.
Jan 15 19:08:05 engserv mkinitcpio[8024]: ==> Build complete.
Jan 15 19:08:05 engserv systemd[1]: Started Generate shutdown-ramfs.
-- Subject: Unit mkinitcpio-generate-shutdown-ramfs.service has finished start-up
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit mkinitcpio-generate-shutdown-ramfs.service has finished starting up.
-- 
-- The start-up result is done.
Jan 15 19:08:05 engserv systemd[1]: Starting Shutdown.
-- Subject: Unit shutdown.target has begun with start-up
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit shutdown.target has begun starting up.
Jan 15 19:08:05 engserv systemd[1]: Reached target Shutdown.
-- Subject: Unit shutdown.target has finished start-up
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit shutdown.target has finished starting up.
-- 
-- The start-up result is done.
Jan 15 19:08:05 engserv systemd[1]: Starting Final Step.
-- Subject: Unit final.target has begun with start-up
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit final.target has begun starting up.
Jan 15 19:08:05 engserv systemd[1]: Reached target Final Step.
-- Subject: Unit final.target has finished start-up
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit final.target has finished starting up.
-- 
-- The start-up result is done.
Jan 15 19:08:05 engserv systemd[1]: Starting Reboot...
-- Subject: Unit systemd-reboot.service has begun with start-up
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit systemd-reboot.service has begun starting up.
Jan 15 19:08:05 engserv systemd[1]: Shutting down.
Jan 15 19:08:05 engserv systemd[1]: Hardware watchdog 'SP5100 TCO timer', version 0
Jan 15 19:08:05 engserv systemd[1]: Set hardware watchdog to 10min.
Jan 15 19:08:05 engserv kernel: sp5100_tco: Unexpected close, not stopping watchdog!

I'll summarize the above:
- Partway through copying a large amount of data to the local hard drive mounted in sdb1 (ext4, WD Green 2TB) from a network connected CIFS share (mount.cifs), the copying stopped while the process was still running. The speed reported by rsync appeared to gradually decrease during the copy which could possible be due to it finding many small files.
When the copying stopped (I wasn't watching when it happened),

"INFO: task jbd2/sdb1-8:215 blocked for more than 120 seconds."
INFO: task rsync blocked for more than 120 seconds."

started appearing at 120 second intervals.
- When I noticed them, I tried to stop rsync. First using (^C) in the session it was running in. I then tried listing the contents of the directory rsync was copying to. This process got stuck, so I switched to another tty and noticed rsync was still running. I try to kill it (kill -9) and it stays alive (uninterruptable state).
- I then tried clearing the cache again (again almost all 4GB of the RAM). This produced another error shown above.
- I try to unmount the directory, failing of course since it's used by rsync
- Reboot

At no point in this did the system become completely unresponsive, so still better than it was a day or so ago. This is still a very big issue though because the server will be used for critical backups in the future so for rsync too become unresponsive like that is unacceptable.

I am at a loss. If all else fails I will have to try switching to a full set of new hardware (all of this is already new - hardware and software - , I should add).
If that fails I will probably be forced to use Windows.

Spider.007 · 2015-01-16 10:30:48

stefanhartman wrote:

Spider.007 wrote:
What does 'cat /proc/sys/kernel/tainted' output? I'd definitely try a longer memtest run (eg, a few days) since all signs point towards memory problems. You might also check for a bios update
/proc/sys/kernel/tainted contains "0"
From what I just read (here https://www.kernel.org/doc/Documentatio … acing.txt), "tainted" refers to the presence of abnormal/unsupported things, all identified by flags. Presumably the "0" here means not tainted? I also suppose this file is reset at boot?
Is there a way for me to keep these files (including journal files) alive after a crash so that I can read them afterwards? I know of 'kdump' but I have limited internet now and thus can't get the ABS tree for linux to compile with support.

Yeah, it means the kernel is not tainted; the reason I asked is because your dump said "Disabling lock debugging due to kernel taint" but I guess that's a fluke. Unfortunately these are not really files; which is why you cannot keep them.

Well; this really sucks; crashes like these are hard to pinpoint; my guess is definitely a faulty memory-module or motherboard; do you have ECC memory installed? I don't think using another o/s will help but I understand that you're willing to try anything.

TheSaint · 2015-01-16 12:49:49

You may try out the latest kernel.

stefanhartman · 2015-01-17 14:01:52

The latest kernel was already installed and being used. The release of yesterday fixed something completely unrelated.

I have transferred the system to a new computer. Still waiting for it to go wrong but so far it looks promising.

Arch Linux

#1 2015-01-11 23:37:18

Intermittent crashes on new install

#2 2015-01-14 00:50:41

Re: Intermittent crashes on new install

#3 2015-01-14 01:37:51

Re: Intermittent crashes on new install

#4 2015-01-14 08:09:49

Re: Intermittent crashes on new install

#5 2015-01-14 13:06:47

Re: Intermittent crashes on new install

#6 2015-01-14 17:48:57

Re: Intermittent crashes on new install

#7 2015-01-14 18:12:52

Re: Intermittent crashes on new install

#8 2015-01-14 20:05:18

Re: Intermittent crashes on new install

#9 2015-01-14 21:42:21

Re: Intermittent crashes on new install

#10 2015-01-15 23:49:17

Re: Intermittent crashes on new install

#11 2015-01-16 10:30:48

Re: Intermittent crashes on new install

#12 2015-01-16 12:49:49

Re: Intermittent crashes on new install

#13 2015-01-17 14:01:52

Re: Intermittent crashes on new install

Board footer