You are not logged in.
Hi All,
I have been running Arch on my machine for a year now, and in that time I have not once had a kernel panic or any other kind of crash. In the last two weeks, I have had several.
It seems to happen when I am interacting with USB drives, particularly with rapid writes or file system creation. The issue coincides approximately with my installation of Paragon's ufsd kernel modifications for interacting with NTFS and HFS+ file systems, however I believe I have completely uninstalled those components since then.
Here is an image of my most recent crash:
http://michaeldacre.com/crash.jpg
When this message appeared my computer froze - completely unresponsive, not even the mouse would move, and Ctrl+Alt+Del did nothing. Only a hard restart worked.
I should also note I have been having odd issues with udev recently - USB3 drives not mounting, encrypted file systems not mounting, etc. I have posted other threads to that effect (e.g. https://bbs.archlinux.org/viewtopic.php?id=185619)
Any ideas would be very appreciated, this is a big problem.
Thanks!
Moderator edit [ewaller] Converted over sized image to url tags. Our Policy
Last edited by ewaller (2014-08-15 01:21:20)
Home Page: www.michaeldacre.com
Lab: Hunter Fraser's Lab
GPG key: E76370D6
Offline
I am unfamiliar with the way ufsd modifications are installed. Did you compile a custom kernel? In any case, is there any improvement if you temporarily switch to the LTS kernel? This may help to rule out potential hardware issues.
Last edited by Pse (2014-08-15 04:44:50)
Offline
No, there was no custom compilation of the kernel, just compilation of modules that I then added to the kernel with modprobe. My understanding of kernel modules is that once they are deleted they are gone right?
Also, this problem hasn't happened again recently, it only happened while trying to access damaged drives, specifically while using mkfs, or with very large tar operations (I use tar to copy files to the disk as it is the fastest).
I have returned those disks and so it hasn't happened since, but it is still very concerning that a failed operation on an external disk would cause a kernel panic.
Home Page: www.michaeldacre.com
Lab: Hunter Fraser's Lab
GPG key: E76370D6
Offline
which kernel version are you using ?
3.16.x ?
It seems to happen when I am interacting with USB drives, particularly with rapid writes or file system creation.
I don't know if it's related but I notice since kernel 3.16.x that I have problems with ntfs mounted partitions and virtualbox, if the virtual machine is located in ntfs partition then I get freezes and sometimes kernel panic in host if heavy I/O ( read/writes ) are made to the ntfs partition,
the virtual machine suddenly can't do read/write on ntfs partition, that's why a freeze or kernel panic occurs, I think sometimes kernel 3.16.x for an unknown reason can lost the connection with the partition, which leads to a freeze or a kernel panic,
look the kernel messages in journalctl :
# journalctl -n 20000 _TRANSPORT=kernel > kernel_bugs.logif you find some "kernel trace" it would be interesting to post here the results
Last edited by Potomac (2014-08-20 18:13:27)
Offline
Right now I am on linux 3.15.8-1, although I am upgrading as I write this.
I ran the command you suggested, you can see the log here:
michaeldacre.com/kernel_bugs.txt
Last edited by MikeDacre (2014-08-20 19:08:54)
Home Page: www.michaeldacre.com
Lab: Hunter Fraser's Lab
GPG key: E76370D6
Offline
the interesting part is here :
Aug 14 18:07:41 esmeralda kernel: BUG: unable to handle kernel paging request at ffffffffffffffd8
Aug 14 18:07:41 esmeralda kernel: IP: [<ffffffff8108db00>] kthread_data+0x10/0x20
Aug 14 18:07:41 esmeralda kernel: PGD 1814067 PUD 1816067 PMD 0
Aug 14 18:07:41 esmeralda kernel: Oops: 0000 [#2] PREEMPT SMP
Aug 14 18:07:41 esmeralda kernel: Modules linked in: nf_conntrack_ipv4 nf_conntrack_ipv6 nf_defrag_ipv4 nf_defrag_ipv6 xt_tcpudp xt_conntrack nf_conntrack ip6table_filter iptable_filter ip6_tables ip_tables x_tables snd_hda_codec_hdmi snd_hda_codec_realtek snd_hda_codec_generic iTCO_wdt iTCO_vendor_support ecb btusb bluetooth mousedev 6lowpan_iphc coretemp eeepc_wmi asus_wmi sparse_keymap led_class rfkill video evdev mxm_wmi mac_hid intel_rapl x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul crc32_pclmul crc32c_intel radeon ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd microcode psmouse pcspkr serio_raw sb_edac ttm edac_core drm_kms_helper drm lpc_ich hwmon i2c_i801 i2c_algo_bit snd_hda_intel i2c_core snd_hda_controller snd_hda_codec snd_hwdep snd_pcm e1000e
Aug 14 18:07:41 esmeralda kernel: snd_timer mei_me snd mei ptp soundcore shpchp pps_core wmi processor button fuse nfs lockd sunrpc fscache ext4 crc16 mbcache jbd2 hid_generic usbhid hid uas usb_storage sr_mod cdrom sd_mod crc_t10dif crct10dif_common atkbd libps2 ahci libahci libata firewire_ohci ehci_pci firewire_core xhci_hcd crc_itu_t ehci_hcd scsi_mod usbcore usb_common i8042 serio
Aug 14 18:07:41 esmeralda kernel: CPU: 2 PID: 122 Comm: kworker/u16:7 Tainted: G D 3.15.8-1-ARCH #1
Aug 14 18:07:41 esmeralda kernel: Hardware name: System manufacturer System Product Name/SABERTOOTH X79, BIOS 3305 12/25/2012
Aug 14 18:07:41 esmeralda kernel: task: ffff880802745bb0 ti: ffff880801860000 task.ti: ffff880801860000
Aug 14 18:07:41 esmeralda kernel: RIP: 0010:[<ffffffff8108db00>]
Aug 14 18:07:41 esmeralda kernel: [<ffffffff8108db00>] kthread_data+0x10/0x20
Aug 14 18:07:41 esmeralda kernel: RSP: 0018:ffff880801863ab0 EFLAGS: 00010002
Aug 14 18:07:41 esmeralda kernel: RAX: 0000000000000000 RBX: 0000000000000002 RCX: 0000000000000001
Aug 14 18:07:41 esmeralda kernel: RDX: 0000000000000001 RSI: 0000000000000002 RDI: ffff880802745bb0
Aug 14 18:07:41 esmeralda kernel: RBP: ffff880801863ab0 R08: 0000000000000000 R09: 0000000000000001
Aug 14 18:07:41 esmeralda kernel: R10: ffff88082fc9c920 R11: ffffea002006e280 R12: ffff88082fc94700
Aug 14 18:07:41 esmeralda kernel: R13: ffff88082fc94700 R14: ffff880802745bb0 R15: 0000000000000000
Aug 14 18:07:41 esmeralda kernel: FS: 0000000000000000(0000) GS:ffff88082fc80000(0000) knlGS:0000000000000000
Aug 14 18:07:41 esmeralda kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Aug 14 18:07:41 esmeralda kernel: CR2: 0000000000000028 CR3: 0000000001811000 CR4: 00000000000407e0
Aug 14 18:07:41 esmeralda kernel: Stack:
Aug 14 18:07:41 esmeralda kernel: ffff880801863ac8
Aug 14 18:07:41 esmeralda kernel: ffffffff81087211
Aug 14 18:07:41 esmeralda kernel: 0000000000000002
Aug 14 18:07:41 esmeralda kernel: ffff880801863bd8
Aug 14 18:07:41 esmeralda kernel:
Aug 14 18:07:41 esmeralda kernel: ffffffff8150a2c5
Aug 14 18:07:41 esmeralda kernel: ffff880802745bb0
Aug 14 18:07:41 esmeralda kernel: 0000000000014700
Aug 14 18:07:41 esmeralda kernel: ffff880801863fd8
Aug 14 18:07:41 esmeralda kernel:
Aug 14 18:07:41 esmeralda kernel: 0000000000014700
Aug 14 18:07:41 esmeralda kernel: ffff880802745bb0
Aug 14 18:07:41 esmeralda kernel: 0000000000000000
Aug 14 18:07:41 esmeralda kernel: ffff880801863b50
Aug 14 18:07:41 esmeralda kernel:
Aug 14 18:07:41 esmeralda kernel: Call Trace:
Aug 14 18:07:41 esmeralda kernel:
Aug 14 18:07:41 esmeralda kernel: [<ffffffff81087211>] wq_worker_sleeping+0x11/0x90
Aug 14 18:07:41 esmeralda kernel:
Aug 14 18:07:41 esmeralda kernel: [<ffffffff8150a2c5>] __schedule+0x6c5/0x980
Aug 14 18:07:41 esmeralda kernel:
Aug 14 18:07:41 esmeralda kernel: [<ffffffff81084fb6>] ? __queue_work+0x136/0x390
Aug 14 18:07:41 esmeralda kernel:
Aug 14 18:07:41 esmeralda kernel: [<ffffffff8126e622>] ? put_io_context+0x62/0xa0
Aug 14 18:07:41 esmeralda kernel:
Aug 14 18:07:41 esmeralda kernel: [<ffffffff8126e70b>] ? put_io_context_active+0xab/0xd0
Aug 14 18:07:41 esmeralda kernel:
Aug 14 18:07:41 esmeralda kernel: [<ffffffff8150a5a9>] schedule+0x29/0x70
Aug 14 18:07:41 esmeralda kernel:
Aug 14 18:07:41 esmeralda kernel: [<ffffffff8106c882>] do_exit+0x872/0xb10
Aug 14 18:07:41 esmeralda kernel:
Aug 14 18:07:41 esmeralda kernel: [<ffffffff810c5d3d>] ? console_unlock+0x26d/0x3e0
Aug 14 18:07:41 esmeralda kernel:
Aug 14 18:07:41 esmeralda kernel: [<ffffffff8150f0ab>] oops_end+0x9b/0xe0
Aug 14 18:07:41 esmeralda kernel:
Aug 14 18:07:41 esmeralda kernel: [<ffffffff8101826b>] die+0x4b/0x70
Aug 14 18:07:41 esmeralda kernel:
Aug 14 18:07:41 esmeralda kernel: [<ffffffff8150eb6a>] do_general_protection+0xca/0x150
Aug 14 18:07:41 esmeralda kernel:
Aug 14 18:07:41 esmeralda kernel: [<ffffffff8150e4d8>] general_protection+0x28/0x30
Aug 14 18:07:41 esmeralda kernel:
Aug 14 18:07:41 esmeralda kernel: [<ffffffffa03ea5ad>] ? uas_mark_cmd_dead+0x5d/0xd0 [uas]
Aug 14 18:07:41 esmeralda kernel: [<ffffffffa03ebe4e>] uas_eh_abort_handler+0x9e/0x110 [uas]
Aug 14 18:07:41 esmeralda kernel: [<ffffffffa0146082>] scmd_eh_abort_handler+0x62/0x110 [scsi_mod]
Aug 14 18:07:41 esmeralda kernel: [<ffffffff810861e8>] process_one_work+0x168/0x450
Aug 14 18:07:41 esmeralda kernel: [<ffffffff81086c42>] worker_thread+0x132/0x3e0
Aug 14 18:07:41 esmeralda kernel: [<ffffffff81086b10>] ? manage_workers.isra.23+0x2d0/0x2d0
Aug 14 18:07:41 esmeralda kernel: [<ffffffff8108d44a>] kthread+0xea/0x100
Aug 14 18:07:41 esmeralda kernel: [<ffffffff8108d360>] ? kthread_create_on_node+0x1b0/0x1b0
Aug 14 18:07:41 esmeralda kernel: [<ffffffff815164fc>] ret_from_fork+0x7c/0xb0
Aug 14 18:07:41 esmeralda kernel: [<ffffffff8108d360>] ? kthread_create_on_node+0x1b0/0x1b0
Aug 14 18:07:41 esmeralda kernel: Code: 00 48 89 e5 5d 48 8b 40 c8 48 c1 e8 02 83 e0 01 c3 66 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 48 8b 87 e8 04 00 00 55 48 89 e5 <48> 8b 40 d8 5d c3 66 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90
Aug 14 18:07:41 esmeralda kernel: RIP [<ffffffff8108db00>] kthread_data+0x10/0x20
Aug 14 18:07:41 esmeralda kernel: RSP <ffff880801863ab0>
Aug 14 18:07:41 esmeralda kernel: CR2: ffffffffffffffd8
Aug 14 18:07:41 esmeralda kernel: ---[ end trace 7d50630c173ee499 ]---
Aug 14 18:07:41 esmeralda kernel: Fixing recursive fault but reboot is needed!it's seems a different bug because my log is a little different, althought it's also a "BUG: unable to handle kernel paging request"
kernel: BUG: unable to handle kernel paging request at ffff880143833c92
kernel: IP: [<ffffffff812ae25d>] memcpy+0xd/0x110
kernel: PGD 1b23067 PUD 0
kernel: Oops: 0000 [#1] PREEMPT SMP
kernel: Modules linked in: vboxnetflt(O) vboxnetadp(O) vboxdrv(O) zl10353 ipt_REJECT nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack iptable_filter ip_tables dvb_pll cx22702 cx88_dvb cx88_vp3054_i2c videobuf_dvb dvb_core x_tables it87 hwmon_vid coretemp kvm_intel kvm gpio_ich iTCO_wdt iTCO_vendor_support ppdev rc_winfast tuner_xc2028 microcode pcspkr serio_raw nls_iso8859_1 tuner nls_cp850 vfat fat snd_ymfpci cx8802 fuse cx88_alsa cx8800 cx88xx snd_mpu401_uart btcx_risc snd_opl3_lib tveeprom snd_ac97_codec videobuf_dma_sg ac97_bus gameport videobuf_core snd_rawmidi rc_core v4l2_common snd_hda_codec_realtek snd_seq_device videodev snd_hda_codec_hdmi snd_hda_codec_generic i2c_i801 media led_class lpc_ich snd_hda_intel snd_hda_controller snd_hda_codec rng_core snd_hwdep r8169 snd_pcm
kernel: snd_timer evdev snd mousedev mac_hid soundcore mii shpchp button intel_agp intel_gtt acpi_cpufreq parport_pc parport processor ext4 crc16 mbcache jbd2 hid_generic usbhid hid sd_mod crc_t10dif crct10dif_common sr_mod cdrom atkbd libps2 ata_generic pata_acpi ata_piix uhci_hcd ehci_pci ehci_hcd pata_jmicron ahci libahci usbcore usb_common libata i8042 serio scsi_mod radeon hwmon i2c_algo_bit drm_kms_helper ttm drm i2c_core
kernel: CPU: 1 PID: 303 Comm: mount.ntfs-3g Tainted: G O 3.16.0-2-ARCH #1
kernel: Hardware name: Gigabyte Technology Co., Ltd. P31-DS3L/P31-DS3L, BIOS F10A 07/30/2008
kernel: task: ffff880128c5dbb0 ti: ffff8800c64c4000 task.ti: ffff8800c64c4000
kernel: RIP: 0010:[<ffffffff812ae25d>] [<ffffffff812ae25d>] memcpy+0xd/0x110
kernel: RSP: 0018:ffff8800c64c7c30 EFLAGS: 00010246
kernel: RAX: ffff88008a252860 RBX: 00000000000007a0 RCX: 00000000000000f4
kernel: RDX: 0000000000000000 RSI: ffff880143833c92 RDI: ffff88008a252860
kernel: RBP: ffff8800c64c7c60 R08: 0000000000000000 R09: ffffea0000000000
kernel: R10: 00007f8848800000 R11: ffff880000000218 R12: ffff8800c64c7e00
kernel: R13: ffff8800c64c7c9c R14: ffff8800c64c7ca0 R15: 00000000000007a0
kernel: FS: 00007f88488c8700(0000) GS:ffff88012fc80000(0000) knlGS:0000000000000000
kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
kernel: CR2: ffff880143833c92 CR3: 00000000c631c000 CR4: 00000000000427e0
kernel: Stack:
kernel: ffffffffa0b8fbdb 00000000925aac92 ffff8800c65f4e01 ffff8800b1289000
kernel: ffffea0002c4a240 ffff8800c64c7e00 ffff8800c64c7cd8 ffffffffa0b90181
kernel: 0000000000000400 0000000000000400 ffffffffa0b8fbdb ffffea0002c4a240
kernel: Call Trace:
kernel: [<ffffffffa0b8fbdb>] ? fuse_copy_do+0xbb/0xd0 [fuse]
kernel: [<ffffffffa0b90181>] fuse_copy_page+0xa1/0x5f0 [fuse]
kernel: [<ffffffffa0b8fbdb>] ? fuse_copy_do+0xbb/0xd0 [fuse]
kernel: [<ffffffffa0b907bf>] fuse_copy_args+0xef/0x140 [fuse]
kernel: [<ffffffffa0b9133b>] fuse_dev_do_read.isra.17+0x77b/0x880 [fuse]
kernel: [<ffffffff812009cc>] ? fsnotify+0x28c/0x370
kernel: [<ffffffff810a2cd0>] ? wake_up_process+0x50/0x50
kernel: [<ffffffffa0b9171a>] fuse_dev_read+0x7a/0xa0 [fuse]
kernel: [<ffffffff811c1137>] do_sync_read+0x67/0xa0
kernel: [<ffffffff811c19f0>] vfs_read+0x90/0x170
kernel: [<ffffffff811c2729>] SyS_read+0x59/0xd0
kernel: [<ffffffff81015bf3>] ? do_device_not_available+0x23/0x30
kernel: [<ffffffff81530769>] system_call_fastpath+0x16/0x1b
kernel: Code: e5 53 48 89 fb 75 05 e8 42 fb ff ff 48 8b 43 58 48 2b 43 50 88 43 4e 5b 5d f3 c3 90 90 90 48 89 f8 48 89 d1 48 c1 e9 03 83 e2 07 <f3> 48 a5 89 d1 f3 a4 c3 20 4c 8b 06 4c 8b 4e 08 4c 8b 56 10 4c
kernel: RIP [<ffffffff812ae25d>] memcpy+0xd/0x110
kernel: RSP <ffff8800c64c7c30>
kernel: CR2: ffff880143833c92
kernel: ---[ end trace be8f9df069af52ee ]---Offline