You are not logged in.

#1 2020-04-07 14:47:46

Zod
Member
From: Hoosiertucky
Registered: 2019-03-10
Posts: 636

[Solved] Intermitant kernel panic during boot

Bus 004 Device 002: ID 152d:2561 JMicron Technology Corp. / JMicron USA Technology Corp. CEB-2235S-U3 external RAID box

Trying to track down a kernel panic on startup.

I think I've narrowed it down to my Blackx duet, ID 152d:2561

I've just recently thrown it back into action and the panic has been happening on both kernels 5.5 and 5.6

I've created /etc/modprobe.d/ignore_uas.conf

options usb-storage quirks=152d:2561

I've rebooted a number of times since without the panic and I was wondering how I might track down a commit or regression that might be causing it.

I'm not positive that this is helping since (I may be doing it wrong) the panic does not happen everytime.

Journal with panic

Apr 07 08:36:45 carlos systemd[1]: Listening on Journal Socket.                                                                                                                                                                             
Apr 07 08:36:45 carlos systemd[1]: Listening on udev Control Socket.                                                                                                                                                                        
Apr 07 08:36:45 carlos systemd[1]: Listening on udev Kernel Socket.                                                                                                                                                                         
Apr 07 08:36:45 carlos systemd[1]: Mounting Huge Pages File System...                                                                                                                                                                       
Apr 07 08:36:45 carlos systemd[1]: Mounting POSIX Message Queue File System...                                                                                                                                                              
Apr 07 08:36:45 carlos systemd[1]: Mounting Kernel Debug File System...                                                                                                                                                                     
Apr 07 08:36:45 carlos systemd[1]: Mounting Kernel Trace File System...                                                                                                                                                                     
Apr 07 08:36:45 carlos systemd[1]: Starting Create list of static device nodes for the curre>                                                                                                                                               
Apr 07 08:36:45 carlos systemd[1]: Starting Load Kernel Module drm...                                                                                                                                                                       
Apr 07 08:36:45 carlos systemd[1]: Condition check resulted in Set Up Additional Binary Form>                                                                                                                                               
Apr 07 08:36:45 carlos systemd[1]: Starting Journal Service...                                                                                                                                                                              
Apr 07 08:36:45 carlos systemd[1]: Starting Load Kernel Modules...                                                                                                                                                                          
Apr 07 08:36:45 carlos systemd[1]: Starting Remount Root and Kernel File Systems...                                                                                                                                                         
Apr 07 08:36:45 carlos systemd[1]: Starting udev Coldplug all Devices...                                                                                                                                                                    
Apr 07 08:36:45 carlos kernel: BTRFS info (device sda1): disk space caching is enabled                                                                                                                                                      
Apr 07 08:36:45 carlos systemd[1]: Mounted Kernel Debug File System.                                                                                                                                                                        
Apr 07 08:36:45 carlos systemd[1]: Mounted Kernel Trace File System.                                                                                                                                                                        
Apr 07 08:36:45 carlos systemd[1]: Finished Remount Root and Kernel File Systems.                                                                                                                                                           
Apr 07 08:36:45 carlos systemd[1]: Condition check resulted in First Boot Wizard being skipp>                                                                                                                                               
Apr 07 08:36:45 carlos systemd[1]: Condition check resulted in Rebuild Hardware Database bei>                                                                                                                                               
Apr 07 08:36:45 carlos systemd[1]: Condition check resulted in Create System Users being ski>                                                                                                                                               
Apr 07 08:36:45 carlos systemd[1]: Finished Create list of static device nodes for the curre>                                                                                                                                               
Apr 07 08:36:45 carlos systemd[1]: Starting Create Static Device Nodes in /dev...                                                                                                                                                           
Apr 07 08:36:45 carlos systemd[1]: Mounted Huge Pages File System.                                                                                                                                                                          
Apr 07 08:36:45 carlos systemd[1]: Mounted POSIX Message Queue File System.                                                                                                                                                                 
Apr 07 08:36:45 carlos kernel: Linux agpgart interface v0.103                                                                                                                                                                               
Apr 07 08:36:45 carlos systemd[1]: Finished udev Coldplug all Devices.                                                                                                                                                                      
Apr 07 08:36:45 carlos systemd[1]: Starting udev Wait for Complete Device Initialization...                                                                                                                                                 
Apr 07 08:36:45 carlos kernel: Asymmetric key parser 'pkcs8' registered                                                                                                                                                                     
Apr 07 08:36:45 carlos systemd[1]: Finished Load Kernel Modules.                                                                                                                                                                            
Apr 07 08:36:45 carlos systemd-sysctl[329]: Not setting net/ipv4/conf/all/accept_source_route (explicit setting exists).
Apr 07 08:36:45 carlos systemd-sysctl[329]: Not setting net/ipv4/conf/default/accept_source_route (explicit setting exists).
Apr 07 08:36:45 carlos systemd-sysctl[329]: Not setting net/ipv4/conf/all/promote_secondaries (explicit setting exists).
Apr 07 08:36:45 carlos systemd-sysctl[329]: Not setting net/ipv4/conf/default/promote_secondaries (explicit setting exists).
Apr 07 08:36:45 carlos systemd[1]: Starting Flush Journal to Persistent Storage...
Apr 07 08:36:45 carlos systemd[1]: Started Journal Service.
Apr 07 08:36:45 carlos kernel: audit: type=1130 audit(1586263005.112:2): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-journald comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Apr 07 08:36:45 carlos systemd-journald[319]: Time spent on flushing to /var/log/journal/72a77f886610450b9c0d3d70301bcfb1 is 258.278ms for 849 entries.
-- Reboot --
Apr 07 08:37:27 carlos kernel: microcode: microcode updated early to revision 0x2f, date = 2019-02-17
Apr 07 08:37:27 carlos kernel: Linux version 5.6.2-arch1-2 (linux@archlinux) (gcc version 9.3.0 (Arch Linux 9.3.0-1)) #1 SMP PREEMPT Sun, 05 Apr 2020 05:13:14 +0000
Apr 07 08:37:27 carlos kernel: Command line: BOOT_IMAGE=/boot/vmlinuz-linux root=UUID=2b96693f-4ae2-4fe7-a61d-9f28be64d981 rw loglevel=3 quiet ipv6.disable=1
Apr 07 08:37:27 carlos kernel: KERNEL supported cpus:
Apr 07 08:37:27 carlos kernel:   Intel GenuineIntel
Apr 07 08:37:27 carlos kernel:   AMD AuthenticAMD
Apr 07 08:37:27 carlos kernel:   Hygon HygonGenuine

Journal without

Apr 07 08:37:27 carlos kernel: Asymmetric key parser 'pkcs8' registered
Apr 07 08:37:27 carlos systemd[1]: Finished Load Kernel Modules.
Apr 07 08:37:27 carlos systemd[1]: Condition check resulted in FUSE Control File System being skipped.
Apr 07 08:37:27 carlos systemd[1]: Mounting Kernel Configuration File System...
Apr 07 08:37:27 carlos systemd[1]: Starting Apply Kernel Variables...
Apr 07 08:37:27 carlos systemd[1]: Mounted Kernel Configuration File System.
Apr 07 08:37:27 carlos systemd[1]: Finished Apply Kernel Variables.
Apr 07 08:37:27 carlos systemd[1]: Finished Create Static Device Nodes in /dev.
Apr 07 08:37:27 carlos systemd[1]: Reached target Local File Systems (Pre).
Apr 07 08:37:27 carlos systemd[1]: Condition check resulted in Virtual Machine and Container Storage (Compatibility) being skipped.
Apr 07 08:37:27 carlos systemd[1]: Starting udev Kernel Device Manager...
Apr 07 08:37:27 carlos systemd[1]: modprobe@drm.service: Succeeded.
Apr 07 08:37:27 carlos systemd[1]: Finished Load Kernel Module drm.
Apr 07 08:37:27 carlos kernel: audit: type=1130 audit(1586263047.250:2): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=modprobe@drm comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Apr 07 08:37:27 carlos kernel: audit: type=1131 audit(1586263047.250:3): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=modprobe@drm comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Apr 07 08:37:27 carlos systemd-journald[318]: Journal started
Apr 07 08:37:27 carlos systemd-journald[318]: Runtime Journal (/run/log/journal/72a77f886610450b9c0d3d70301bcfb1) is 8.0M, max 395.6M, 387.6M free.
Apr 07 08:37:27 carlos audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=modprobe@drm comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Apr 07 08:37:27 carlos audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=modprobe@drm comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Apr 07 08:37:27 carlos systemd-modules-load[319]: Inserted module 'pkcs8_key_parser'
Apr 07 08:37:27 carlos audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-journald comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Apr 07 08:37:27 carlos systemd-sysctl[327]: Not setting net/ipv4/conf/all/rp_filter (explicit setting exists).
Apr 07 08:37:27 carlos systemd-sysctl[327]: Not setting net/ipv4/conf/default/rp_filter (explicit setting exists).
Apr 07 08:37:27 carlos systemd-sysctl[327]: Not setting net/ipv4/conf/all/accept_source_route (explicit setting exists).
Apr 07 08:37:27 carlos systemd-sysctl[327]: Not setting net/ipv4/conf/default/accept_source_route (explicit setting exists).
Apr 07 08:37:27 carlos systemd-sysctl[327]: Not setting net/ipv4/conf/all/promote_secondaries (explicit setting exists).
Apr 07 08:37:27 carlos systemd-sysctl[327]: Not setting net/ipv4/conf/default/promote_secondaries (explicit setting exists).
Apr 07 08:37:27 carlos systemd[1]: Starting Flush Journal to Persistent Storage...
Apr 07 08:37:27 carlos systemd[1]: Started Journal Service.
Apr 07 08:37:27 carlos kernel: audit: type=1130 audit(1586263047.300:4): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-journald comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Apr 07 08:37:27 carlos systemd-journald[318]: Time spent on flushing to /var/log/journal/72a77f886610450b9c0d3d70301bcfb1 is 12.690ms for 856 entries.
Apr 07 08:37:27 carlos systemd-journald[318]: System Journal (/var/log/journal/72a77f886610450b9c0d3d70301bcfb1) is 232.0M, max 4.0G, 3.7G free.
Apr 07 08:37:28 carlos kernel: audit: type=1130 audit(1586263048.493:5): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-udevd comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Apr 07 08:37:28 carlos audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-udevd comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Apr 07 08:37:28 carlos systemd[1]: Started udev Kernel Device Manager.
Apr 07 08:37:28 carlos audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-journal-flush comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Apr 07 08:37:28 carlos systemd[1]: Finished Flush Journal to Persistent Storage.
Apr 07 08:37:28 carlos kernel: audit: type=1130 audit(1586263048.593:6): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-journal-flush comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Apr 07 08:37:28 carlos kernel: ACPI Warning: SystemIO range 0x0000000000000428-0x000000000000042F conflicts with OpRegion 0x0000000000000400-0x000000000000047F (\PMIO) (20200110/utaddress-204)
Apr 07 08:37:28 carlos kernel: ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
Apr 07 08:37:28 carlos kernel: ACPI Warning: SystemIO range 0x0000000000000540-0x000000000000054F conflicts with OpRegion 0x0000000000000500-0x0000000000000563 (\GPIO) (20200110/utaddress-204)
Apr 07 08:37:28 carlos kernel: ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
Apr 07 08:37:28 carlos kernel: ACPI Warning: SystemIO range 0x0000000000000530-0x000000000000053F conflicts with OpRegion 0x0000000000000500-0x0000000000000563 (\GPIO) (20200110/utaddress-204)
Apr 07 08:37:28 carlos kernel: ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
Apr 07 08:37:28 carlos kernel: ACPI Warning: SystemIO range 0x0000000000000500-0x000000000000052F conflicts with OpRegion 0x0000000000000500-0x0000000000000563 (\GPIO) (20200110/utaddress-204)
Apr 07 08:37:28 carlos kernel: ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver

Tips or next steps appreciated.

Edit: Forgot to mention that I ran..

# mkinitcpio -p linux

After creating ingnore_uas.conf

Last edited by Zod (2020-04-08 12:25:56)

Offline

#2 2020-04-07 15:05:30

loqs
Member
Registered: 2014-03-06
Posts: 18,928

Re: [Solved] Intermitant kernel panic during boot

Is there any additional output on the display from the panic that is not present in the journal?
Edit:
Have you tried linux-lts to see if 5.4 has the issue?

Last edited by loqs (2020-04-07 15:07:00)

Offline

#3 2020-04-07 15:10:35

Zod
Member
From: Hoosiertucky
Registered: 2019-03-10
Posts: 636

Re: [Solved] Intermitant kernel panic during boot

@ loqs
Yeah, it's what I figure is the core dump output on tty, I've not been able to capture it.

coredumpctl list

TIME                            PID   UID   GID SIG COREFILE  EXE
Thu 2020-04-02 21:13:24 EDT     715  1000  1000  11 missing   /usr/lib/firefox/firefox
Thu 2020-04-02 21:47:51 EDT     798  1000  1000  11 missing   /usr/bin/python3.8
Mon 2020-04-06 19:33:26 EDT    1243  1000  1000  11 present   /usr/lib/firefox/firefox

Edit: I can give 5.4 lts a try, I've got a meeting coming up and I'm running a 2 drive zfs mirror on on the blacx so it will be a while.

Edit1: Before doing zfs I had a 2 device btrfs raid1 on the same setup and the kernel was intermittently panicking on that also.

Last edited by Zod (2020-04-07 15:24:13)

Offline

#4 2020-04-07 15:23:31

loqs
Member
Registered: 2014-03-06
Posts: 18,928

Re: [Solved] Intermitant kernel panic during boot

A kernel panic will not be captured by a coredump.  Does the display show text similar to Kernel_panic?  Does the system just hang or reboot without showing any message?

Offline

#5 2020-04-07 15:26:15

Zod
Member
From: Hoosiertucky
Registered: 2019-03-10
Posts: 636

Re: [Solved] Intermitant kernel panic during boot

Yeah, like the first pic, it scrolls about 2 screens worth and requires a hard reboot.

Edit: The file I created does not help, it happened again. In case there is any interest, I took a picture of the screen (sorry)

Click to embiggen.
(Took out the pic)

Edit:1
Downgraded to..

Linux carlos 5.4.15-arch1-1 #1 SMP PREEMPT Sun, 26 Jan 2020 09:48:50 +0000 x86_64 GNU/Linux

It panicked again.

Edit:2
I've moved this device to a different port and have not been able to get it to panic, closing.

Last edited by Zod (2020-04-08 12:39:30)

Offline

Board footer

Powered by FluxBB