You are not logged in.

#1 2018-02-21 17:11:37

morphin
Member
Registered: 2017-11-15
Posts: 20

BUG: soft lockup - CPU#22 stuck for 21s! [z_null_iss:28262]

Hello.

Distribution Version    | SMP Tue Feb 13 13:11:52 CET 2018 x86_64 GNU/Linux
Linux Kernel               | 4.14.19-1-lts
ZFS Version               | zfs-linux 0.7.6-1
SPL Version               | spl-linux 0.7.6-1


After upgrade ZFS & kernel from "zfs-linux 0.7.5.4.14.12.1-1" to "0.7.6-1" and "4.14.12-1-ARCH" to "4.14.19-1-lts" I got the error while importing a pool: 

This is the import time:
[2018-02-20 21:32:19] zpool import ssdpool
 
After 30 sec i got this lockup:
Feb 20 21:32:59 DEV1 kernel: watchdog: BUG: soft lockup - CPU#22 stuck for 21s! [z_null_iss:28262]
 
Everything works right now but i have lockup cores and %100 endless cpu usage on some cores.

_____________________________________________________
39780 root        0 -20     0     0     0 R 100.  0.0 14h56:58 z_null_iss
31356 root       20   0     0     0     0 R 100.  0.0 15h01:36 mmp
28262 root        0 -20     0     0     0 R 100.  0.0 15h01:45 z_null_iss
6786 root       20   0     0     0     0 R 100.  0.0 14h59:34 mmp
_____________________________________________________


My ZFS settings:   
multihost=on
zfs_multihost_fail_intervals = 0

Boot settings:
pti=off earlymodules=xhci_hcd modules-load=xhci_hcd scsi_mod.use_blk_mq=y dm_mod.use_blk_mq=y ipv6.disable_ipv6=1 nomodeset vga=791 quiet loglevel=3 udev.log-priority=3


LOGS:

Feb 20 21:28:26 DEV1 kernel: pci 0000:82:00.0: reg 0x30: [mem 0xfb900000-0xfb9fffff pref]
Feb 20 21:28:26 DEV1 kernel: pci 0000:82:00.0: enabling Extended Tags
Feb 20 21:28:26 DEV1 kernel: pci 0000:82:00.0: supports D1 D2
Feb 20 21:28:26 DEV1 kernel: pci 0000:82:00.0: reg 0x174: [mem 0x00000000-0x0000ffff 64bit]
Feb 20 21:28:26 DEV1 kernel: pci 0000:82:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit] (contains BAR0 for 16 VFs)
...skipping...
Feb 20 21:32:59 DEV1 kernel: watchdog: BUG: soft lockup - CPU#22 stuck for 21s! [z_null_iss:28262]
Feb 20 21:32:59 DEV1 kernel: Modules linked in: msr dm_service_time dm_multipath scsi_dh_rdac scsi_dh_emc scsi_dh_alua ses enclosure 8021q mrp intel_rapl x86_pkg_temp_thermal intel_powerclamp coretemp i
Feb 20 21:32:59 DEV1 kernel:  mptscsih mptbase hpsa hid_generic usbhid zfs(PO) zunicode(PO) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) sd_mod mpt3sas raid_class scsi_transport_sas megaraid_sas ahci
Feb 20 21:32:59 DEV1 kernel: CPU: 22 PID: 28262 Comm: z_null_iss Tainted: P           O    4.14.19-1-lts #1
Feb 20 21:32:59 DEV1 kernel: Hardware name: Supermicro X10DRH LN4/X10DRH-CLN4, BIOS 2.0 01/30/2016
Feb 20 21:32:59 DEV1 kernel: task: ffff8a76a0083a00 task.stack: ffffa61a8c074000
Feb 20 21:32:59 DEV1 kernel: RIP: 0010:SHA256TransformBlocks+0xf14/0x1300 [icp]
Feb 20 21:32:59 DEV1 kernel: RSP: 0018:ffffa61a8c077a00 EFLAGS: 00000282 ORIG_RAX: ffffffffffffff10
Feb 20 21:32:59 DEV1 kernel: RAX: 00000000ac8afa43 RBX: 0000000021fcf6b8 RCX: 00000000ed685c94
Feb 20 21:32:59 DEV1 kernel: RDX: 00000000d3515c9e RSI: ffff8a769df35bc0 RDI: 000000000000003a
Feb 20 21:32:59 DEV1 kernel: RBP: ffffffffc0642400 R08: 00000000d2693222 R09: 00000000d75e1120
Feb 20 21:32:59 DEV1 kernel: R10: 0000000073c4bb28 R11: 0000000037a3b700 R12: 000000007c107125
Feb 20 21:32:59 DEV1 kernel: R13: 0000000012eca1cf R14: 00000000ffcefb6b R15: 0000000073c4bb28
Feb 20 21:32:59 DEV1 kernel: FS:  0000000000000000(0000) GS:ffff8a78bfb00000(0000) knlGS:0000000000000000
Feb 20 21:32:59 DEV1 kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Feb 20 21:32:59 DEV1 kernel: CR2: 00007f5dfd784728 CR3: 00000051c000a003 CR4: 00000000003606e0
Feb 20 21:32:59 DEV1 kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Feb 20 21:32:59 DEV1 kernel: DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Feb 20 21:32:59 DEV1 kernel: Call Trace:
Feb 20 21:32:59 DEV1 kernel:  ? SHA2Update+0x1c3/0x1e0 [icp]
Feb 20 21:32:59 DEV1 kernel:  ? sa_register_update_callback_locked+0x20/0x20 [zfs]
Feb 20 21:32:59 DEV1 kernel:  ? sha_incremental+0x16/0x20 [zfs]
Feb 20 21:32:59 DEV1 kernel:  ? abd_iterate_func+0xa4/0x130 [zfs]
Feb 20 21:32:59 DEV1 kernel:  ? sha_incremental+0x20/0x20 [zfs]
Feb 20 21:32:59 DEV1 kernel:  ? abd_checksum_SHA256+0x51/0xb0 [zfs]
Feb 20 21:32:59 DEV1 kernel:  ? blk_mq_flush_plug_list+0x1c9/0x240
Feb 20 21:32:59 DEV1 kernel:  ? abd_iterate_func+0x73/0x130 [zfs]
Feb 20 21:32:59 DEV1 kernel:  ? zio_checksum_compute+0x1ae/0x300 [zfs]
Feb 20 21:32:59 DEV1 kernel:  ? zio_checksum_generate+0x3f/0x60 [zfs]
Feb 20 21:32:59 DEV1 kernel:  ? zio_execute+0x87/0xe0 [zfs]
Feb 20 21:32:59 DEV1 kernel:  ? taskq_thread+0x295/0x4a0 [spl]
Feb 20 21:32:59 DEV1 kernel:  ? wake_up_q+0x70/0x70
Feb 20 21:32:59 DEV1 kernel:  ? zio_reexecute+0x370/0x370 [zfs]
Feb 20 21:32:59 DEV1 kernel:  ? taskq_thread_should_stop+0x70/0x70 [spl]
Feb 20 21:32:59 DEV1 kernel:  ? kthread+0x11a/0x130
Feb 20 21:32:59 DEV1 kernel:  ? kthread_create_on_node+0x70/0x70
Feb 20 21:32:59 DEV1 kernel:  ? kthread_create_on_node+0x70/0x70
Feb 20 21:32:59 DEV1 kernel:  ? ret_from_fork+0x35/0x40
Feb 20 21:32:59 DEV1 kernel: Code: 89 d1 45 01 ec 45 01 fc 45 89 d5 45 89 d6 41 c1 c9 02 41 c1 cd 0d 45 89 d7 44 03 64 bd 00 45 31 e9 41 c1 cd 09 41 09 c6 45 31 e9 <41> 21 c7 44 01 e3 45 21 de 45 01 e1
Feb 20 21:34:08 DEV1 kernel: ZFS: Unable to set "noop" scheduler for /dev/mapper/35000c5003022e31b (dm-80): 256
Feb 20 21:34:08 DEV1 kernel: ZFS: Unable to set "noop" scheduler for /dev/mapper/35000c5003023ff67 (dm-2): 256
Feb 20 21:34:08 DEV1 kernel: ZFS: Unable to set "noop" scheduler for /dev/mapper/35000c5003022e3bb (dm-313): 256
Feb 20 21:34:08 DEV1 kernel: ZFS: Unable to set "noop" scheduler for /dev/mapper/35000c5003022e2e7 (dm-158): 256
Feb 20 21:34:08 DEV1 kernel: ZFS: Unable to set "noop" scheduler for /dev/mapper/35000c5003022e26f (dm-235): 256
Feb 20 21:34:08 DEV1 kernel: ZFS: Unable to set "noop" scheduler for /dev/mapper/35000c50093dd9ba3 (dm-377): 256
Feb 20 21:34:08 DEV1 kernel: ZFS: Unable to set "noop" scheduler for /dev/mapper/35000c50093cb7353 (dm-334): 256
Feb 20 21:34:08 DEV1 kernel: ZFS: Unable to set "noop" scheduler for /dev/mapper/35000c50093d28e0b (dm-273): 256
Feb 20 21:34:08 DEV1 kernel: ZFS: Unable to set "noop" scheduler for /dev/mapper/35000c50093ddc013 (dm-202): 256
Feb 20 21:34:08 DEV1 kernel: ZFS: Unable to set "noop" scheduler for /dev/mapper/35000c50093dda863 (dm-67): 256
Feb 20 21:34:08 DEV1 kernel: ZFS: Unable to set "noop" scheduler for /dev/mapper/35000c50093d51bf3 (dm-285): 256
lines 9640-96

Offline

Board footer

Powered by FluxBB