You are not logged in.
- Topics: Active | Unanswered
#1 2015-07-15 10:23:15
- chuliqiang
- Member
- Registered: 2015-07-15
- Posts: 3
My NFS is crash and computer CPU is stuck
I use this command output:
sudo journalctl --since "1200 min ago"
Jul 14 12:02:42 head kernel: general protection fault: 0000 [#1] PREEMPT SMP
Jul 14 12:02:42 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:02:42 head kernel: CPU: 2 PID: 534 Comm: nfsd Tainted: G W 3.18.2-2-ARCH #1
Jul 14 12:02:42 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:02:42 head kernel: task: ffff8817f8a42840 ti: ffff8817f1c38000 task.ti: ffff8817f1c38000
Jul 14 12:02:42 head kernel: RIP: 0010:[<ffffffffa01f3222>] [<ffffffffa01f3222>] unhash_ol_stateid+0x42/0x80 [nfsd]
Jul 14 12:02:42 head kernel: RSP: 0018:ffff8817f1c3bc88 EFLAGS: 00010246
Jul 14 12:02:42 head kernel: RAX: dead000000200200 RBX: ffff8817c0cc64b0 RCX: 0000000000000015
Jul 14 12:02:42 head kernel: RDX: dead000000100100 RSI: 0000000000000000 RDI: ffff88006dea26cc
Jul 14 12:02:42 head kernel: RBP: ffff8817f1c3bca8 R08: 0000000000000000 R09: 0000000000000089
Jul 14 12:02:42 head kernel: R10: ffff8817f96ec000 R11: ffff8817fab153c0 R12: ffff88006dea26cc
Jul 14 12:02:42 head kernel: R13: dead000000200200 R14: dead000000100100 R15: ffff88010e29cb40
Jul 14 12:02:42 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa20000(0000) knlGS:0000000000000000
Jul 14 12:02:42 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:02:42 head kernel: CR2: 00007f21ac0de000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:02:42 head kernel: Stack:
Jul 14 12:02:42 head kernel: ffff8817c0cc64b0 ffff8817f1c3bcd8 ffff88010e29c800 0000000000000000
Jul 14 12:02:42 head kernel: ffff8817f1c3bd48 ffffffffa01fb156 0000040000000400 000000001e24efc0
Jul 14 12:02:42 head kernel: 00000004fab150a0 ffff8817c0cc64b0 ffff8817f1c3bcd8 ffff8817f1c3bcd8
Jul 14 12:02:42 head kernel: Call Trace:
Jul 14 12:02:42 head kernel: [<ffffffffa01fb156>] nfsd4_close+0x106/0x380 [nfsd]
Jul 14 12:02:42 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:02:42 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:02:42 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:02:42 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:02:42 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:02:42 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:02:42 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:02:42 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:02:42 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:02:42 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:02:42 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:02:42 head kernel: Code: 49 be 00 01 10 00 00 00 ad de 49 bd 00 02 20 00 00 00 ad de 4c 8d 60 04 4c 89 e7 e8 29 0f 36 e1 48 8b 53 30 48 8b 43 38 4c 89 e7 <48> 89 42 08 48 89 10 4c 89 73 30 4c 89 6b 38 e8 0a 10 36 e1 48
Jul 14 12:02:42 head kernel: RIP [<ffffffffa01f3222>] unhash_ol_stateid+0x42/0x80 [nfsd]
Jul 14 12:02:43 head kernel: RSP <ffff8817f1c3bc88>
Jul 14 12:02:43 head kernel: ------------[ cut here ]------------
Jul 14 12:02:43 head kernel: kernel BUG at arch/x86/mm/pageattr.c:216!
Jul 14 12:02:43 head kernel: invalid opcode: 0000 [#2] PREEMPT SMP
Jul 14 12:02:43 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:02:43 head kernel: CPU: 2 PID: 534 Comm: nfsd Tainted: G W 3.18.2-2-ARCH #1
Jul 14 12:02:43 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:02:43 head kernel: task: ffff8817f8a42840 ti: ffff8817f1c38000 task.ti: ffff8817f1c38000
Jul 14 12:02:43 head kernel: RIP: 0010:[<ffffffff81063c46>] [<ffffffff81063c46>] change_page_attr_set_clr+0x496/0x4d0
Jul 14 12:02:43 head kernel: RSP: 0018:ffff8817f1c3afd8 EFLAGS: 00010046
Jul 14 12:02:43 head kernel: RAX: 0000000000000046 RBX: 0000000000000000 RCX: 0000000000000005
Jul 14 12:02:43 head kernel: RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000080000000
Jul 14 12:02:43 head kernel: RBP: ffff8817f1c3b078 R08: ffff880000000e30 R09: 00000017f97c5000
Jul 14 12:02:43 head kernel: R10: 0000000000000010 R11: 0000000000000001 R12: 0000000000000000
Jul 14 12:02:43 head kernel: R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000200
Jul 14 12:02:43 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa20000(0000) knlGS:0000000000000000
Jul 14 12:02:43 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:02:43 head kernel: CR2: 00007f21ac0de000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:02:43 head kernel: Stack:
Jul 14 12:02:43 head kernel: 0000000400000008 0000000000000000 0000000000000010 ffff88178b060000
Jul 14 12:02:43 head kernel: ffff8817f1c3b028 0000000000000000 0000000000000000 0000000000000010
Jul 14 12:02:43 head kernel: 0000000000000000 0000000500000001 0000000000078c5e 0000020000000000
Jul 14 12:02:43 head kernel: Call Trace:
Jul 14 12:02:43 head kernel: [<ffffffff8106422a>] _set_pages_array+0xfa/0x150
Jul 14 12:02:43 head kernel: [<ffffffff810642b3>] set_pages_array_wc+0x13/0x20
Jul 14 12:02:43 head kernel: [<ffffffffa04cbf0f>] ttm_set_pages_caching+0x2f/0x70 [ttm]
Jul 14 12:02:43 head kernel: [<ffffffffa04cc009>] ttm_alloc_new_pages.isra.6+0xb9/0x180 [ttm]
Jul 14 12:02:43 head kernel: [<ffffffffa04cc594>] ttm_pool_populate+0x404/0x500 [ttm]
Jul 14 12:02:43 head kernel: [<ffffffffa034edce>] mgag200_ttm_tt_populate+0xe/0x10 [mgag200]
Jul 14 12:02:43 head kernel: [<ffffffffa04c8e31>] ttm_bo_move_memcpy+0x5e1/0x640 [ttm]
Jul 14 12:02:43 head kernel: [<ffffffffa04c43ac>] ? ttm_tt_init+0x8c/0xb0 [ttm]
Jul 14 12:02:43 head kernel: [<ffffffffa034ed78>] mgag200_bo_move+0x18/0x20 [mgag200]
Jul 14 12:02:43 head kernel: [<ffffffffa04c6152>] ttm_bo_handle_move_mem+0x2b2/0x660 [ttm]
Jul 14 12:02:43 head kernel: [<ffffffffa04c6c00>] ? ttm_bo_mem_space+0xf0/0x370 [ttm]
Jul 14 12:02:43 head kernel: [<ffffffffa04c738b>] ttm_bo_validate+0x20b/0x220 [ttm]
Jul 14 12:02:43 head kernel: [<ffffffff8106154b>] ? iounmap+0x7b/0xb0
Jul 14 12:02:43 head kernel: [<ffffffffa034f686>] mgag200_bo_push_sysram+0x96/0xf0 [mgag200]
Jul 14 12:02:43 head kernel: [<ffffffffa034ab17>] mga_crtc_do_set_base.isra.9.constprop.17+0x87/0x470 [mgag200]
Jul 14 12:02:43 head kernel: [<ffffffff812bf4c3>] ? delay_tsc+0x43/0xc0
Jul 14 12:02:43 head kernel: [<ffffffffa034befa>] mga_crtc_mode_set+0xffa/0x20f0 [mgag200]
Jul 14 12:02:43 head kernel: [<ffffffffa04a396d>] drm_crtc_helper_set_mode+0x32d/0x590 [drm_kms_helper]
Jul 14 12:02:43 head kernel: [<ffffffffa04a4740>] drm_crtc_helper_set_config+0x9c0/0xb50 [drm_kms_helper]
Jul 14 12:02:43 head kernel: [<ffffffffa0471380>] drm_mode_set_config_internal+0x60/0xf0 [drm]
Jul 14 12:02:43 head kernel: [<ffffffffa04ad515>] drm_fb_helper_pan_display+0x95/0xf0 [drm_kms_helper]
Jul 14 12:02:43 head kernel: [<ffffffff81322e7a>] fb_pan_display+0x9a/0x160
Jul 14 12:02:43 head kernel: [<ffffffff8131cde0>] bit_update_start+0x20/0x50
Jul 14 12:02:43 head kernel: [<ffffffff8131a5d1>] fbcon_switch+0x3b1/0x5e0
Jul 14 12:02:43 head kernel: [<ffffffff81392c59>] redraw_screen+0x1a9/0x250
Jul 14 12:02:43 head kernel: [<ffffffff813199ba>] fbcon_blank+0x23a/0x340
Jul 14 12:02:43 head kernel: [<ffffffff810c842c>] ? wake_up_klogd+0x3c/0x60
Jul 14 12:02:43 head kernel: [<ffffffff810c86d2>] ? console_unlock+0x282/0x460
Jul 14 12:02:43 head kernel: [<ffffffff810d9be3>] ? internal_add_timer+0x63/0x80
Jul 14 12:02:43 head kernel: [<ffffffff810dab14>] ? mod_timer+0x114/0x250
Jul 14 12:02:43 head kernel: [<ffffffff8139378a>] do_unblank_screen+0xaa/0x1d0
Jul 14 12:02:43 head kernel: [<ffffffff813938c0>] unblank_screen+0x10/0x20
Jul 14 12:02:43 head kernel: [<ffffffff812c1d39>] bust_spinlocks+0x19/0x40
Jul 14 12:02:43 head kernel: [<ffffffff81018788>] oops_end+0x38/0xe0
Jul 14 12:02:43 head kernel: [<ffffffff81018ceb>] die+0x4b/0x70
Jul 14 12:02:43 head kernel: [<ffffffff810152fa>] do_general_protection+0xda/0x160
Jul 14 12:02:43 head kernel: [<ffffffff81556af8>] general_protection+0x28/0x30
Jul 14 12:02:43 head kernel: [<ffffffffa01f3222>] ? unhash_ol_stateid+0x42/0x80 [nfsd]
Jul 14 12:02:43 head kernel: [<ffffffffa01f3217>] ? unhash_ol_stateid+0x37/0x80 [nfsd]
Jul 14 12:02:43 head kernel: [<ffffffffa01fb156>] nfsd4_close+0x106/0x380 [nfsd]
Jul 14 12:02:43 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:02:43 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:02:43 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:02:43 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:02:43 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:02:43 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:02:43 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:02:43 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:02:43 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:02:43 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:02:43 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:02:43 head kernel: Code: 01 74 d2 be 00 10 00 00 4c 89 f7 e8 b5 dc ff ff eb c3 0f 1f 00 be 00 10 00 00 4c 89 f7 e8 a3 dc ff ff e9 0a fe ff ff 0f 0b 0f 0b <0f> 0b be ba 00 00 00 48 c7 c7 ca fe 6f 81 44 89 95 78 ff ff ff
Jul 14 12:02:43 head kernel: RIP [<ffffffff81063c46>] change_page_attr_set_clr+0x496/0x4d0
Jul 14 12:02:43 head kernel: RSP <ffff8817f1c3afd8>
Jul 14 12:02:43 head kernel: ---[ end trace e8a8a2d8ec728df4 ]---
Jul 14 12:02:43 head kernel: note: nfsd[534] exited with preempt_count 2
Jul 14 12:02:56 head pbs_server[30205]: LOG_ERROR::svr_is_request, bad attempt to connect from 192.168.2.236:706 (address not trusted - check entry in server_priv/nodes)
Jul 14 12:02:58 head pbs_server[30205]: LOG_ERROR::svr_is_request, bad attempt to connect from 192.168.2.233:646 (address not trusted - check entry in server_priv/nodes)
Jul 14 12:03:07 head kernel: NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [nfsd:537]
Jul 14 12:03:07 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:03:07 head kernel: CPU: 0 PID: 537 Comm: nfsd Tainted: G D W 3.18.2-2-ARCH #1
Jul 14 12:03:07 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:03:07 head kernel: task: ffff8817f8a46eb0 ti: ffff8817f1f5c000 task.ti: ffff8817f1f5c000
Jul 14 12:03:07 head kernel: RIP: 0010:[<ffffffff8155417a>] [<ffffffff8155417a>] _raw_spin_lock+0x3a/0x40
Jul 14 12:03:07 head kernel: RSP: 0018:ffff8817f1f5fcc8 EFLAGS: 00000202
Jul 14 12:03:07 head kernel: RAX: 0000000000007810 RBX: ffff8817f96ec000 RCX: 00000000000000c1
Jul 14 12:03:07 head kernel: RDX: 00000000000000c0 RSI: 000000000000132a RDI: ffff88010e29cb40
Jul 14 12:03:07 head kernel: RBP: ffff8817f1f5fcc8 R08: ffff8817db320540 R09: ffff88010e306a00
Jul 14 12:03:07 head kernel: R10: ffff88010e29cb40 R11: ffff88010e29c800 R12: ffff882ff904e718
Jul 14 12:03:07 head kernel: R13: ffff8817f1f5fc60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:03:07 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa00000(0000) knlGS:0000000000000000
Jul 14 12:03:07 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:03:07 head kernel: CR2: 00007f23500d8000 CR3: 0000000001811000 CR4: 00000000001407f0
Jul 14 12:03:07 head kernel: Stack:
Jul 14 12:03:07 head kernel: ffff8817f1f5fd48 ffffffffa01f7fc4 ffff8817db320540 ffff88010e306a00
Jul 14 12:03:07 head kernel: ffff88010e29c800 ffff88010e29cb40 ffff88164fcf8000 ffff8817f1e41068
Jul 14 12:03:07 head kernel: 00000000818adc00 00000000f1e7181a ffff8817f1f5fdd8 ffff8817f1e41000
Jul 14 12:03:07 head kernel: Call Trace:
Jul 14 12:03:07 head kernel: [<ffffffffa01f7fc4>] nfsd4_sequence+0x334/0x610 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:03:07 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:03:07 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:03:07 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:03:07 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:03:07 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:03:07 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:03:07 head kernel: Code: 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 0f b6 17 <38> ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f 1f 44 00
Jul 14 12:03:07 head kernel: NMI watchdog: BUG: soft lockup - CPU#4 stuck for 22s! [nfsd:535]
Jul 14 12:03:07 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:03:07 head kernel: CPU: 4 PID: 535 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:03:07 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:03:07 head kernel: task: ffff8817f8a43250 ti: ffff8817f1d34000 task.ti: ffff8817f1d34000
Jul 14 12:03:07 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:03:07 head kernel: RSP: 0018:ffff8817f1d37cc8 EFLAGS: 00000297
Jul 14 12:03:07 head kernel: RAX: 0000000000004eac RBX: ffffffffa0183eec RCX: 000000000000001d
Jul 14 12:03:07 head kernel: RDX: 000000000000001c RSI: 00000000000000d0 RDI: ffff8817f96ec130
Jul 14 12:03:07 head kernel: RBP: ffff8817f1d37cc8 R08: ffff8817dfc3e840 R09: ffff8817fab11000
Jul 14 12:03:07 head kernel: R10: 0000000000000004 R11: ffff8817fab13080 R12: ffff882ff904e718
Jul 14 12:03:07 head kernel: R13: ffff8817f1d37c60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:03:07 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa40000(0000) knlGS:0000000000000000
Jul 14 12:03:07 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:03:07 head kernel: CR2: 00007f216c0e2000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:03:07 head kernel: Stack:
Jul 14 12:03:07 head kernel: ffff8817f1d37d48 ffffffffa01f7d76 0000000015de9b97 000000006f7b8096
Jul 14 12:03:07 head kernel: ffff8817f1d37d38 ffff8817f5302000 ffff8817dfc3e840 ffff8817fab11068
Jul 14 12:03:07 head kernel: ffffffff818adc00 000000006f7b8096 ffff8817fa590000 ffff8817fab11000
Jul 14 12:03:07 head kernel: Call Trace:
Jul 14 12:03:07 head kernel: [<ffffffffa01f7d76>] nfsd4_sequence+0xe6/0x610 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:03:07 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:03:07 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:03:07 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:03:07 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:03:07 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:03:07 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:03:07 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:03:07 head kernel: NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [nfsd:539]
Jul 14 12:03:07 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:03:07 head kernel: CPU: 6 PID: 539 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:03:07 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:03:07 head kernel: task: ffff8817f8a45a90 ti: ffff8817f195c000 task.ti: ffff8817f195c000
Jul 14 12:03:07 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:03:07 head kernel: RSP: 0018:ffff8817f195fbc8 EFLAGS: 00000293
Jul 14 12:03:07 head kernel: RAX: 00000000000057f1 RBX: ffff8801178cc900 RCX: 000000000000001e
Jul 14 12:03:07 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:03:07 head kernel: RBP: ffff8817f195fbc8 R08: 0000000000000000 R09: ffff8817f96ec000
Jul 14 12:03:07 head kernel: R10: ffff8817f96ec000 R11: ffff8817f1e44220 R12: ffffffff8124f74c
Jul 14 12:03:07 head kernel: R13: ffff8817f195fc98 R14: ffff8814ec9b3380 R15: ffff8817f8bc1ce0
Jul 14 12:03:07 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa60000(0000) knlGS:0000000000000000
Jul 14 12:03:07 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:03:07 head kernel: CR2: 00007f23380df000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:03:07 head kernel: Stack:
Jul 14 12:03:07 head kernel: ffff8817f195fbf8 ffffffffa01f4eff ffff8817f1e44244 ffff8817f96ec000
Jul 14 12:03:07 head kernel: ffff8817f1e45068 0000000000000009 ffff8817f195fc38 ffffffffa01f4ffa
Jul 14 12:03:07 head kernel: ffff8817f1f62000 0000000000000009 ffff8817f1e44244 ffff8817f195fcd0
Jul 14 12:03:07 head kernel: Call Trace:
Jul 14 12:03:07 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffffa01f6440>] nfs4_preprocess_seqid_op+0x60/0x1a0 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffffa01dee82>] ? rqst_exp_find+0x92/0x190 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffffa01fb0ee>] nfsd4_close+0x9e/0x380 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:03:07 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:03:07 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:03:07 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:03:07 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:03:07 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:03:07 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:03:07 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:03:07 head kernel: NMI watchdog: BUG: soft lockup - CPU#8 stuck for 22s! [nfsd:538]
Jul 14 12:03:07 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:03:07 head kernel: CPU: 8 PID: 538 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:03:07 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:03:07 head kernel: task: ffff8817f8a464a0 ti: ffff8817f1860000 task.ti: ffff8817f1860000
Jul 14 12:03:07 head kernel: RIP: 0010:[<ffffffff8155417a>] [<ffffffff8155417a>] _raw_spin_lock+0x3a/0x40
Jul 14 12:03:07 head kernel: RSP: 0018:ffff8817f1863c08 EFLAGS: 00000206
Jul 14 12:03:07 head kernel: RAX: 00000000000078e7 RBX: 0000000000000246 RCX: 000000000000001f
Jul 14 12:03:07 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:03:07 head kernel: RBP: ffff8817f1863c08 R08: 0000000000000000 R09: 0000000000000000
Jul 14 12:03:07 head kernel: R10: 0000000000000400 R11: ffff8817f1e42220 R12: ffff882ff7b80de0
Jul 14 12:03:07 head kernel: R13: ffff8817f8b44480 R14: 00000000888ab88f R15: ffff8817f95c1f00
Jul 14 12:03:07 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa80000(0000) knlGS:0000000000000000
Jul 14 12:03:07 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:03:07 head kernel: CR2: 00007f23480ce000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:03:07 head kernel: Stack:
Jul 14 12:03:07 head kernel: ffff8817f1863c38 ffffffffa01f4eff ffff8817f1e42240 ffff8817f96ec000
Jul 14 12:03:07 head kernel: ffff8817f1e43068 0000000000000007 ffff8817f1863c78 ffffffffa01f4ffa
Jul 14 12:03:07 head kernel: ffff8817f1863c98 ffffffff818adc00 ffff8817f1863d10 ffff8817f1e43068
Jul 14 12:03:07 head kernel: Call Trace:
Jul 14 12:03:07 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffffa01fa6e0>] nfs4_preprocess_stateid_op+0x190/0x330 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffffa01e779a>] nfsd4_write+0x8a/0x1f0 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:03:07 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:03:07 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:03:07 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:03:07 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:03:07 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:03:07 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:03:07 head kernel: Code: 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 0f b6 17 <38> ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f 1f 44 00
Jul 14 12:03:07 head kernel: NMI watchdog: BUG: soft lockup - CPU#10 stuck for 22s! [nfsd:540]
Jul 14 12:03:07 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:03:07 head kernel: CPU: 10 PID: 540 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:03:07 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:03:07 head kernel: task: ffff8817f8a45080 ti: ffff8817f1a78000 task.ti: ffff8817f1a78000
Jul 14 12:03:07 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:03:07 head kernel: RSP: 0018:ffff8817f1a7bcc8 EFLAGS: 00000287
Jul 14 12:03:07 head kernel: RAX: 0000000000000b25 RBX: ffffffffa0183eec RCX: 0000000000000020
Jul 14 12:03:07 head kernel: RDX: 000000000000001c RSI: 00000000000000d0 RDI: ffff8817f96ec130
Jul 14 12:03:07 head kernel: RBP: ffff8817f1a7bcc8 R08: ffff881792d83840 R09: ffff8817f1e47000
Jul 14 12:03:07 head kernel: R10: 0000000000000004 R11: ffff8817f1e46080 R12: ffff882ff904e718
Jul 14 12:03:07 head kernel: R13: ffff8817f1a7bc60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:03:07 head kernel: FS: 0000000000000000(0000) GS:ffff88181faa0000(0000) knlGS:0000000000000000
Jul 14 12:03:07 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:03:07 head kernel: CR2: 00007f22ec0c6000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:03:07 head kernel: Stack:
Jul 14 12:03:07 head kernel: ffff8817f1a7bd48 ffffffffa01f7d76 0000000015de9b97 00000000b16b0475
Jul 14 12:03:07 head kernel: ffff8817f1a7bd38 ffff8817f1f64000 ffff881792d83840 ffff8817f1e47068
Jul 14 12:03:07 head kernel: ffffffff818adc00 00000000b16b0475 ffff8817f1a7bdd8 ffff8817f1e47000
Jul 14 12:03:07 head kernel: Call Trace:
Jul 14 12:03:07 head kernel: [<ffffffffa01f7d76>] nfsd4_sequence+0xe6/0x610 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:03:07 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:03:07 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:03:07 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:03:07 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:03:07 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:03:07 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:03:07 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:03:07 head kernel: NMI watchdog: BUG: soft lockup - CPU#14 stuck for 22s! [nfsd:541]
Jul 14 12:03:07 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:03:07 head kernel: CPU: 14 PID: 541 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:03:07 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:03:07 head kernel: task: ffff8817f1b80000 ti: ffff8817f1b7c000 task.ti: ffff8817f1b7c000
Jul 14 12:03:07 head kernel: RIP: 0010:[<ffffffff8155417a>] [<ffffffff8155417a>] _raw_spin_lock+0x3a/0x40
Jul 14 12:03:07 head kernel: RSP: 0018:ffff8817f1b7fc08 EFLAGS: 00000202
Jul 14 12:03:07 head kernel: RAX: 0000000000002554 RBX: 0000000000000246 RCX: 0000000000000021
Jul 14 12:03:07 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:03:07 head kernel: RBP: ffff8817f1b7fc08 R08: 0000000000000000 R09: 0000000000000000
Jul 14 12:03:07 head kernel: R10: 0000000000000400 R11: ffff8817f1a80220 R12: ffff882ff7b80de0
Jul 14 12:03:07 head kernel: R13: ffff8817f8b44480 R14: 0000000060a0f8c6 R15: ffff8817f95c1f00
Jul 14 12:03:07 head kernel: FS: 0000000000000000(0000) GS:ffff88181fae0000(0000) knlGS:0000000000000000
Jul 14 12:03:07 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:03:07 head kernel: CR2: 00007f235c0d5000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:03:07 head kernel: Stack:
Jul 14 12:03:07 head kernel: ffff8817f1b7fc38 ffffffffa01f4eff ffff8817f1a80240 ffff8817f96ec000
Jul 14 12:03:07 head kernel: ffff8817f1a81068 0000000000000007 ffff8817f1b7fc78 ffffffffa01f4ffa
Jul 14 12:03:07 head kernel: ffff8817f1b7fc98 ffffffff818adc00 ffff8817f1b7fd10 ffff8817f1a81068
Jul 14 12:03:07 head kernel: Call Trace:
Jul 14 12:03:07 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffffa01fa6e0>] nfs4_preprocess_stateid_op+0x190/0x330 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffffa01e779a>] nfsd4_write+0x8a/0x1f0 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:03:07 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:03:07 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:03:07 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:03:07 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:03:07 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:03:07 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:03:07 head kernel: Code: 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 0f b6 17 <38> ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f 1f 44 00
Jul 14 12:03:19 head kernel: NMI watchdog: BUG: soft lockup - CPU#11 stuck for 22s! [kworker/u96:2:9888]
Jul 14 12:03:19 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:03:19 head kernel: CPU: 11 PID: 9888 Comm: kworker/u96:2 Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:03:19 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:03:19 head kernel: Workqueue: nfsd4 laundromat_main [nfsd]
Jul 14 12:03:19 head kernel: task: ffff882ff208a840 ti: ffff8818ca7d0000 task.ti: ffff8818ca7d0000
Jul 14 12:03:19 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:03:19 head kernel: RSP: 0018:ffff8818ca7d3d68 EFLAGS: 00000287
Jul 14 12:03:19 head kernel: RAX: 0000000000006f05 RBX: 0000000000000000 RCX: 0000000000000022
Jul 14 12:03:19 head kernel: RDX: 000000000000001c RSI: 000000000000005a RDI: ffff8817f96ec130
Jul 14 12:03:19 head kernel: RBP: ffff8818ca7d3d68 R08: ffff8818ca7d0000 R09: 0000000000000001
Jul 14 12:03:19 head kernel: R10: ffff882ffa0c1038 R11: 00000000000ec472 R12: 0000000000000001
Jul 14 12:03:19 head kernel: R13: ffff882ff208ae40 R14: ffff88301f2b0a80 R15: ffff88301f273640
Jul 14 12:03:19 head kernel: FS: 0000000000000000(0000) GS:ffff88301f2a0000(0000) knlGS:0000000000000000
Jul 14 12:03:19 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:03:19 head kernel: CR2: 00007f951cad1000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:03:19 head kernel: Stack:
Jul 14 12:03:19 head kernel: ffff8818ca7d3df8 ffffffffa01f6680 000000000000005a ffff8817f96ec130
Jul 14 12:03:19 head kernel: ffff8817f96ec0a0 ffff8817f96ec000 ffff8818ca7d3dc8 0000000000000292
Jul 14 12:03:19 head kernel: ffff8814ae5ec0c0 ffff8818ca7d3db0 ffff8818ca7d3db0 00000000612153c8
Jul 14 12:03:19 head kernel: Call Trace:
Jul 14 12:03:19 head kernel: [<ffffffffa01f6680>] laundromat_main+0x80/0x480 [nfsd]
Jul 14 12:03:19 head kernel: [<ffffffff8108b7c5>] process_one_work+0x145/0x400
Jul 14 12:03:19 head kernel: [<ffffffff8108bd8b>] worker_thread+0x6b/0x4a0
Jul 14 12:03:19 head kernel: [<ffffffff8108bd20>] ? init_pwq.part.22+0x10/0x10
Jul 14 12:03:19 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:03:19 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:03:19 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:03:19 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:03:19 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:03:35 head kernel: NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [nfsd:537]
Jul 14 12:03:35 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:03:35 head kernel: CPU: 0 PID: 537 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:03:35 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:03:35 head kernel: task: ffff8817f8a46eb0 ti: ffff8817f1f5c000 task.ti: ffff8817f1f5c000
Jul 14 12:03:35 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:03:35 head kernel: RSP: 0018:ffff8817f1f5fcc8 EFLAGS: 00000297
Jul 14 12:03:35 head kernel: RAX: 0000000000003a3c RBX: ffff8817f96ec000 RCX: 00000000000000c1
Jul 14 12:03:35 head kernel: RDX: 00000000000000c0 RSI: 000000000000132a RDI: ffff88010e29cb40
Jul 14 12:03:35 head kernel: RBP: ffff8817f1f5fcc8 R08: ffff8817db320540 R09: ffff88010e306a00
Jul 14 12:03:35 head kernel: R10: ffff88010e29cb40 R11: ffff88010e29c800 R12: ffff882ff904e718
Jul 14 12:03:35 head kernel: R13: ffff8817f1f5fc60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:03:35 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa00000(0000) knlGS:0000000000000000
Jul 14 12:03:35 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:03:35 head kernel: CR2: 00007f23500d8000 CR3: 0000000001811000 CR4: 00000000001407f0
Jul 14 12:03:35 head kernel: Stack:
Jul 14 12:03:35 head kernel: ffff8817f1f5fd48 ffffffffa01f7fc4 ffff8817db320540 ffff88010e306a00
Jul 14 12:03:35 head kernel: ffff88010e29c800 ffff88010e29cb40 ffff88164fcf8000 ffff8817f1e41068
Jul 14 12:03:35 head kernel: 00000000818adc00 00000000f1e7181a ffff8817f1f5fdd8 ffff8817f1e41000
Jul 14 12:03:35 head kernel: Call Trace:
Jul 14 12:03:35 head kernel: [<ffffffffa01f7fc4>] nfsd4_sequence+0x334/0x610 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:03:35 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:03:35 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:03:35 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:03:35 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:03:35 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:03:35 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:03:35 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:03:35 head kernel: NMI watchdog: BUG: soft lockup - CPU#4 stuck for 22s! [nfsd:535]
Jul 14 12:03:35 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:03:35 head kernel: CPU: 4 PID: 535 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:03:35 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:03:35 head kernel: task: ffff8817f8a43250 ti: ffff8817f1d34000 task.ti: ffff8817f1d34000
Jul 14 12:03:35 head kernel: RIP: 0010:[<ffffffff81554177>] [<ffffffff81554177>] _raw_spin_lock+0x37/0x40
Jul 14 12:03:35 head kernel: RSP: 0018:ffff8817f1d37cc8 EFLAGS: 00000202
Jul 14 12:03:35 head kernel: RAX: 00000000000017fb RBX: ffffffffa0183eec RCX: 000000000000001d
Jul 14 12:03:35 head kernel: RDX: 000000000000001c RSI: 00000000000000d0 RDI: ffff8817f96ec130
Jul 14 12:03:35 head kernel: RBP: ffff8817f1d37cc8 R08: ffff8817dfc3e840 R09: ffff8817fab11000
Jul 14 12:03:35 head kernel: R10: 0000000000000004 R11: ffff8817fab13080 R12: ffff882ff904e718
Jul 14 12:03:35 head kernel: R13: ffff8817f1d37c60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:03:35 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa40000(0000) knlGS:0000000000000000
Jul 14 12:03:35 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:03:35 head kernel: CR2: 00007f216c0e2000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:03:35 head kernel: Stack:
Jul 14 12:03:35 head kernel: ffff8817f1d37d48 ffffffffa01f7d76 0000000015de9b97 000000006f7b8096
Jul 14 12:03:35 head kernel: ffff8817f1d37d38 ffff8817f5302000 ffff8817dfc3e840 ffff8817fab11068
Jul 14 12:03:35 head kernel: ffffffff818adc00 000000006f7b8096 ffff8817fa590000 ffff8817fab11000
Jul 14 12:03:35 head kernel: Call Trace:
Jul 14 12:03:35 head kernel: [<ffffffffa01f7d76>] nfsd4_sequence+0xe6/0x610 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:03:35 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:03:35 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:03:35 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:03:35 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:03:35 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:03:35 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:03:35 head kernel: Code: 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 <0f> b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f
Jul 14 12:03:35 head kernel: NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [nfsd:539]
Jul 14 12:03:35 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:03:35 head kernel: CPU: 6 PID: 539 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:03:35 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:03:35 head kernel: task: ffff8817f8a45a90 ti: ffff8817f195c000 task.ti: ffff8817f195c000
Jul 14 12:03:35 head kernel: RIP: 0010:[<ffffffff81554177>] [<ffffffff81554177>] _raw_spin_lock+0x37/0x40
Jul 14 12:03:35 head kernel: RSP: 0018:ffff8817f195fbc8 EFLAGS: 00000206
Jul 14 12:03:35 head kernel: RAX: 00000000000078c6 RBX: ffff8801178cc900 RCX: 000000000000001e
Jul 14 12:03:35 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:03:35 head kernel: RBP: ffff8817f195fbc8 R08: 0000000000000000 R09: ffff8817f96ec000
Jul 14 12:03:35 head kernel: R10: ffff8817f96ec000 R11: ffff8817f1e44220 R12: ffffffff8124f74c
Jul 14 12:03:35 head kernel: R13: ffff8817f195fc98 R14: ffff8814ec9b3380 R15: ffff8817f8bc1ce0
Jul 14 12:03:35 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa60000(0000) knlGS:0000000000000000
Jul 14 12:03:35 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:03:35 head kernel: CR2: 00007f23380df000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:03:35 head kernel: Stack:
Jul 14 12:03:35 head kernel: ffff8817f195fbf8 ffffffffa01f4eff ffff8817f1e44244 ffff8817f96ec000
Jul 14 12:03:35 head kernel: ffff8817f1e45068 0000000000000009 ffff8817f195fc38 ffffffffa01f4ffa
Jul 14 12:03:35 head kernel: ffff8817f1f62000 0000000000000009 ffff8817f1e44244 ffff8817f195fcd0
Jul 14 12:03:35 head kernel: Call Trace:
Jul 14 12:03:35 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffffa01f6440>] nfs4_preprocess_seqid_op+0x60/0x1a0 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffffa01dee82>] ? rqst_exp_find+0x92/0x190 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffffa01fb0ee>] nfsd4_close+0x9e/0x380 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:03:35 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:03:35 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:03:35 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:03:35 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:03:35 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:03:35 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:03:35 head kernel: Code: 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 <0f> b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f
Jul 14 12:03:35 head kernel: NMI watchdog: BUG: soft lockup - CPU#8 stuck for 22s! [nfsd:538]
Jul 14 12:03:35 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:03:35 head kernel: CPU: 8 PID: 538 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:03:35 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:03:35 head kernel: task: ffff8817f8a464a0 ti: ffff8817f1860000 task.ti: ffff8817f1860000
Jul 14 12:03:35 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:03:35 head kernel: RSP: 0018:ffff8817f1863c08 EFLAGS: 00000293
Jul 14 12:03:35 head kernel: RAX: 0000000000003f65 RBX: 0000000000000246 RCX: 000000000000001f
Jul 14 12:03:35 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:03:35 head kernel: RBP: ffff8817f1863c08 R08: 0000000000000000 R09: 0000000000000000
Jul 14 12:03:35 head kernel: R10: 0000000000000400 R11: ffff8817f1e42220 R12: ffff882ff7b80de0
Jul 14 12:03:35 head kernel: R13: ffff8817f8b44480 R14: 00000000888ab88f R15: ffff8817f95c1f00
Jul 14 12:03:35 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa80000(0000) knlGS:0000000000000000
Jul 14 12:03:35 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:03:35 head kernel: CR2: 00007f23480ce000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:03:35 head kernel: Stack:
Jul 14 12:03:35 head kernel: ffff8817f1863c38 ffffffffa01f4eff ffff8817f1e42240 ffff8817f96ec000
Jul 14 12:03:35 head kernel: ffff8817f1e43068 0000000000000007 ffff8817f1863c78 ffffffffa01f4ffa
Jul 14 12:03:35 head kernel: ffff8817f1863c98 ffffffff818adc00 ffff8817f1863d10 ffff8817f1e43068
Jul 14 12:03:35 head kernel: Call Trace:
Jul 14 12:03:35 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffffa01fa6e0>] nfs4_preprocess_stateid_op+0x190/0x330 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffffa01e779a>] nfsd4_write+0x8a/0x1f0 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:03:35 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:03:35 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:03:35 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:03:35 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:03:35 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:03:35 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:03:35 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:03:35 head kernel: NMI watchdog: BUG: soft lockup - CPU#10 stuck for 22s! [nfsd:540]
Jul 14 12:03:35 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:03:35 head kernel: CPU: 10 PID: 540 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:03:35 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:03:35 head kernel: task: ffff8817f8a45080 ti: ffff8817f1a78000 task.ti: ffff8817f1a78000
Jul 14 12:03:35 head kernel: RIP: 0010:[<ffffffff81554177>] [<ffffffff81554177>] _raw_spin_lock+0x37/0x40
Jul 14 12:03:35 head kernel: RSP: 0018:ffff8817f1a7bcc8 EFLAGS: 00000206
Jul 14 12:03:35 head kernel: RAX: 0000000000006990 RBX: ffffffffa0183eec RCX: 0000000000000020
Jul 14 12:03:35 head kernel: RDX: 000000000000001c RSI: 00000000000000d0 RDI: ffff8817f96ec130
Jul 14 12:03:35 head kernel: RBP: ffff8817f1a7bcc8 R08: ffff881792d83840 R09: ffff8817f1e47000
Jul 14 12:03:35 head kernel: R10: 0000000000000004 R11: ffff8817f1e46080 R12: ffff882ff904e718
Jul 14 12:03:35 head kernel: R13: ffff8817f1a7bc60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:03:35 head kernel: FS: 0000000000000000(0000) GS:ffff88181faa0000(0000) knlGS:0000000000000000
Jul 14 12:03:35 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:03:35 head kernel: CR2: 00007f22ec0c6000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:03:35 head kernel: Stack:
Jul 14 12:03:35 head kernel: ffff8817f1a7bd48 ffffffffa01f7d76 0000000015de9b97 00000000b16b0475
Jul 14 12:03:35 head kernel: ffff8817f1a7bd38 ffff8817f1f64000 ffff881792d83840 ffff8817f1e47068
Jul 14 12:03:35 head kernel: ffffffff818adc00 00000000b16b0475 ffff8817f1a7bdd8 ffff8817f1e47000
Jul 14 12:03:35 head kernel: Call Trace:
Jul 14 12:03:35 head kernel: [<ffffffffa01f7d76>] nfsd4_sequence+0xe6/0x610 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:03:35 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:03:35 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:03:35 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:03:35 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:03:35 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:03:35 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:03:35 head kernel: Code: 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 <0f> b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f
Jul 14 12:03:35 head kernel: NMI watchdog: BUG: soft lockup - CPU#14 stuck for 22s! [nfsd:541]
Jul 14 12:03:35 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:03:35 head kernel: CPU: 14 PID: 541 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:03:35 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:03:35 head kernel: task: ffff8817f1b80000 ti: ffff8817f1b7c000 task.ti: ffff8817f1b7c000
Jul 14 12:03:35 head kernel: RIP: 0010:[<ffffffff8155417a>] [<ffffffff8155417a>] _raw_spin_lock+0x3a/0x40
Jul 14 12:03:35 head kernel: RSP: 0018:ffff8817f1b7fc08 EFLAGS: 00000206
Jul 14 12:03:35 head kernel: RAX: 0000000000005505 RBX: 0000000000000246 RCX: 0000000000000021
Jul 14 12:03:35 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:03:35 head kernel: RBP: ffff8817f1b7fc08 R08: 0000000000000000 R09: 0000000000000000
Jul 14 12:03:35 head kernel: R10: 0000000000000400 R11: ffff8817f1a80220 R12: ffff882ff7b80de0
Jul 14 12:03:35 head kernel: R13: ffff8817f8b44480 R14: 0000000060a0f8c6 R15: ffff8817f95c1f00
Jul 14 12:03:35 head kernel: FS: 0000000000000000(0000) GS:ffff88181fae0000(0000) knlGS:0000000000000000
Jul 14 12:03:35 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:03:35 head kernel: CR2: 00007f235c0d5000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:03:35 head kernel: Stack:
Jul 14 12:03:35 head kernel: ffff8817f1b7fc38 ffffffffa01f4eff ffff8817f1a80240 ffff8817f96ec000
Jul 14 12:03:35 head kernel: ffff8817f1a81068 0000000000000007 ffff8817f1b7fc78 ffffffffa01f4ffa
Jul 14 12:03:35 head kernel: ffff8817f1b7fc98 ffffffff818adc00 ffff8817f1b7fd10 ffff8817f1a81068
Jul 14 12:03:35 head kernel: Call Trace:
Jul 14 12:03:35 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffffa01fa6e0>] nfs4_preprocess_stateid_op+0x190/0x330 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffffa01e779a>] nfsd4_write+0x8a/0x1f0 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:03:35 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:03:35 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:03:35 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:03:35 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:03:35 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:03:35 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:03:35 head kernel: Code: 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 0f b6 17 <38> ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f 1f 44 00
Jul 14 12:03:41 head pbs_server[30205]: LOG_ERROR::svr_is_request, bad attempt to connect from 192.168.2.236:706 (address not trusted - check entry in server_priv/nodes)
Jul 14 12:03:43 head pbs_server[30205]: LOG_ERROR::svr_is_request, bad attempt to connect from 192.168.2.233:646 (address not trusted - check entry in server_priv/nodes)
Jul 14 12:03:47 head kernel: NMI watchdog: BUG: soft lockup - CPU#11 stuck for 22s! [kworker/u96:2:9888]
Jul 14 12:03:47 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:03:47 head kernel: CPU: 11 PID: 9888 Comm: kworker/u96:2 Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:03:47 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:03:47 head kernel: Workqueue: nfsd4 laundromat_main [nfsd]
Jul 14 12:03:47 head kernel: task: ffff882ff208a840 ti: ffff8818ca7d0000 task.ti: ffff8818ca7d0000
Jul 14 12:03:47 head kernel: RIP: 0010:[<ffffffff8155417a>] [<ffffffff8155417a>] _raw_spin_lock+0x3a/0x40
Jul 14 12:03:47 head kernel: RSP: 0018:ffff8818ca7d3d68 EFLAGS: 00000202
Jul 14 12:03:47 head kernel: RAX: 0000000000006645 RBX: 0000000000000000 RCX: 0000000000000022
Jul 14 12:03:47 head kernel: RDX: 000000000000001c RSI: 000000000000005a RDI: ffff8817f96ec130
Jul 14 12:03:47 head kernel: RBP: ffff8818ca7d3d68 R08: ffff8818ca7d0000 R09: 0000000000000001
Jul 14 12:03:47 head kernel: R10: ffff882ffa0c1038 R11: 00000000000ec472 R12: 0000000000000001
Jul 14 12:03:47 head kernel: R13: ffff882ff208ae40 R14: ffff88301f2b0a80 R15: ffff88301f273640
Jul 14 12:03:47 head kernel: FS: 0000000000000000(0000) GS:ffff88301f2a0000(0000) knlGS:0000000000000000
Jul 14 12:03:47 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:03:47 head kernel: CR2: 00007f951cad1000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:03:47 head kernel: Stack:
Jul 14 12:03:47 head kernel: ffff8818ca7d3df8 ffffffffa01f6680 000000000000005a ffff8817f96ec130
Jul 14 12:03:47 head kernel: ffff8817f96ec0a0 ffff8817f96ec000 ffff8818ca7d3dc8 0000000000000292
Jul 14 12:03:47 head kernel: ffff8814ae5ec0c0 ffff8818ca7d3db0 ffff8818ca7d3db0 00000000612153c8
Jul 14 12:03:47 head kernel: Call Trace:
Jul 14 12:03:47 head kernel: [<ffffffffa01f6680>] laundromat_main+0x80/0x480 [nfsd]
Jul 14 12:03:47 head kernel: [<ffffffff8108b7c5>] process_one_work+0x145/0x400
Jul 14 12:03:47 head kernel: [<ffffffff8108bd8b>] worker_thread+0x6b/0x4a0
Jul 14 12:03:47 head kernel: [<ffffffff8108bd20>] ? init_pwq.part.22+0x10/0x10
Jul 14 12:03:47 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:03:47 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:03:47 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:03:47 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:03:47 head kernel: Code: 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 0f b6 17 <38> ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f 1f 44 00
Jul 14 12:04:03 head kernel: NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [nfsd:537]
Jul 14 12:04:03 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:04:03 head kernel: CPU: 0 PID: 537 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:04:03 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:04:03 head kernel: task: ffff8817f8a46eb0 ti: ffff8817f1f5c000 task.ti: ffff8817f1f5c000
Jul 14 12:04:03 head kernel: RIP: 0010:[<ffffffff8155417a>] [<ffffffff8155417a>] _raw_spin_lock+0x3a/0x40
Jul 14 12:04:03 head kernel: RSP: 0018:ffff8817f1f5fcc8 EFLAGS: 00000206
Jul 14 12:04:03 head kernel: RAX: 0000000000006542 RBX: ffff8817f96ec000 RCX: 00000000000000c1
Jul 14 12:04:03 head kernel: RDX: 00000000000000c0 RSI: 000000000000132a RDI: ffff88010e29cb40
Jul 14 12:04:03 head kernel: RBP: ffff8817f1f5fcc8 R08: ffff8817db320540 R09: ffff88010e306a00
Jul 14 12:04:03 head kernel: R10: ffff88010e29cb40 R11: ffff88010e29c800 R12: ffff882ff904e718
Jul 14 12:04:03 head kernel: R13: ffff8817f1f5fc60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:04:03 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa00000(0000) knlGS:0000000000000000
Jul 14 12:04:03 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:04:03 head kernel: CR2: 00007f23500d8000 CR3: 0000000001811000 CR4: 00000000001407f0
Jul 14 12:04:03 head kernel: Stack:
Jul 14 12:04:03 head kernel: ffff8817f1f5fd48 ffffffffa01f7fc4 ffff8817db320540 ffff88010e306a00
Jul 14 12:04:03 head kernel: ffff88010e29c800 ffff88010e29cb40 ffff88164fcf8000 ffff8817f1e41068
Jul 14 12:04:03 head kernel: 00000000818adc00 00000000f1e7181a ffff8817f1f5fdd8 ffff8817f1e41000
Jul 14 12:04:03 head kernel: Call Trace:
Jul 14 12:04:03 head kernel: [<ffffffffa01f7fc4>] nfsd4_sequence+0x334/0x610 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:04:03 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:04:03 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:04:03 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:04:03 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:03 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:04:03 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:03 head kernel: Code: 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 0f b6 17 <38> ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f 1f 44 00
Jul 14 12:04:03 head kernel: NMI watchdog: BUG: soft lockup - CPU#4 stuck for 22s! [nfsd:535]
Jul 14 12:04:03 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:04:03 head kernel: CPU: 4 PID: 535 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:04:03 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:04:03 head kernel: task: ffff8817f8a43250 ti: ffff8817f1d34000 task.ti: ffff8817f1d34000
Jul 14 12:04:03 head kernel: RIP: 0010:[<ffffffff81554177>] [<ffffffff81554177>] _raw_spin_lock+0x37/0x40
Jul 14 12:04:03 head kernel: RSP: 0018:ffff8817f1d37cc8 EFLAGS: 00000202
Jul 14 12:04:03 head kernel: RAX: 0000000000003343 RBX: ffffffffa0183eec RCX: 000000000000001d
Jul 14 12:04:03 head kernel: RDX: 000000000000001c RSI: 00000000000000d0 RDI: ffff8817f96ec130
Jul 14 12:04:03 head kernel: RBP: ffff8817f1d37cc8 R08: ffff8817dfc3e840 R09: ffff8817fab11000
Jul 14 12:04:03 head kernel: R10: 0000000000000004 R11: ffff8817fab13080 R12: ffff882ff904e718
Jul 14 12:04:03 head kernel: R13: ffff8817f1d37c60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:04:03 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa40000(0000) knlGS:0000000000000000
Jul 14 12:04:03 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:04:03 head kernel: CR2: 00007f216c0e2000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:04:03 head kernel: Stack:
Jul 14 12:04:03 head kernel: ffff8817f1d37d48 ffffffffa01f7d76 0000000015de9b97 000000006f7b8096
Jul 14 12:04:03 head kernel: ffff8817f1d37d38 ffff8817f5302000 ffff8817dfc3e840 ffff8817fab11068
Jul 14 12:04:03 head kernel: ffffffff818adc00 000000006f7b8096 ffff8817fa590000 ffff8817fab11000
Jul 14 12:04:03 head kernel: Call Trace:
Jul 14 12:04:03 head kernel: [<ffffffffa01f7d76>] nfsd4_sequence+0xe6/0x610 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:04:03 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:04:03 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:04:03 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:04:03 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:03 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:04:03 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:03 head kernel: Code: 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 <0f> b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f
Jul 14 12:04:03 head kernel: NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [nfsd:539]
Jul 14 12:04:03 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:04:03 head kernel: CPU: 6 PID: 539 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:04:03 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:04:03 head kernel: task: ffff8817f8a45a90 ti: ffff8817f195c000 task.ti: ffff8817f195c000
Jul 14 12:04:03 head kernel: RIP: 0010:[<ffffffff81554177>] [<ffffffff81554177>] _raw_spin_lock+0x37/0x40
Jul 14 12:04:03 head kernel: RSP: 0018:ffff8817f195fbc8 EFLAGS: 00000202
Jul 14 12:04:03 head kernel: RAX: 0000000000006f83 RBX: ffff8801178cc900 RCX: 000000000000001e
Jul 14 12:04:03 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:04:03 head kernel: RBP: ffff8817f195fbc8 R08: 0000000000000000 R09: ffff8817f96ec000
Jul 14 12:04:03 head kernel: R10: ffff8817f96ec000 R11: ffff8817f1e44220 R12: ffffffff8124f74c
Jul 14 12:04:03 head kernel: R13: ffff8817f195fc98 R14: ffff8814ec9b3380 R15: ffff8817f8bc1ce0
Jul 14 12:04:03 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa60000(0000) knlGS:0000000000000000
Jul 14 12:04:03 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:04:03 head kernel: CR2: 00007f23380df000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:04:03 head kernel: Stack:
Jul 14 12:04:03 head kernel: ffff8817f195fbf8 ffffffffa01f4eff ffff8817f1e44244 ffff8817f96ec000
Jul 14 12:04:03 head kernel: ffff8817f1e45068 0000000000000009 ffff8817f195fc38 ffffffffa01f4ffa
Jul 14 12:04:03 head kernel: ffff8817f1f62000 0000000000000009 ffff8817f1e44244 ffff8817f195fcd0
Jul 14 12:04:03 head kernel: Call Trace:
Jul 14 12:04:03 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffffa01f6440>] nfs4_preprocess_seqid_op+0x60/0x1a0 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffffa01dee82>] ? rqst_exp_find+0x92/0x190 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffffa01fb0ee>] nfsd4_close+0x9e/0x380 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:04:03 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:04:03 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:04:03 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:04:03 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:03 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:04:03 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:03 head kernel: Code: 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 <0f> b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f
Jul 14 12:04:03 head kernel: NMI watchdog: BUG: soft lockup - CPU#8 stuck for 22s! [nfsd:538]
Jul 14 12:04:03 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:04:03 head kernel: CPU: 8 PID: 538 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:04:03 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:04:03 head kernel: task: ffff8817f8a464a0 ti: ffff8817f1860000 task.ti: ffff8817f1860000
Jul 14 12:04:03 head kernel: RIP: 0010:[<ffffffff8155417a>] [<ffffffff8155417a>] _raw_spin_lock+0x3a/0x40
Jul 14 12:04:03 head kernel: RSP: 0018:ffff8817f1863c08 EFLAGS: 00000202
Jul 14 12:04:03 head kernel: RAX: 0000000000002a0b RBX: 0000000000000246 RCX: 000000000000001f
Jul 14 12:04:03 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:04:03 head kernel: RBP: ffff8817f1863c08 R08: 0000000000000000 R09: 0000000000000000
Jul 14 12:04:03 head kernel: R10: 0000000000000400 R11: ffff8817f1e42220 R12: ffff882ff7b80de0
Jul 14 12:04:03 head kernel: R13: ffff8817f8b44480 R14: 00000000888ab88f R15: ffff8817f95c1f00
Jul 14 12:04:03 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa80000(0000) knlGS:0000000000000000
Jul 14 12:04:03 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:04:03 head kernel: CR2: 00007f23480ce000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:04:03 head kernel: Stack:
Jul 14 12:04:03 head kernel: ffff8817f1863c38 ffffffffa01f4eff ffff8817f1e42240 ffff8817f96ec000
Jul 14 12:04:03 head kernel: ffff8817f1e43068 0000000000000007 ffff8817f1863c78 ffffffffa01f4ffa
Jul 14 12:04:03 head kernel: ffff8817f1863c98 ffffffff818adc00 ffff8817f1863d10 ffff8817f1e43068
Jul 14 12:04:03 head kernel: Call Trace:
Jul 14 12:04:03 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffffa01fa6e0>] nfs4_preprocess_stateid_op+0x190/0x330 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffffa01e779a>] nfsd4_write+0x8a/0x1f0 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:04:03 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:04:03 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:04:03 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:04:03 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:03 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:04:03 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:03 head kernel: Code: 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 0f b6 17 <38> ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f 1f 44 00
Jul 14 12:04:03 head kernel: NMI watchdog: BUG: soft lockup - CPU#10 stuck for 22s! [nfsd:540]
Jul 14 12:04:03 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:04:03 head kernel: CPU: 10 PID: 540 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:04:03 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:04:03 head kernel: task: ffff8817f8a45080 ti: ffff8817f1a78000 task.ti: ffff8817f1a78000
Jul 14 12:04:03 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:04:03 head kernel: RSP: 0018:ffff8817f1a7bcc8 EFLAGS: 00000287
Jul 14 12:04:03 head kernel: RAX: 0000000000000efa RBX: ffffffffa0183eec RCX: 0000000000000020
Jul 14 12:04:03 head kernel: RDX: 000000000000001c RSI: 00000000000000d0 RDI: ffff8817f96ec130
Jul 14 12:04:03 head kernel: RBP: ffff8817f1a7bcc8 R08: ffff881792d83840 R09: ffff8817f1e47000
Jul 14 12:04:03 head kernel: R10: 0000000000000004 R11: ffff8817f1e46080 R12: ffff882ff904e718
Jul 14 12:04:03 head kernel: R13: ffff8817f1a7bc60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:04:03 head kernel: FS: 0000000000000000(0000) GS:ffff88181faa0000(0000) knlGS:0000000000000000
Jul 14 12:04:03 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:04:03 head kernel: CR2: 00007f22ec0c6000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:04:03 head kernel: Stack:
Jul 14 12:04:03 head kernel: ffff8817f1a7bd48 ffffffffa01f7d76 0000000015de9b97 00000000b16b0475
Jul 14 12:04:03 head kernel: ffff8817f1a7bd38 ffff8817f1f64000 ffff881792d83840 ffff8817f1e47068
Jul 14 12:04:03 head kernel: ffffffff818adc00 00000000b16b0475 ffff8817f1a7bdd8 ffff8817f1e47000
Jul 14 12:04:03 head kernel: Call Trace:
Jul 14 12:04:03 head kernel: [<ffffffffa01f7d76>] nfsd4_sequence+0xe6/0x610 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:04:03 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:04:03 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:04:03 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:04:03 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:03 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:04:03 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:03 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:04:03 head kernel: NMI watchdog: BUG: soft lockup - CPU#14 stuck for 22s! [nfsd:541]
Jul 14 12:04:03 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:04:03 head kernel: CPU: 14 PID: 541 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:04:03 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:04:03 head kernel: task: ffff8817f1b80000 ti: ffff8817f1b7c000 task.ti: ffff8817f1b7c000
Jul 14 12:04:03 head kernel: RIP: 0010:[<ffffffff81554170>] [<ffffffff81554170>] _raw_spin_lock+0x30/0x40
Jul 14 12:04:03 head kernel: RSP: 0018:ffff8817f1b7fc08 EFLAGS: 00000283
Jul 14 12:04:03 head kernel: RAX: 000000000000247c RBX: 0000000000000246 RCX: 0000000000000021
Jul 14 12:04:03 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:04:03 head kernel: RBP: ffff8817f1b7fc08 R08: 0000000000000000 R09: 0000000000000000
Jul 14 12:04:03 head kernel: R10: 0000000000000400 R11: ffff8817f1a80220 R12: ffff882ff7b80de0
Jul 14 12:04:03 head kernel: R13: ffff8817f8b44480 R14: 0000000060a0f8c6 R15: ffff8817f95c1f00
Jul 14 12:04:03 head kernel: FS: 0000000000000000(0000) GS:ffff88181fae0000(0000) knlGS:0000000000000000
Jul 14 12:04:03 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:04:03 head kernel: CR2: 00007f235c0d5000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:04:03 head kernel: Stack:
Jul 14 12:04:03 head kernel: ffff8817f1b7fc38 ffffffffa01f4eff ffff8817f1a80240 ffff8817f96ec000
Jul 14 12:04:03 head kernel: ffff8817f1a81068 0000000000000007 ffff8817f1b7fc78 ffffffffa01f4ffa
Jul 14 12:04:03 head kernel: ffff8817f1b7fc98 ffffffff818adc00 ffff8817f1b7fd10 ffff8817f1a81068
Jul 14 12:04:03 head kernel: Call Trace:
Jul 14 12:04:03 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffffa01fa6e0>] nfs4_preprocess_stateid_op+0x190/0x330 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffffa01e779a>] nfsd4_write+0x8a/0x1f0 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:04:03 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:04:03 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:04:03 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:04:03 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:03 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:04:03 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:03 head kernel: Code: 55 65 ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 <f3> 90 83 e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00
Jul 14 12:04:15 head kernel: NMI watchdog: BUG: soft lockup - CPU#11 stuck for 22s! [kworker/u96:2:9888]
Jul 14 12:04:15 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:04:15 head kernel: CPU: 11 PID: 9888 Comm: kworker/u96:2 Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:04:15 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:04:15 head kernel: Workqueue: nfsd4 laundromat_main [nfsd]
Jul 14 12:04:15 head kernel: task: ffff882ff208a840 ti: ffff8818ca7d0000 task.ti: ffff8818ca7d0000
Jul 14 12:04:15 head kernel: RIP: 0010:[<ffffffff81554177>] [<ffffffff81554177>] _raw_spin_lock+0x37/0x40
Jul 14 12:04:15 head kernel: RSP: 0018:ffff8818ca7d3d68 EFLAGS: 00000202
Jul 14 12:04:15 head kernel: RAX: 00000000000078a2 RBX: 0000000000000000 RCX: 0000000000000022
Jul 14 12:04:15 head kernel: RDX: 000000000000001c RSI: 000000000000005a RDI: ffff8817f96ec130
Jul 14 12:04:15 head kernel: RBP: ffff8818ca7d3d68 R08: ffff8818ca7d0000 R09: 0000000000000001
Jul 14 12:04:15 head kernel: R10: ffff882ffa0c1038 R11: 00000000000ec472 R12: 0000000000000001
Jul 14 12:04:15 head kernel: R13: ffff882ff208ae40 R14: ffff88301f2b0a80 R15: ffff88301f273640
Jul 14 12:04:15 head kernel: FS: 0000000000000000(0000) GS:ffff88301f2a0000(0000) knlGS:0000000000000000
Jul 14 12:04:15 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:04:15 head kernel: CR2: 00007f951cad1000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:04:15 head kernel: Stack:
Jul 14 12:04:15 head kernel: ffff8818ca7d3df8 ffffffffa01f6680 000000000000005a ffff8817f96ec130
Jul 14 12:04:15 head kernel: ffff8817f96ec0a0 ffff8817f96ec000 ffff8818ca7d3dc8 0000000000000292
Jul 14 12:04:15 head kernel: ffff8814ae5ec0c0 ffff8818ca7d3db0 ffff8818ca7d3db0 00000000612153c8
Jul 14 12:04:15 head kernel: Call Trace:
Jul 14 12:04:15 head kernel: [<ffffffffa01f6680>] laundromat_main+0x80/0x480 [nfsd]
Jul 14 12:04:15 head kernel: [<ffffffff8108b7c5>] process_one_work+0x145/0x400
Jul 14 12:04:15 head kernel: [<ffffffff8108bd8b>] worker_thread+0x6b/0x4a0
Jul 14 12:04:15 head kernel: [<ffffffff8108bd20>] ? init_pwq.part.22+0x10/0x10
Jul 14 12:04:15 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:04:15 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:15 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:04:15 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:15 head kernel: Code: 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 <0f> b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f
Jul 14 12:04:26 head pbs_server[30205]: LOG_ERROR::svr_is_request, bad attempt to connect from 192.168.2.236:706 (address not trusted - check entry in server_priv/nodes)
Jul 14 12:04:28 head pbs_server[30205]: LOG_ERROR::svr_is_request, bad attempt to connect from 192.168.2.233:646 (address not trusted - check entry in server_priv/nodes)
Jul 14 12:04:31 head kernel: NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [nfsd:537]
Jul 14 12:04:31 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:04:31 head kernel: CPU: 0 PID: 537 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:04:31 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:04:31 head kernel: task: ffff8817f8a46eb0 ti: ffff8817f1f5c000 task.ti: ffff8817f1f5c000
Jul 14 12:04:31 head kernel: RIP: 0010:[<ffffffff8155417a>] [<ffffffff8155417a>] _raw_spin_lock+0x3a/0x40
Jul 14 12:04:31 head kernel: RSP: 0018:ffff8817f1f5fcc8 EFLAGS: 00000202
Jul 14 12:04:31 head kernel: RAX: 000000000000140b RBX: ffff8817f96ec000 RCX: 00000000000000c1
Jul 14 12:04:31 head kernel: RDX: 00000000000000c0 RSI: 000000000000132a RDI: ffff88010e29cb40
Jul 14 12:04:31 head kernel: RBP: ffff8817f1f5fcc8 R08: ffff8817db320540 R09: ffff88010e306a00
Jul 14 12:04:31 head kernel: R10: ffff88010e29cb40 R11: ffff88010e29c800 R12: ffff882ff904e718
Jul 14 12:04:31 head kernel: R13: ffff8817f1f5fc60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:04:31 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa00000(0000) knlGS:0000000000000000
Jul 14 12:04:31 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:04:31 head kernel: CR2: 00007f23500d8000 CR3: 0000000001811000 CR4: 00000000001407f0
Jul 14 12:04:31 head kernel: Stack:
Jul 14 12:04:31 head kernel: ffff8817f1f5fd48 ffffffffa01f7fc4 ffff8817db320540 ffff88010e306a00
Jul 14 12:04:31 head kernel: ffff88010e29c800 ffff88010e29cb40 ffff88164fcf8000 ffff8817f1e41068
Jul 14 12:04:31 head kernel: 00000000818adc00 00000000f1e7181a ffff8817f1f5fdd8 ffff8817f1e41000
Jul 14 12:04:31 head kernel: Call Trace:
Jul 14 12:04:31 head kernel: [<ffffffffa01f7fc4>] nfsd4_sequence+0x334/0x610 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:04:31 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:04:31 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:04:31 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:04:31 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:31 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:04:31 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:31 head kernel: Code: 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 0f b6 17 <38> ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f 1f 44 00
Jul 14 12:04:31 head kernel: NMI watchdog: BUG: soft lockup - CPU#4 stuck for 22s! [nfsd:535]
Jul 14 12:04:31 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:04:31 head kernel: CPU: 4 PID: 535 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:04:31 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:04:31 head kernel: task: ffff8817f8a43250 ti: ffff8817f1d34000 task.ti: ffff8817f1d34000
Jul 14 12:04:31 head kernel: RIP: 0010:[<ffffffff8155417a>] [<ffffffff8155417a>] _raw_spin_lock+0x3a/0x40
Jul 14 12:04:31 head kernel: RSP: 0018:ffff8817f1d37cc8 EFLAGS: 00000216
Jul 14 12:04:31 head kernel: RAX: 0000000000007b6f RBX: ffffffffa0183eec RCX: 000000000000001d
Jul 14 12:04:31 head kernel: RDX: 000000000000001c RSI: 00000000000000d0 RDI: ffff8817f96ec130
Jul 14 12:04:31 head kernel: RBP: ffff8817f1d37cc8 R08: ffff8817dfc3e840 R09: ffff8817fab11000
Jul 14 12:04:31 head kernel: R10: 0000000000000004 R11: ffff8817fab13080 R12: ffff882ff904e718
Jul 14 12:04:31 head kernel: R13: ffff8817f1d37c60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:04:31 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa40000(0000) knlGS:0000000000000000
Jul 14 12:04:31 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:04:31 head kernel: CR2: 00007f216c0e2000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:04:31 head kernel: Stack:
Jul 14 12:04:31 head kernel: ffff8817f1d37d48 ffffffffa01f7d76 0000000015de9b97 000000006f7b8096
Jul 14 12:04:31 head kernel: ffff8817f1d37d38 ffff8817f5302000 ffff8817dfc3e840 ffff8817fab11068
Jul 14 12:04:31 head kernel: ffffffff818adc00 000000006f7b8096 ffff8817fa590000 ffff8817fab11000
Jul 14 12:04:31 head kernel: Call Trace:
Jul 14 12:04:31 head kernel: [<ffffffffa01f7d76>] nfsd4_sequence+0xe6/0x610 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:04:31 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:04:31 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:04:31 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:04:31 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:31 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:04:31 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:31 head kernel: Code: 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 0f b6 17 <38> ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f 1f 44 00
Jul 14 12:04:31 head kernel: NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [nfsd:539]
Jul 14 12:04:31 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:04:31 head kernel: CPU: 6 PID: 539 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:04:31 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:04:31 head kernel: task: ffff8817f8a45a90 ti: ffff8817f195c000 task.ti: ffff8817f195c000
Jul 14 12:04:31 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:04:31 head kernel: RSP: 0018:ffff8817f195fbc8 EFLAGS: 00000293
Jul 14 12:04:31 head kernel: RAX: 00000000000032f0 RBX: ffff8801178cc900 RCX: 000000000000001e
Jul 14 12:04:31 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:04:31 head kernel: RBP: ffff8817f195fbc8 R08: 0000000000000000 R09: ffff8817f96ec000
Jul 14 12:04:31 head kernel: R10: ffff8817f96ec000 R11: ffff8817f1e44220 R12: ffffffff8124f74c
Jul 14 12:04:31 head kernel: R13: ffff8817f195fc98 R14: ffff8814ec9b3380 R15: ffff8817f8bc1ce0
Jul 14 12:04:31 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa60000(0000) knlGS:0000000000000000
Jul 14 12:04:31 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:04:31 head kernel: CR2: 00007f23380df000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:04:31 head kernel: Stack:
Jul 14 12:04:31 head kernel: ffff8817f195fbf8 ffffffffa01f4eff ffff8817f1e44244 ffff8817f96ec000
Jul 14 12:04:31 head kernel: ffff8817f1e45068 0000000000000009 ffff8817f195fc38 ffffffffa01f4ffa
Jul 14 12:04:31 head kernel: ffff8817f1f62000 0000000000000009 ffff8817f1e44244 ffff8817f195fcd0
Jul 14 12:04:31 head kernel: Call Trace:
Jul 14 12:04:31 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffffa01f6440>] nfs4_preprocess_seqid_op+0x60/0x1a0 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffffa01dee82>] ? rqst_exp_find+0x92/0x190 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffffa01fb0ee>] nfsd4_close+0x9e/0x380 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:04:31 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:04:31 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:04:31 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:04:31 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:31 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:04:31 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:31 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:04:31 head kernel: NMI watchdog: BUG: soft lockup - CPU#8 stuck for 22s! [nfsd:538]
Jul 14 12:04:31 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:04:31 head kernel: CPU: 8 PID: 538 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:04:31 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:04:31 head kernel: task: ffff8817f8a464a0 ti: ffff8817f1860000 task.ti: ffff8817f1860000
Jul 14 12:04:31 head kernel: RIP: 0010:[<ffffffff8155417a>] [<ffffffff8155417a>] _raw_spin_lock+0x3a/0x40
Jul 14 12:04:31 head kernel: RSP: 0018:ffff8817f1863c08 EFLAGS: 00000202
Jul 14 12:04:31 head kernel: RAX: 0000000000006434 RBX: 0000000000000246 RCX: 000000000000001f
Jul 14 12:04:31 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:04:31 head kernel: RBP: ffff8817f1863c08 R08: 0000000000000000 R09: 0000000000000000
Jul 14 12:04:31 head kernel: R10: 0000000000000400 R11: ffff8817f1e42220 R12: ffff882ff7b80de0
Jul 14 12:04:31 head kernel: R13: ffff8817f8b44480 R14: 00000000888ab88f R15: ffff8817f95c1f00
Jul 14 12:04:31 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa80000(0000) knlGS:0000000000000000
Jul 14 12:04:31 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:04:31 head kernel: CR2: 00007f23480ce000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:04:31 head kernel: Stack:
Jul 14 12:04:31 head kernel: ffff8817f1863c38 ffffffffa01f4eff ffff8817f1e42240 ffff8817f96ec000
Jul 14 12:04:31 head kernel: ffff8817f1e43068 0000000000000007 ffff8817f1863c78 ffffffffa01f4ffa
Jul 14 12:04:31 head kernel: ffff8817f1863c98 ffffffff818adc00 ffff8817f1863d10 ffff8817f1e43068
Jul 14 12:04:31 head kernel: Call Trace:
Jul 14 12:04:31 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffffa01fa6e0>] nfs4_preprocess_stateid_op+0x190/0x330 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffffa01e779a>] nfsd4_write+0x8a/0x1f0 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:04:31 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:04:31 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:04:31 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:04:31 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:31 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:04:31 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:31 head kernel: Code: 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 0f b6 17 <38> ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f 1f 44 00
Jul 14 12:04:31 head kernel: NMI watchdog: BUG: soft lockup - CPU#10 stuck for 22s! [nfsd:540]
Jul 14 12:04:31 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:04:31 head kernel: CPU: 10 PID: 540 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:04:31 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:04:31 head kernel: task: ffff8817f8a45080 ti: ffff8817f1a78000 task.ti: ffff8817f1a78000
Jul 14 12:04:31 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:04:31 head kernel: RSP: 0018:ffff8817f1a7bcc8 EFLAGS: 00000287
Jul 14 12:04:31 head kernel: RAX: 00000000000010e0 RBX: ffffffffa0183eec RCX: 0000000000000020
Jul 14 12:04:31 head kernel: RDX: 000000000000001c RSI: 00000000000000d0 RDI: ffff8817f96ec130
Jul 14 12:04:31 head kernel: RBP: ffff8817f1a7bcc8 R08: ffff881792d83840 R09: ffff8817f1e47000
Jul 14 12:04:31 head kernel: R10: 0000000000000004 R11: ffff8817f1e46080 R12: ffff882ff904e718
Jul 14 12:04:31 head kernel: R13: ffff8817f1a7bc60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:04:31 head kernel: FS: 0000000000000000(0000) GS:ffff88181faa0000(0000) knlGS:0000000000000000
Jul 14 12:04:31 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:04:31 head kernel: CR2: 00007f22ec0c6000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:04:31 head kernel: Stack:
Jul 14 12:04:31 head kernel: ffff8817f1a7bd48 ffffffffa01f7d76 0000000015de9b97 00000000b16b0475
Jul 14 12:04:31 head kernel: ffff8817f1a7bd38 ffff8817f1f64000 ffff881792d83840 ffff8817f1e47068
Jul 14 12:04:31 head kernel: ffffffff818adc00 00000000b16b0475 ffff8817f1a7bdd8 ffff8817f1e47000
Jul 14 12:04:31 head kernel: Call Trace:
Jul 14 12:04:31 head kernel: [<ffffffffa01f7d76>] nfsd4_sequence+0xe6/0x610 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:04:31 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:04:31 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:04:31 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:04:31 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:31 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:04:31 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:31 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:04:31 head kernel: NMI watchdog: BUG: soft lockup - CPU#14 stuck for 22s! [nfsd:541]
Jul 14 12:04:31 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:04:31 head kernel: CPU: 14 PID: 541 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:04:31 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:04:31 head kernel: task: ffff8817f1b80000 ti: ffff8817f1b7c000 task.ti: ffff8817f1b7c000
Jul 14 12:04:31 head kernel: RIP: 0010:[<ffffffff81554170>] [<ffffffff81554170>] _raw_spin_lock+0x30/0x40
Jul 14 12:04:31 head kernel: RSP: 0018:ffff8817f1b7fc08 EFLAGS: 00000283
Jul 14 12:04:31 head kernel: RAX: 0000000000007ac0 RBX: 0000000000000246 RCX: 0000000000000021
Jul 14 12:04:31 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:04:31 head kernel: RBP: ffff8817f1b7fc08 R08: 0000000000000000 R09: 0000000000000000
Jul 14 12:04:31 head kernel: R10: 0000000000000400 R11: ffff8817f1a80220 R12: ffff882ff7b80de0
Jul 14 12:04:31 head kernel: R13: ffff8817f8b44480 R14: 0000000060a0f8c6 R15: ffff8817f95c1f00
Jul 14 12:04:31 head kernel: FS: 0000000000000000(0000) GS:ffff88181fae0000(0000) knlGS:0000000000000000
Jul 14 12:04:31 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:04:31 head kernel: CR2: 00007f235c0d5000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:04:31 head kernel: Stack:
Jul 14 12:04:31 head kernel: ffff8817f1b7fc38 ffffffffa01f4eff ffff8817f1a80240 ffff8817f96ec000
Jul 14 12:04:31 head kernel: ffff8817f1a81068 0000000000000007 ffff8817f1b7fc78 ffffffffa01f4ffa
Jul 14 12:04:31 head kernel: ffff8817f1b7fc98 ffffffff818adc00 ffff8817f1b7fd10 ffff8817f1a81068
Jul 14 12:04:31 head kernel: Call Trace:
Jul 14 12:04:31 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffffa01fa6e0>] nfs4_preprocess_stateid_op+0x190/0x330 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffffa01e779a>] nfsd4_write+0x8a/0x1f0 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:04:31 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:04:31 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:04:31 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:04:31 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:31 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:04:31 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:31 head kernel: Code: 55 65 ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 <f3> 90 83 e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00
Jul 14 12:04:43 head kernel: NMI watchdog: BUG: soft lockup - CPU#11 stuck for 22s! [kworker/u96:2:9888]
Jul 14 12:04:43 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:04:43 head kernel: CPU: 11 PID: 9888 Comm: kworker/u96:2 Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:04:43 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:04:43 head kernel: Workqueue: nfsd4 laundromat_main [nfsd]
Jul 14 12:04:43 head kernel: task: ffff882ff208a840 ti: ffff8818ca7d0000 task.ti: ffff8818ca7d0000
Jul 14 12:04:43 head kernel: RIP: 0010:[<ffffffff81554177>] [<ffffffff81554177>] _raw_spin_lock+0x37/0x40
Jul 14 12:04:43 head kernel: RSP: 0018:ffff8818ca7d3d68 EFLAGS: 00000206
Jul 14 12:04:43 head kernel: RAX: 0000000000007ddd RBX: 0000000000000000 RCX: 0000000000000022
Jul 14 12:04:43 head kernel: RDX: 000000000000001c RSI: 000000000000005a RDI: ffff8817f96ec130
Jul 14 12:04:43 head kernel: RBP: ffff8818ca7d3d68 R08: ffff8818ca7d0000 R09: 0000000000000001
Jul 14 12:04:43 head kernel: R10: ffff882ffa0c1038 R11: 00000000000ec472 R12: 0000000000000001
Jul 14 12:04:43 head kernel: R13: ffff882ff208ae40 R14: ffff88301f2b0a80 R15: ffff88301f273640
Jul 14 12:04:43 head kernel: FS: 0000000000000000(0000) GS:ffff88301f2a0000(0000) knlGS:0000000000000000
Jul 14 12:04:43 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:04:43 head kernel: CR2: 00007f951cad1000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:04:43 head kernel: Stack:
Jul 14 12:04:43 head kernel: ffff8818ca7d3df8 ffffffffa01f6680 000000000000005a ffff8817f96ec130
Jul 14 12:04:43 head kernel: ffff8817f96ec0a0 ffff8817f96ec000 ffff8818ca7d3dc8 0000000000000292
Jul 14 12:04:43 head kernel: ffff8814ae5ec0c0 ffff8818ca7d3db0 ffff8818ca7d3db0 00000000612153c8
Jul 14 12:04:43 head kernel: Call Trace:
Jul 14 12:04:43 head kernel: [<ffffffffa01f6680>] laundromat_main+0x80/0x480 [nfsd]
Jul 14 12:04:43 head kernel: [<ffffffff8108b7c5>] process_one_work+0x145/0x400
Jul 14 12:04:43 head kernel: [<ffffffff8108bd8b>] worker_thread+0x6b/0x4a0
Jul 14 12:04:43 head kernel: [<ffffffff8108bd20>] ? init_pwq.part.22+0x10/0x10
Jul 14 12:04:43 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:04:43 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:43 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:04:43 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:43 head kernel: Code: 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 <0f> b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f
Jul 14 12:04:59 head kernel: NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [nfsd:537]
Jul 14 12:04:59 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:04:59 head kernel: CPU: 0 PID: 537 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:04:59 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:04:59 head kernel: task: ffff8817f8a46eb0 ti: ffff8817f1f5c000 task.ti: ffff8817f1f5c000
Jul 14 12:04:59 head kernel: RIP: 0010:[<ffffffff8155417a>] [<ffffffff8155417a>] _raw_spin_lock+0x3a/0x40
Jul 14 12:04:59 head kernel: RSP: 0018:ffff8817f1f5fcc8 EFLAGS: 00000206
Jul 14 12:04:59 head kernel: RAX: 0000000000000f11 RBX: ffff8817f96ec000 RCX: 00000000000000c1
Jul 14 12:04:59 head kernel: RDX: 00000000000000c0 RSI: 000000000000132a RDI: ffff88010e29cb40
Jul 14 12:04:59 head kernel: RBP: ffff8817f1f5fcc8 R08: ffff8817db320540 R09: ffff88010e306a00
Jul 14 12:04:59 head kernel: R10: ffff88010e29cb40 R11: ffff88010e29c800 R12: ffff882ff904e718
Jul 14 12:04:59 head kernel: R13: ffff8817f1f5fc60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:04:59 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa00000(0000) knlGS:0000000000000000
Jul 14 12:04:59 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:04:59 head kernel: CR2: 00007f23500d8000 CR3: 0000000001811000 CR4: 00000000001407f0
Jul 14 12:04:59 head kernel: Stack:
Jul 14 12:04:59 head kernel: ffff8817f1f5fd48 ffffffffa01f7fc4 ffff8817db320540 ffff88010e306a00
Jul 14 12:04:59 head kernel: ffff88010e29c800 ffff88010e29cb40 ffff88164fcf8000 ffff8817f1e41068
Jul 14 12:04:59 head kernel: 00000000818adc00 00000000f1e7181a ffff8817f1f5fdd8 ffff8817f1e41000
Jul 14 12:04:59 head kernel: Call Trace:
Jul 14 12:04:59 head kernel: [<ffffffffa01f7fc4>] nfsd4_sequence+0x334/0x610 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:04:59 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:04:59 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:04:59 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:04:59 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:59 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:04:59 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:59 head kernel: Code: 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 0f b6 17 <38> ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f 1f 44 00
Jul 14 12:04:59 head kernel: NMI watchdog: BUG: soft lockup - CPU#4 stuck for 22s! [nfsd:535]
Jul 14 12:04:59 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:04:59 head kernel: CPU: 4 PID: 535 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:04:59 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:04:59 head kernel: task: ffff8817f8a43250 ti: ffff8817f1d34000 task.ti: ffff8817f1d34000
Jul 14 12:04:59 head kernel: RIP: 0010:[<ffffffff81554177>] [<ffffffff81554177>] _raw_spin_lock+0x37/0x40
Jul 14 12:04:59 head kernel: RSP: 0018:ffff8817f1d37cc8 EFLAGS: 00000202
Jul 14 12:04:59 head kernel: RAX: 0000000000004449 RBX: ffffffffa0183eec RCX: 000000000000001d
Jul 14 12:04:59 head kernel: RDX: 000000000000001c RSI: 00000000000000d0 RDI: ffff8817f96ec130
Jul 14 12:04:59 head kernel: RBP: ffff8817f1d37cc8 R08: ffff8817dfc3e840 R09: ffff8817fab11000
Jul 14 12:04:59 head kernel: R10: 0000000000000004 R11: ffff8817fab13080 R12: ffff882ff904e718
Jul 14 12:04:59 head kernel: R13: ffff8817f1d37c60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:04:59 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa40000(0000) knlGS:0000000000000000
Jul 14 12:04:59 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:04:59 head kernel: CR2: 00007f216c0e2000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:04:59 head kernel: Stack:
Jul 14 12:04:59 head kernel: ffff8817f1d37d48 ffffffffa01f7d76 0000000015de9b97 000000006f7b8096
Jul 14 12:04:59 head kernel: ffff8817f1d37d38 ffff8817f5302000 ffff8817dfc3e840 ffff8817fab11068
Jul 14 12:04:59 head kernel: ffffffff818adc00 000000006f7b8096 ffff8817fa590000 ffff8817fab11000
Jul 14 12:04:59 head kernel: Call Trace:
Jul 14 12:04:59 head kernel: [<ffffffffa01f7d76>] nfsd4_sequence+0xe6/0x610 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:04:59 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:04:59 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:04:59 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:04:59 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:59 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:04:59 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:59 head kernel: Code: 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 <0f> b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f
Jul 14 12:04:59 head kernel: NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [nfsd:539]
Jul 14 12:04:59 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:04:59 head kernel: CPU: 6 PID: 539 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:04:59 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:04:59 head kernel: task: ffff8817f8a45a90 ti: ffff8817f195c000 task.ti: ffff8817f195c000
Jul 14 12:04:59 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:04:59 head kernel: RSP: 0018:ffff8817f195fbc8 EFLAGS: 00000293
Jul 14 12:04:59 head kernel: RAX: 0000000000005070 RBX: ffff8801178cc900 RCX: 000000000000001e
Jul 14 12:04:59 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:04:59 head kernel: RBP: ffff8817f195fbc8 R08: 0000000000000000 R09: ffff8817f96ec000
Jul 14 12:04:59 head kernel: R10: ffff8817f96ec000 R11: ffff8817f1e44220 R12: ffffffff8124f74c
Jul 14 12:04:59 head kernel: R13: ffff8817f195fc98 R14: ffff8814ec9b3380 R15: ffff8817f8bc1ce0
Jul 14 12:04:59 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa60000(0000) knlGS:0000000000000000
Jul 14 12:04:59 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:04:59 head kernel: CR2: 00007f23380df000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:04:59 head kernel: Stack:
Jul 14 12:04:59 head kernel: ffff8817f195fbf8 ffffffffa01f4eff ffff8817f1e44244 ffff8817f96ec000
Jul 14 12:04:59 head kernel: ffff8817f1e45068 0000000000000009 ffff8817f195fc38 ffffffffa01f4ffa
Jul 14 12:04:59 head kernel: ffff8817f1f62000 0000000000000009 ffff8817f1e44244 ffff8817f195fcd0
Jul 14 12:04:59 head kernel: Call Trace:
Jul 14 12:04:59 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffffa01f6440>] nfs4_preprocess_seqid_op+0x60/0x1a0 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffffa01dee82>] ? rqst_exp_find+0x92/0x190 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffffa01fb0ee>] nfsd4_close+0x9e/0x380 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:04:59 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:04:59 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:04:59 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:04:59 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:59 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:04:59 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:59 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:04:59 head kernel: NMI watchdog: BUG: soft lockup - CPU#8 stuck for 22s! [nfsd:538]
Jul 14 12:04:59 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:04:59 head kernel: CPU: 8 PID: 538 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:04:59 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:04:59 head kernel: task: ffff8817f8a464a0 ti: ffff8817f1860000 task.ti: ffff8817f1860000
Jul 14 12:04:59 head kernel: RIP: 0010:[<ffffffff81554177>] [<ffffffff81554177>] _raw_spin_lock+0x37/0x40
Jul 14 12:04:59 head kernel: RSP: 0018:ffff8817f1863c08 EFLAGS: 00000202
Jul 14 12:04:59 head kernel: RAX: 0000000000004f10 RBX: 0000000000000246 RCX: 000000000000001f
Jul 14 12:04:59 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:04:59 head kernel: RBP: ffff8817f1863c08 R08: 0000000000000000 R09: 0000000000000000
Jul 14 12:04:59 head kernel: R10: 0000000000000400 R11: ffff8817f1e42220 R12: ffff882ff7b80de0
Jul 14 12:04:59 head kernel: R13: ffff8817f8b44480 R14: 00000000888ab88f R15: ffff8817f95c1f00
Jul 14 12:04:59 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa80000(0000) knlGS:0000000000000000
Jul 14 12:04:59 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:04:59 head kernel: CR2: 00007f23480ce000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:04:59 head kernel: Stack:
Jul 14 12:04:59 head kernel: ffff8817f1863c38 ffffffffa01f4eff ffff8817f1e42240 ffff8817f96ec000
Jul 14 12:04:59 head kernel: ffff8817f1e43068 0000000000000007 ffff8817f1863c78 ffffffffa01f4ffa
Jul 14 12:04:59 head kernel: ffff8817f1863c98 ffffffff818adc00 ffff8817f1863d10 ffff8817f1e43068
Jul 14 12:04:59 head kernel: Call Trace:
Jul 14 12:04:59 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffffa01fa6e0>] nfs4_preprocess_stateid_op+0x190/0x330 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffffa01e779a>] nfsd4_write+0x8a/0x1f0 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:04:59 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:04:59 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:04:59 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:04:59 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:59 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:04:59 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:59 head kernel: Code: 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 <0f> b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f
Jul 14 12:04:59 head kernel: NMI watchdog: BUG: soft lockup - CPU#10 stuck for 22s! [nfsd:540]
Jul 14 12:04:59 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:04:59 head kernel: CPU: 10 PID: 540 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:04:59 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:04:59 head kernel: task: ffff8817f8a45080 ti: ffff8817f1a78000 task.ti: ffff8817f1a78000
Jul 14 12:04:59 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:04:59 head kernel: RSP: 0018:ffff8817f1a7bcc8 EFLAGS: 00000287
Jul 14 12:04:59 head kernel: RAX: 0000000000000eb2 RBX: ffffffffa0183eec RCX: 0000000000000020
Jul 14 12:04:59 head kernel: RDX: 000000000000001c RSI: 00000000000000d0 RDI: ffff8817f96ec130
Jul 14 12:04:59 head kernel: RBP: ffff8817f1a7bcc8 R08: ffff881792d83840 R09: ffff8817f1e47000
Jul 14 12:04:59 head kernel: R10: 0000000000000004 R11: ffff8817f1e46080 R12: ffff882ff904e718
Jul 14 12:04:59 head kernel: R13: ffff8817f1a7bc60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:04:59 head kernel: FS: 0000000000000000(0000) GS:ffff88181faa0000(0000) knlGS:0000000000000000
Jul 14 12:04:59 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:04:59 head kernel: CR2: 00007f22ec0c6000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:04:59 head kernel: Stack:
Jul 14 12:04:59 head kernel: ffff8817f1a7bd48 ffffffffa01f7d76 0000000015de9b97 00000000b16b0475
Jul 14 12:04:59 head kernel: ffff8817f1a7bd38 ffff8817f1f64000 ffff881792d83840 ffff8817f1e47068
Jul 14 12:04:59 head kernel: ffffffff818adc00 00000000b16b0475 ffff8817f1a7bdd8 ffff8817f1e47000
Jul 14 12:04:59 head kernel: Call Trace:
Jul 14 12:04:59 head kernel: [<ffffffffa01f7d76>] nfsd4_sequence+0xe6/0x610 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:04:59 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:04:59 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:04:59 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:04:59 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:59 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:04:59 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:59 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:04:59 head kernel: NMI watchdog: BUG: soft lockup - CPU#14 stuck for 22s! [nfsd:541]
Jul 14 12:04:59 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:04:59 head kernel: CPU: 14 PID: 541 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:04:59 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:04:59 head kernel: task: ffff8817f1b80000 ti: ffff8817f1b7c000 task.ti: ffff8817f1b7c000
Jul 14 12:04:59 head kernel: RIP: 0010:[<ffffffff81554177>] [<ffffffff81554177>] _raw_spin_lock+0x37/0x40
Jul 14 12:04:59 head kernel: RSP: 0018:ffff8817f1b7fc08 EFLAGS: 00000212
Jul 14 12:04:59 head kernel: RAX: 0000000000007fdf RBX: 0000000000000246 RCX: 0000000000000021
Jul 14 12:04:59 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:04:59 head kernel: RBP: ffff8817f1b7fc08 R08: 0000000000000000 R09: 0000000000000000
Jul 14 12:04:59 head kernel: R10: 0000000000000400 R11: ffff8817f1a80220 R12: ffff882ff7b80de0
Jul 14 12:04:59 head kernel: R13: ffff8817f8b44480 R14: 0000000060a0f8c6 R15: ffff8817f95c1f00
Jul 14 12:04:59 head kernel: FS: 0000000000000000(0000) GS:ffff88181fae0000(0000) knlGS:0000000000000000
Jul 14 12:04:59 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:04:59 head kernel: CR2: 00007f235c0d5000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:04:59 head kernel: Stack:
Jul 14 12:04:59 head kernel: ffff8817f1b7fc38 ffffffffa01f4eff ffff8817f1a80240 ffff8817f96ec000
Jul 14 12:04:59 head kernel: ffff8817f1a81068 0000000000000007 ffff8817f1b7fc78 ffffffffa01f4ffa
Jul 14 12:04:59 head kernel: ffff8817f1b7fc98 ffffffff818adc00 ffff8817f1b7fd10 ffff8817f1a81068
Jul 14 12:04:59 head kernel: Call Trace:
Jul 14 12:04:59 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffffa01fa6e0>] nfs4_preprocess_stateid_op+0x190/0x330 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffffa01e779a>] nfsd4_write+0x8a/0x1f0 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:04:59 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:04:59 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:04:59 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:04:59 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:59 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:04:59 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:04:59 head kernel: Code: 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 <0f> b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f
Jul 14 12:05:11 head pbs_server[30205]: LOG_ERROR::svr_is_request, bad attempt to connect from 192.168.2.236:706 (address not trusted - check entry in server_priv/nodes)
Jul 14 12:05:11 head kernel: NMI watchdog: BUG: soft lockup - CPU#11 stuck for 23s! [kworker/u96:2:9888]
Jul 14 12:05:11 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:05:11 head kernel: CPU: 11 PID: 9888 Comm: kworker/u96:2 Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:05:11 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:05:11 head kernel: Workqueue: nfsd4 laundromat_main [nfsd]
Jul 14 12:05:11 head kernel: task: ffff882ff208a840 ti: ffff8818ca7d0000 task.ti: ffff8818ca7d0000
Jul 14 12:05:11 head kernel: RIP: 0010:[<ffffffff8155417a>] [<ffffffff8155417a>] _raw_spin_lock+0x3a/0x40
Jul 14 12:05:11 head kernel: RSP: 0018:ffff8818ca7d3d68 EFLAGS: 00000206
Jul 14 12:05:11 head kernel: RAX: 000000000000236c RBX: 0000000000000000 RCX: 0000000000000022
Jul 14 12:05:11 head kernel: RDX: 000000000000001c RSI: 000000000000005a RDI: ffff8817f96ec130
Jul 14 12:05:11 head kernel: RBP: ffff8818ca7d3d68 R08: ffff8818ca7d0000 R09: 0000000000000001
Jul 14 12:05:11 head kernel: R10: ffff882ffa0c1038 R11: 00000000000ec472 R12: 0000000000000001
Jul 14 12:05:11 head kernel: R13: ffff882ff208ae40 R14: ffff88301f2b0a80 R15: ffff88301f273640
Jul 14 12:05:11 head kernel: FS: 0000000000000000(0000) GS:ffff88301f2a0000(0000) knlGS:0000000000000000
Jul 14 12:05:11 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:05:11 head kernel: CR2: 00007f951cad1000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:05:11 head kernel: Stack:
Jul 14 12:05:11 head kernel: ffff8818ca7d3df8 ffffffffa01f6680 000000000000005a ffff8817f96ec130
Jul 14 12:05:11 head kernel: ffff8817f96ec0a0 ffff8817f96ec000 ffff8818ca7d3dc8 0000000000000292
Jul 14 12:05:11 head kernel: ffff8814ae5ec0c0 ffff8818ca7d3db0 ffff8818ca7d3db0 00000000612153c8
Jul 14 12:05:11 head kernel: Call Trace:
Jul 14 12:05:11 head kernel: [<ffffffffa01f6680>] laundromat_main+0x80/0x480 [nfsd]
Jul 14 12:05:11 head kernel: [<ffffffff8108b7c5>] process_one_work+0x145/0x400
Jul 14 12:05:11 head kernel: [<ffffffff8108bd8b>] worker_thread+0x6b/0x4a0
Jul 14 12:05:11 head kernel: [<ffffffff8108bd20>] ? init_pwq.part.22+0x10/0x10
Jul 14 12:05:11 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:05:11 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:05:11 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:05:11 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:05:11 head kernel: Code: 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 0f b6 17 <38> ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f 1f 44 00
Jul 14 12:05:13 head pbs_server[30205]: LOG_ERROR::svr_is_request, bad attempt to connect from 192.168.2.233:646 (address not trusted - check entry in server_priv/nodes)
Jul 14 12:05:27 head kernel: NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [nfsd:537]
Jul 14 12:05:27 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:05:27 head kernel: CPU: 0 PID: 537 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:05:27 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:05:27 head kernel: task: ffff8817f8a46eb0 ti: ffff8817f1f5c000 task.ti: ffff8817f1f5c000
Jul 14 12:05:27 head kernel: RIP: 0010:[<ffffffff81554170>] [<ffffffff81554170>] _raw_spin_lock+0x30/0x40
Jul 14 12:05:27 head kernel: RSP: 0018:ffff8817f1f5fcc8 EFLAGS: 00000297
Jul 14 12:05:27 head kernel: RAX: 0000000000004f11 RBX: ffff8817f96ec000 RCX: 00000000000000c1
Jul 14 12:05:27 head kernel: RDX: 00000000000000c0 RSI: 000000000000132a RDI: ffff88010e29cb40
Jul 14 12:05:27 head kernel: RBP: ffff8817f1f5fcc8 R08: ffff8817db320540 R09: ffff88010e306a00
Jul 14 12:05:27 head kernel: R10: ffff88010e29cb40 R11: ffff88010e29c800 R12: ffff882ff904e718
Jul 14 12:05:27 head kernel: R13: ffff8817f1f5fc60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:05:27 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa00000(0000) knlGS:0000000000000000
Jul 14 12:05:27 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:05:27 head kernel: CR2: 00007f23500d8000 CR3: 0000000001811000 CR4: 00000000001407f0
Jul 14 12:05:27 head kernel: Stack:
Jul 14 12:05:27 head kernel: ffff8817f1f5fd48 ffffffffa01f7fc4 ffff8817db320540 ffff88010e306a00
Jul 14 12:05:27 head kernel: ffff88010e29c800 ffff88010e29cb40 ffff88164fcf8000 ffff8817f1e41068
Jul 14 12:05:27 head kernel: 00000000818adc00 00000000f1e7181a ffff8817f1f5fdd8 ffff8817f1e41000
Jul 14 12:05:27 head kernel: Call Trace:
Jul 14 12:05:27 head kernel: [<ffffffffa01f7fc4>] nfsd4_sequence+0x334/0x610 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:05:27 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:05:27 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:05:27 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:05:27 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:05:27 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:05:27 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:05:27 head kernel: Code: 55 65 ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 <f3> 90 83 e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00
Jul 14 12:05:27 head kernel: NMI watchdog: BUG: soft lockup - CPU#4 stuck for 22s! [nfsd:535]
Jul 14 12:05:27 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:05:27 head kernel: CPU: 4 PID: 535 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:05:27 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:05:27 head kernel: task: ffff8817f8a43250 ti: ffff8817f1d34000 task.ti: ffff8817f1d34000
Jul 14 12:05:27 head kernel: RIP: 0010:[<ffffffff8155417a>] [<ffffffff8155417a>] _raw_spin_lock+0x3a/0x40
Jul 14 12:05:27 head kernel: RSP: 0018:ffff8817f1d37cc8 EFLAGS: 00000206
Jul 14 12:05:27 head kernel: RAX: 00000000000068eb RBX: ffffffffa0183eec RCX: 000000000000001d
Jul 14 12:05:27 head kernel: RDX: 000000000000001c RSI: 00000000000000d0 RDI: ffff8817f96ec130
Jul 14 12:05:27 head kernel: RBP: ffff8817f1d37cc8 R08: ffff8817dfc3e840 R09: ffff8817fab11000
Jul 14 12:05:27 head kernel: R10: 0000000000000004 R11: ffff8817fab13080 R12: ffff882ff904e718
Jul 14 12:05:27 head kernel: R13: ffff8817f1d37c60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:05:27 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa40000(0000) knlGS:0000000000000000
Jul 14 12:05:27 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:05:27 head kernel: CR2: 00007f216c0e2000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:05:27 head kernel: Stack:
Jul 14 12:05:27 head kernel: ffff8817f1d37d48 ffffffffa01f7d76 0000000015de9b97 000000006f7b8096
Jul 14 12:05:27 head kernel: ffff8817f1d37d38 ffff8817f5302000 ffff8817dfc3e840 ffff8817fab11068
Jul 14 12:05:27 head kernel: ffffffff818adc00 000000006f7b8096 ffff8817fa590000 ffff8817fab11000
Jul 14 12:05:27 head kernel: Call Trace:
Jul 14 12:05:27 head kernel: [<ffffffffa01f7d76>] nfsd4_sequence+0xe6/0x610 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:05:27 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:05:27 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:05:27 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:05:27 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:05:27 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:05:27 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:05:27 head kernel: Code: 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 0f b6 17 <38> ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f 1f 44 00
Jul 14 12:05:27 head kernel: NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [nfsd:539]
Jul 14 12:05:27 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:05:27 head kernel: CPU: 6 PID: 539 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:05:27 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:05:27 head kernel: task: ffff8817f8a45a90 ti: ffff8817f195c000 task.ti: ffff8817f195c000
Jul 14 12:05:27 head kernel: RIP: 0010:[<ffffffff81554177>] [<ffffffff81554177>] _raw_spin_lock+0x37/0x40
Jul 14 12:05:27 head kernel: RSP: 0018:ffff8817f195fbc8 EFLAGS: 00000206
Jul 14 12:05:27 head kernel: RAX: 0000000000003c03 RBX: ffff8801178cc900 RCX: 000000000000001e
Jul 14 12:05:27 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:05:27 head kernel: RBP: ffff8817f195fbc8 R08: 0000000000000000 R09: ffff8817f96ec000
Jul 14 12:05:27 head kernel: R10: ffff8817f96ec000 R11: ffff8817f1e44220 R12: ffffffff8124f74c
Jul 14 12:05:27 head kernel: R13: ffff8817f195fc98 R14: ffff8814ec9b3380 R15: ffff8817f8bc1ce0
Jul 14 12:05:27 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa60000(0000) knlGS:0000000000000000
Jul 14 12:05:27 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:05:27 head kernel: CR2: 00007f23380df000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:05:27 head kernel: Stack:
Jul 14 12:05:27 head kernel: ffff8817f195fbf8 ffffffffa01f4eff ffff8817f1e44244 ffff8817f96ec000
Jul 14 12:05:27 head kernel: ffff8817f1e45068 0000000000000009 ffff8817f195fc38 ffffffffa01f4ffa
Jul 14 12:05:27 head kernel: ffff8817f1f62000 0000000000000009 ffff8817f1e44244 ffff8817f195fcd0
Jul 14 12:05:27 head kernel: Call Trace:
Jul 14 12:05:27 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffffa01f6440>] nfs4_preprocess_seqid_op+0x60/0x1a0 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffffa01dee82>] ? rqst_exp_find+0x92/0x190 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffffa01fb0ee>] nfsd4_close+0x9e/0x380 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:05:27 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:05:27 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:05:27 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:05:27 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:05:27 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:05:27 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:05:27 head kernel: Code: 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 <0f> b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f
Jul 14 12:05:27 head kernel: NMI watchdog: BUG: soft lockup - CPU#8 stuck for 22s! [nfsd:538]
Jul 14 12:05:27 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:05:27 head kernel: CPU: 8 PID: 538 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:05:27 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:05:27 head kernel: task: ffff8817f8a464a0 ti: ffff8817f1860000 task.ti: ffff8817f1860000
Jul 14 12:05:27 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:05:27 head kernel: RSP: 0018:ffff8817f1863c08 EFLAGS: 00000293
Jul 14 12:05:27 head kernel: RAX: 000000000000552f RBX: 0000000000000246 RCX: 000000000000001f
Jul 14 12:05:27 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:05:27 head kernel: RBP: ffff8817f1863c08 R08: 0000000000000000 R09: 0000000000000000
Jul 14 12:05:27 head kernel: R10: 0000000000000400 R11: ffff8817f1e42220 R12: ffff882ff7b80de0
Jul 14 12:05:27 head kernel: R13: ffff8817f8b44480 R14: 00000000888ab88f R15: ffff8817f95c1f00
Jul 14 12:05:27 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa80000(0000) knlGS:0000000000000000
Jul 14 12:05:27 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:05:27 head kernel: CR2: 00007f23480ce000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:05:27 head kernel: Stack:
Jul 14 12:05:27 head kernel: ffff8817f1863c38 ffffffffa01f4eff ffff8817f1e42240 ffff8817f96ec000
Jul 14 12:05:27 head kernel: ffff8817f1e43068 0000000000000007 ffff8817f1863c78 ffffffffa01f4ffa
Jul 14 12:05:27 head kernel: ffff8817f1863c98 ffffffff818adc00 ffff8817f1863d10 ffff8817f1e43068
Jul 14 12:05:27 head kernel: Call Trace:
Jul 14 12:05:27 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffffa01fa6e0>] nfs4_preprocess_stateid_op+0x190/0x330 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffffa01e779a>] nfsd4_write+0x8a/0x1f0 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:05:27 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:05:27 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:05:27 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:05:27 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:05:27 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:05:27 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:05:27 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:05:27 head kernel: NMI watchdog: BUG: soft lockup - CPU#10 stuck for 22s! [nfsd:540]
Jul 14 12:05:27 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:05:27 head kernel: CPU: 10 PID: 540 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:05:27 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:05:27 head kernel: task: ffff8817f8a45080 ti: ffff8817f1a78000 task.ti: ffff8817f1a78000
Jul 14 12:05:27 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:05:27 head kernel: RSP: 0018:ffff8817f1a7bcc8 EFLAGS: 00000287
Jul 14 12:05:27 head kernel: RAX: 00000000000076b0 RBX: ffffffffa0183eec RCX: 0000000000000020
Jul 14 12:05:27 head kernel: RDX: 000000000000001c RSI: 00000000000000d0 RDI: ffff8817f96ec130
Jul 14 12:05:27 head kernel: RBP: ffff8817f1a7bcc8 R08: ffff881792d83840 R09: ffff8817f1e47000
Jul 14 12:05:27 head kernel: R10: 0000000000000004 R11: ffff8817f1e46080 R12: ffff882ff904e718
Jul 14 12:05:27 head kernel: R13: ffff8817f1a7bc60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:05:27 head kernel: FS: 0000000000000000(0000) GS:ffff88181faa0000(0000) knlGS:0000000000000000
Jul 14 12:05:27 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:05:27 head kernel: CR2: 00007f22ec0c6000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:05:27 head kernel: Stack:
Jul 14 12:05:27 head kernel: ffff8817f1a7bd48 ffffffffa01f7d76 0000000015de9b97 00000000b16b0475
Jul 14 12:05:27 head kernel: ffff8817f1a7bd38 ffff8817f1f64000 ffff881792d83840 ffff8817f1e47068
Jul 14 12:05:27 head kernel: ffffffff818adc00 00000000b16b0475 ffff8817f1a7bdd8 ffff8817f1e47000
Jul 14 12:05:27 head kernel: Call Trace:
Jul 14 12:05:27 head kernel: [<ffffffffa01f7d76>] nfsd4_sequence+0xe6/0x610 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:05:27 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:05:27 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:05:27 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:05:27 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:05:27 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:05:27 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:05:27 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:05:27 head kernel: NMI watchdog: BUG: soft lockup - CPU#14 stuck for 23s! [nfsd:541]
Jul 14 12:05:27 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:05:27 head kernel: CPU: 14 PID: 541 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:05:27 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:05:27 head kernel: task: ffff8817f1b80000 ti: ffff8817f1b7c000 task.ti: ffff8817f1b7c000
Jul 14 12:05:27 head kernel: RIP: 0010:[<ffffffff8155417a>] [<ffffffff8155417a>] _raw_spin_lock+0x3a/0x40
Jul 14 12:05:27 head kernel: RSP: 0018:ffff8817f1b7fc08 EFLAGS: 00000202
Jul 14 12:05:27 head kernel: RAX: 0000000000006962 RBX: 0000000000000246 RCX: 0000000000000021
Jul 14 12:05:27 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:05:27 head kernel: RBP: ffff8817f1b7fc08 R08: 0000000000000000 R09: 0000000000000000
Jul 14 12:05:27 head kernel: R10: 0000000000000400 R11: ffff8817f1a80220 R12: ffff882ff7b80de0
Jul 14 12:05:27 head kernel: R13: ffff8817f8b44480 R14: 0000000060a0f8c6 R15: ffff8817f95c1f00
Jul 14 12:05:27 head kernel: FS: 0000000000000000(0000) GS:ffff88181fae0000(0000) knlGS:0000000000000000
Jul 14 12:05:27 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:05:27 head kernel: CR2: 00007f235c0d5000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:05:27 head kernel: Stack:
Jul 14 12:05:27 head kernel: ffff8817f1b7fc38 ffffffffa01f4eff ffff8817f1a80240 ffff8817f96ec000
Jul 14 12:05:27 head kernel: ffff8817f1a81068 0000000000000007 ffff8817f1b7fc78 ffffffffa01f4ffa
Jul 14 12:05:27 head kernel: ffff8817f1b7fc98 ffffffff818adc00 ffff8817f1b7fd10 ffff8817f1a81068
Jul 14 12:05:27 head kernel: Call Trace:
Jul 14 12:05:27 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffffa01fa6e0>] nfs4_preprocess_stateid_op+0x190/0x330 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffffa01e779a>] nfsd4_write+0x8a/0x1f0 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:05:27 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:05:27 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:05:27 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:05:27 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:05:27 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:05:27 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:05:27 head kernel: Code: 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 0f b6 17 <38> ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f 1f 44 00
Jul 14 12:05:39 head kernel: NMI watchdog: BUG: soft lockup - CPU#11 stuck for 23s! [kworker/u96:2:9888]
Jul 14 12:05:39 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:05:39 head kernel: CPU: 11 PID: 9888 Comm: kworker/u96:2 Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:05:39 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:05:39 head kernel: Workqueue: nfsd4 laundromat_main [nfsd]
Jul 14 12:05:39 head kernel: task: ffff882ff208a840 ti: ffff8818ca7d0000 task.ti: ffff8818ca7d0000
Jul 14 12:05:39 head kernel: RIP: 0010:[<ffffffff8155417a>] [<ffffffff8155417a>] _raw_spin_lock+0x3a/0x40
Jul 14 12:05:39 head kernel: RSP: 0018:ffff8818ca7d3d68 EFLAGS: 00000206
Jul 14 12:05:39 head kernel: RAX: 00000000000030f5 RBX: 0000000000000000 RCX: 0000000000000022
Jul 14 12:05:39 head kernel: RDX: 000000000000001c RSI: 000000000000005a RDI: ffff8817f96ec130
Jul 14 12:05:39 head kernel: RBP: ffff8818ca7d3d68 R08: ffff8818ca7d0000 R09: 0000000000000001
Jul 14 12:05:39 head kernel: R10: ffff882ffa0c1038 R11: 00000000000ec472 R12: 0000000000000001
Jul 14 12:05:39 head kernel: R13: ffff882ff208ae40 R14: ffff88301f2b0a80 R15: ffff88301f273640
Jul 14 12:05:39 head kernel: FS: 0000000000000000(0000) GS:ffff88301f2a0000(0000) knlGS:0000000000000000
Jul 14 12:05:39 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:05:39 head kernel: CR2: 00007f951cad1000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:05:39 head kernel: Stack:
Jul 14 12:05:39 head kernel: ffff8818ca7d3df8 ffffffffa01f6680 000000000000005a ffff8817f96ec130
Jul 14 12:05:39 head kernel: ffff8817f96ec0a0 ffff8817f96ec000 ffff8818ca7d3dc8 0000000000000292
Jul 14 12:05:39 head kernel: ffff8814ae5ec0c0 ffff8818ca7d3db0 ffff8818ca7d3db0 00000000612153c8
Jul 14 12:05:39 head kernel: Call Trace:
Jul 14 12:05:39 head kernel: [<ffffffffa01f6680>] laundromat_main+0x80/0x480 [nfsd]
Jul 14 12:05:39 head kernel: [<ffffffff8108b7c5>] process_one_work+0x145/0x400
Jul 14 12:05:39 head kernel: [<ffffffff8108bd8b>] worker_thread+0x6b/0x4a0
Jul 14 12:05:39 head kernel: [<ffffffff8108bd20>] ? init_pwq.part.22+0x10/0x10
Jul 14 12:05:39 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:05:39 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:05:39 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:05:39 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:05:39 head kernel: Code: 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 0f b6 17 <38> ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f 1f 44 00
Jul 14 12:05:55 head kernel: NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [nfsd:537]
Jul 14 12:05:55 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:05:55 head kernel: CPU: 0 PID: 537 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:05:55 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:05:55 head kernel: task: ffff8817f8a46eb0 ti: ffff8817f1f5c000 task.ti: ffff8817f1f5c000
Jul 14 12:05:55 head kernel: RIP: 0010:[<ffffffff8155417a>] [<ffffffff8155417a>] _raw_spin_lock+0x3a/0x40
Jul 14 12:05:55 head kernel: RSP: 0018:ffff8817f1f5fcc8 EFLAGS: 00000202
Jul 14 12:05:55 head kernel: RAX: 0000000000005398 RBX: ffff8817f96ec000 RCX: 00000000000000c1
Jul 14 12:05:55 head kernel: RDX: 00000000000000c0 RSI: 000000000000132a RDI: ffff88010e29cb40
Jul 14 12:05:55 head kernel: RBP: ffff8817f1f5fcc8 R08: ffff8817db320540 R09: ffff88010e306a00
Jul 14 12:05:55 head kernel: R10: ffff88010e29cb40 R11: ffff88010e29c800 R12: ffff882ff904e718
Jul 14 12:05:55 head kernel: R13: ffff8817f1f5fc60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:05:55 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa00000(0000) knlGS:0000000000000000
Jul 14 12:05:55 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:05:55 head kernel: CR2: 00007f23500d8000 CR3: 0000000001811000 CR4: 00000000001407f0
Jul 14 12:05:55 head kernel: Stack:
Jul 14 12:05:55 head kernel: ffff8817f1f5fd48 ffffffffa01f7fc4 ffff8817db320540 ffff88010e306a00
Jul 14 12:05:55 head kernel: ffff88010e29c800 ffff88010e29cb40 ffff88164fcf8000 ffff8817f1e41068
Jul 14 12:05:55 head kernel: 00000000818adc00 00000000f1e7181a ffff8817f1f5fdd8 ffff8817f1e41000
Jul 14 12:05:55 head kernel: Call Trace:
Jul 14 12:05:55 head kernel: [<ffffffffa01f7fc4>] nfsd4_sequence+0x334/0x610 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:05:55 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:05:55 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:05:55 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:05:55 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:05:55 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:05:55 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:05:55 head kernel: Code: 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 0f b6 17 <38> ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f 1f 44 00
Jul 14 12:05:55 head kernel: NMI watchdog: BUG: soft lockup - CPU#4 stuck for 22s! [nfsd:535]
Jul 14 12:05:55 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:05:55 head kernel: CPU: 4 PID: 535 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:05:55 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:05:55 head kernel: task: ffff8817f8a43250 ti: ffff8817f1d34000 task.ti: ffff8817f1d34000
Jul 14 12:05:55 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:05:55 head kernel: RSP: 0018:ffff8817f1d37cc8 EFLAGS: 00000297
Jul 14 12:05:55 head kernel: RAX: 0000000000002de5 RBX: ffffffffa0183eec RCX: 000000000000001d
Jul 14 12:05:55 head kernel: RDX: 000000000000001c RSI: 00000000000000d0 RDI: ffff8817f96ec130
Jul 14 12:05:55 head kernel: RBP: ffff8817f1d37cc8 R08: ffff8817dfc3e840 R09: ffff8817fab11000
Jul 14 12:05:55 head kernel: R10: 0000000000000004 R11: ffff8817fab13080 R12: ffff882ff904e718
Jul 14 12:05:55 head kernel: R13: ffff8817f1d37c60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:05:55 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa40000(0000) knlGS:0000000000000000
Jul 14 12:05:55 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:05:55 head kernel: CR2: 00007f216c0e2000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:05:55 head kernel: Stack:
Jul 14 12:05:55 head kernel: ffff8817f1d37d48 ffffffffa01f7d76 0000000015de9b97 000000006f7b8096
Jul 14 12:05:55 head kernel: ffff8817f1d37d38 ffff8817f5302000 ffff8817dfc3e840 ffff8817fab11068
Jul 14 12:05:55 head kernel: ffffffff818adc00 000000006f7b8096 ffff8817fa590000 ffff8817fab11000
Jul 14 12:05:55 head kernel: Call Trace:
Jul 14 12:05:55 head kernel: [<ffffffffa01f7d76>] nfsd4_sequence+0xe6/0x610 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:05:55 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:05:55 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:05:55 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:05:55 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:05:55 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:05:55 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:05:55 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:05:55 head kernel: NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [nfsd:539]
Jul 14 12:05:55 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:05:55 head kernel: CPU: 6 PID: 539 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:05:55 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:05:55 head kernel: task: ffff8817f8a45a90 ti: ffff8817f195c000 task.ti: ffff8817f195c000
Jul 14 12:05:55 head kernel: RIP: 0010:[<ffffffff81554177>] [<ffffffff81554177>] _raw_spin_lock+0x37/0x40
Jul 14 12:05:55 head kernel: RSP: 0018:ffff8817f195fbc8 EFLAGS: 00000202
Jul 14 12:05:55 head kernel: RAX: 00000000000076b5 RBX: ffff8801178cc900 RCX: 000000000000001e
Jul 14 12:05:55 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:05:55 head kernel: RBP: ffff8817f195fbc8 R08: 0000000000000000 R09: ffff8817f96ec000
Jul 14 12:05:55 head kernel: R10: ffff8817f96ec000 R11: ffff8817f1e44220 R12: ffffffff8124f74c
Jul 14 12:05:55 head kernel: R13: ffff8817f195fc98 R14: ffff8814ec9b3380 R15: ffff8817f8bc1ce0
Jul 14 12:05:55 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa60000(0000) knlGS:0000000000000000
Jul 14 12:05:55 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:05:55 head kernel: CR2: 00007f23380df000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:05:55 head kernel: Stack:
Jul 14 12:05:55 head kernel: ffff8817f195fbf8 ffffffffa01f4eff ffff8817f1e44244 ffff8817f96ec000
Jul 14 12:05:55 head kernel: ffff8817f1e45068 0000000000000009 ffff8817f195fc38 ffffffffa01f4ffa
Jul 14 12:05:55 head kernel: ffff8817f1f62000 0000000000000009 ffff8817f1e44244 ffff8817f195fcd0
Jul 14 12:05:55 head kernel: Call Trace:
Jul 14 12:05:55 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffffa01f6440>] nfs4_preprocess_seqid_op+0x60/0x1a0 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffffa01dee82>] ? rqst_exp_find+0x92/0x190 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffffa01fb0ee>] nfsd4_close+0x9e/0x380 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:05:55 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:05:55 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:05:55 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:05:55 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:05:55 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:05:55 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:05:55 head kernel: Code: 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 <0f> b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f
Jul 14 12:05:55 head kernel: NMI watchdog: BUG: soft lockup - CPU#8 stuck for 22s! [nfsd:538]
Jul 14 12:05:55 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:05:55 head kernel: CPU: 8 PID: 538 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:05:55 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:05:55 head kernel: task: ffff8817f8a464a0 ti: ffff8817f1860000 task.ti: ffff8817f1860000
Jul 14 12:05:55 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:05:55 head kernel: RSP: 0018:ffff8817f1863c08 EFLAGS: 00000293
Jul 14 12:05:55 head kernel: RAX: 0000000000002f6a RBX: 0000000000000246 RCX: 000000000000001f
Jul 14 12:05:55 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:05:55 head kernel: RBP: ffff8817f1863c08 R08: 0000000000000000 R09: 0000000000000000
Jul 14 12:05:55 head kernel: R10: 0000000000000400 R11: ffff8817f1e42220 R12: ffff882ff7b80de0
Jul 14 12:05:55 head kernel: R13: ffff8817f8b44480 R14: 00000000888ab88f R15: ffff8817f95c1f00
Jul 14 12:05:55 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa80000(0000) knlGS:0000000000000000
Jul 14 12:05:55 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:05:55 head kernel: CR2: 00007f23480ce000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:05:55 head kernel: Stack:
Jul 14 12:05:55 head kernel: ffff8817f1863c38 ffffffffa01f4eff ffff8817f1e42240 ffff8817f96ec000
Jul 14 12:05:55 head kernel: ffff8817f1e43068 0000000000000007 ffff8817f1863c78 ffffffffa01f4ffa
Jul 14 12:05:55 head kernel: ffff8817f1863c98 ffffffff818adc00 ffff8817f1863d10 ffff8817f1e43068
Jul 14 12:05:55 head kernel: Call Trace:
Jul 14 12:05:55 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffffa01fa6e0>] nfs4_preprocess_stateid_op+0x190/0x330 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffffa01e779a>] nfsd4_write+0x8a/0x1f0 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:05:55 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:05:55 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:05:55 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:05:55 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:05:55 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:05:55 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:05:55 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:05:55 head kernel: NMI watchdog: BUG: soft lockup - CPU#10 stuck for 23s! [nfsd:540]
Jul 14 12:05:55 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:05:55 head kernel: CPU: 10 PID: 540 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:05:55 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:05:55 head kernel: task: ffff8817f8a45080 ti: ffff8817f1a78000 task.ti: ffff8817f1a78000
Jul 14 12:05:55 head kernel: RIP: 0010:[<ffffffff8155417a>] [<ffffffff8155417a>] _raw_spin_lock+0x3a/0x40
Jul 14 12:05:55 head kernel: RSP: 0018:ffff8817f1a7bcc8 EFLAGS: 00000202
Jul 14 12:05:55 head kernel: RAX: 0000000000002a4c RBX: ffffffffa0183eec RCX: 0000000000000020
Jul 14 12:05:55 head kernel: RDX: 000000000000001c RSI: 00000000000000d0 RDI: ffff8817f96ec130
Jul 14 12:05:55 head kernel: RBP: ffff8817f1a7bcc8 R08: ffff881792d83840 R09: ffff8817f1e47000
Jul 14 12:05:55 head kernel: R10: 0000000000000004 R11: ffff8817f1e46080 R12: ffff882ff904e718
Jul 14 12:05:55 head kernel: R13: ffff8817f1a7bc60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:05:55 head kernel: FS: 0000000000000000(0000) GS:ffff88181faa0000(0000) knlGS:0000000000000000
Jul 14 12:05:55 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:05:55 head kernel: CR2: 00007f22ec0c6000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:05:55 head kernel: Stack:
Jul 14 12:05:55 head kernel: ffff8817f1a7bd48 ffffffffa01f7d76 0000000015de9b97 00000000b16b0475
Jul 14 12:05:55 head kernel: ffff8817f1a7bd38 ffff8817f1f64000 ffff881792d83840 ffff8817f1e47068
Jul 14 12:05:55 head kernel: ffffffff818adc00 00000000b16b0475 ffff8817f1a7bdd8 ffff8817f1e47000
Jul 14 12:05:55 head kernel: Call Trace:
Jul 14 12:05:55 head kernel: [<ffffffffa01f7d76>] nfsd4_sequence+0xe6/0x610 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:05:55 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:05:55 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:05:55 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:05:55 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:05:55 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:05:55 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:05:55 head kernel: Code: 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 0f b6 17 <38> ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f 1f 44 00
Jul 14 12:05:55 head kernel: NMI watchdog: BUG: soft lockup - CPU#14 stuck for 23s! [nfsd:541]
Jul 14 12:05:55 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:05:55 head kernel: CPU: 14 PID: 541 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:05:55 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:05:55 head kernel: task: ffff8817f1b80000 ti: ffff8817f1b7c000 task.ti: ffff8817f1b7c000
Jul 14 12:05:55 head kernel: RIP: 0010:[<ffffffff81554177>] [<ffffffff81554177>] _raw_spin_lock+0x37/0x40
Jul 14 12:05:55 head kernel: RSP: 0018:ffff8817f1b7fc08 EFLAGS: 00000206
Jul 14 12:05:55 head kernel: RAX: 0000000000005b82 RBX: 0000000000000246 RCX: 0000000000000021
Jul 14 12:05:55 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:05:55 head kernel: RBP: ffff8817f1b7fc08 R08: 0000000000000000 R09: 0000000000000000
Jul 14 12:05:55 head kernel: R10: 0000000000000400 R11: ffff8817f1a80220 R12: ffff882ff7b80de0
Jul 14 12:05:55 head kernel: R13: ffff8817f8b44480 R14: 0000000060a0f8c6 R15: ffff8817f95c1f00
Jul 14 12:05:55 head kernel: FS: 0000000000000000(0000) GS:ffff88181fae0000(0000) knlGS:0000000000000000
Jul 14 12:05:55 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:05:55 head kernel: CR2: 00007f235c0d5000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:05:55 head kernel: Stack:
Jul 14 12:05:55 head kernel: ffff8817f1b7fc38 ffffffffa01f4eff ffff8817f1a80240 ffff8817f96ec000
Jul 14 12:05:55 head kernel: ffff8817f1a81068 0000000000000007 ffff8817f1b7fc78 ffffffffa01f4ffa
Jul 14 12:05:55 head kernel: ffff8817f1b7fc98 ffffffff818adc00 ffff8817f1b7fd10 ffff8817f1a81068
Jul 14 12:05:55 head kernel: Call Trace:
Jul 14 12:05:55 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffffa01fa6e0>] nfs4_preprocess_stateid_op+0x190/0x330 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffffa01e779a>] nfsd4_write+0x8a/0x1f0 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:05:55 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:05:55 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:05:55 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:05:55 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:05:55 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:05:55 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:05:55 head kernel: Code: 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 <0f> b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f
Jul 14 12:05:56 head pbs_server[30205]: LOG_ERROR::svr_is_request, bad attempt to connect from 192.168.2.236:706 (address not trusted - check entry in server_priv/nodes)
Jul 14 12:05:58 head pbs_server[30205]: LOG_ERROR::svr_is_request, bad attempt to connect from 192.168.2.233:646 (address not trusted - check entry in server_priv/nodes)
Jul 14 12:06:07 head kernel: NMI watchdog: BUG: soft lockup - CPU#11 stuck for 23s! [kworker/u96:2:9888]
Jul 14 12:06:07 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:06:07 head kernel: CPU: 11 PID: 9888 Comm: kworker/u96:2 Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:06:07 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:06:07 head kernel: Workqueue: nfsd4 laundromat_main [nfsd]
Jul 14 12:06:07 head kernel: task: ffff882ff208a840 ti: ffff8818ca7d0000 task.ti: ffff8818ca7d0000
Jul 14 12:06:07 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:06:07 head kernel: RSP: 0018:ffff8818ca7d3d68 EFLAGS: 00000287
Jul 14 12:06:07 head kernel: RAX: 0000000000004fea RBX: 0000000000000000 RCX: 0000000000000022
Jul 14 12:06:07 head kernel: RDX: 000000000000001c RSI: 000000000000005a RDI: ffff8817f96ec130
Jul 14 12:06:07 head kernel: RBP: ffff8818ca7d3d68 R08: ffff8818ca7d0000 R09: 0000000000000001
Jul 14 12:06:07 head kernel: R10: ffff882ffa0c1038 R11: 00000000000ec472 R12: 0000000000000001
Jul 14 12:06:07 head kernel: R13: ffff882ff208ae40 R14: ffff88301f2b0a80 R15: ffff88301f273640
Jul 14 12:06:07 head kernel: FS: 0000000000000000(0000) GS:ffff88301f2a0000(0000) knlGS:0000000000000000
Jul 14 12:06:07 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:06:07 head kernel: CR2: 00007f951cad1000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:06:07 head kernel: Stack:
Jul 14 12:06:07 head kernel: ffff8818ca7d3df8 ffffffffa01f6680 000000000000005a ffff8817f96ec130
Jul 14 12:06:07 head kernel: ffff8817f96ec0a0 ffff8817f96ec000 ffff8818ca7d3dc8 0000000000000292
Jul 14 12:06:07 head kernel: ffff8814ae5ec0c0 ffff8818ca7d3db0 ffff8818ca7d3db0 00000000612153c8
Jul 14 12:06:07 head kernel: Call Trace:
Jul 14 12:06:07 head kernel: [<ffffffffa01f6680>] laundromat_main+0x80/0x480 [nfsd]
Jul 14 12:06:07 head kernel: [<ffffffff8108b7c5>] process_one_work+0x145/0x400
Jul 14 12:06:07 head kernel: [<ffffffff8108bd8b>] worker_thread+0x6b/0x4a0
Jul 14 12:06:07 head kernel: [<ffffffff8108bd20>] ? init_pwq.part.22+0x10/0x10
Jul 14 12:06:07 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:06:07 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:06:07 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:06:07 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:06:07 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:06:23 head kernel: NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [nfsd:537]
Jul 14 12:06:23 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:06:23 head kernel: CPU: 0 PID: 537 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:06:23 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:06:23 head kernel: task: ffff8817f8a46eb0 ti: ffff8817f1f5c000 task.ti: ffff8817f1f5c000
Jul 14 12:06:23 head kernel: RIP: 0010:[<ffffffff8155417a>] [<ffffffff8155417a>] _raw_spin_lock+0x3a/0x40
Jul 14 12:06:23 head kernel: RSP: 0018:ffff8817f1f5fcc8 EFLAGS: 00000206
Jul 14 12:06:23 head kernel: RAX: 0000000000001ed1 RBX: ffff8817f96ec000 RCX: 00000000000000c1
Jul 14 12:06:23 head kernel: RDX: 00000000000000c0 RSI: 000000000000132a RDI: ffff88010e29cb40
Jul 14 12:06:23 head kernel: RBP: ffff8817f1f5fcc8 R08: ffff8817db320540 R09: ffff88010e306a00
Jul 14 12:06:23 head kernel: R10: ffff88010e29cb40 R11: ffff88010e29c800 R12: ffff882ff904e718
Jul 14 12:06:23 head kernel: R13: ffff8817f1f5fc60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:06:23 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa00000(0000) knlGS:0000000000000000
Jul 14 12:06:23 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:06:23 head kernel: CR2: 00007f23500d8000 CR3: 0000000001811000 CR4: 00000000001407f0
Jul 14 12:06:23 head kernel: Stack:
Jul 14 12:06:23 head kernel: ffff8817f1f5fd48 ffffffffa01f7fc4 ffff8817db320540 ffff88010e306a00
Jul 14 12:06:23 head kernel: ffff88010e29c800 ffff88010e29cb40 ffff88164fcf8000 ffff8817f1e41068
Jul 14 12:06:23 head kernel: 00000000818adc00 00000000f1e7181a ffff8817f1f5fdd8 ffff8817f1e41000
Jul 14 12:06:23 head kernel: Call Trace:
Jul 14 12:06:23 head kernel: [<ffffffffa01f7fc4>] nfsd4_sequence+0x334/0x610 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:06:23 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:06:23 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:06:23 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:06:23 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:06:23 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:06:23 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:06:23 head kernel: Code: 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 0f b6 17 <38> ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f 1f 44 00
Jul 14 12:06:23 head kernel: NMI watchdog: BUG: soft lockup - CPU#4 stuck for 23s! [nfsd:535]
Jul 14 12:06:23 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:06:23 head kernel: CPU: 4 PID: 535 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:06:23 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:06:23 head kernel: task: ffff8817f8a43250 ti: ffff8817f1d34000 task.ti: ffff8817f1d34000
Jul 14 12:06:23 head kernel: RIP: 0010:[<ffffffff81554177>] [<ffffffff81554177>] _raw_spin_lock+0x37/0x40
Jul 14 12:06:23 head kernel: RSP: 0018:ffff8817f1d37cc8 EFLAGS: 00000206
Jul 14 12:06:23 head kernel: RAX: 00000000000054d4 RBX: ffffffffa0183eec RCX: 000000000000001d
Jul 14 12:06:23 head kernel: RDX: 000000000000001c RSI: 00000000000000d0 RDI: ffff8817f96ec130
Jul 14 12:06:23 head kernel: RBP: ffff8817f1d37cc8 R08: ffff8817dfc3e840 R09: ffff8817fab11000
Jul 14 12:06:23 head kernel: R10: 0000000000000004 R11: ffff8817fab13080 R12: ffff882ff904e718
Jul 14 12:06:23 head kernel: R13: ffff8817f1d37c60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:06:23 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa40000(0000) knlGS:0000000000000000
Jul 14 12:06:23 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:06:23 head kernel: CR2: 00007f216c0e2000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:06:23 head kernel: Stack:
Jul 14 12:06:23 head kernel: ffff8817f1d37d48 ffffffffa01f7d76 0000000015de9b97 000000006f7b8096
Jul 14 12:06:23 head kernel: ffff8817f1d37d38 ffff8817f5302000 ffff8817dfc3e840 ffff8817fab11068
Jul 14 12:06:23 head kernel: ffffffff818adc00 000000006f7b8096 ffff8817fa590000 ffff8817fab11000
Jul 14 12:06:23 head kernel: Call Trace:
Jul 14 12:06:23 head kernel: [<ffffffffa01f7d76>] nfsd4_sequence+0xe6/0x610 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:06:23 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:06:23 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:06:23 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:06:23 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:06:23 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:06:23 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:06:23 head kernel: Code: 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 <0f> b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f
Jul 14 12:06:23 head kernel: NMI watchdog: BUG: soft lockup - CPU#6 stuck for 23s! [nfsd:539]
Jul 14 12:06:23 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:06:23 head kernel: CPU: 6 PID: 539 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:06:23 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:06:23 head kernel: task: ffff8817f8a45a90 ti: ffff8817f195c000 task.ti: ffff8817f195c000
Jul 14 12:06:23 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:06:23 head kernel: RSP: 0018:ffff8817f195fbc8 EFLAGS: 00000293
Jul 14 12:06:23 head kernel: RAX: 0000000000004380 RBX: ffff8801178cc900 RCX: 000000000000001e
Jul 14 12:06:23 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:06:23 head kernel: RBP: ffff8817f195fbc8 R08: 0000000000000000 R09: ffff8817f96ec000
Jul 14 12:06:23 head kernel: R10: ffff8817f96ec000 R11: ffff8817f1e44220 R12: ffffffff8124f74c
Jul 14 12:06:23 head kernel: R13: ffff8817f195fc98 R14: ffff8814ec9b3380 R15: ffff8817f8bc1ce0
Jul 14 12:06:23 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa60000(0000) knlGS:0000000000000000
Jul 14 12:06:23 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:06:23 head kernel: CR2: 00007f23380df000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:06:23 head kernel: Stack:
Jul 14 12:06:23 head kernel: ffff8817f195fbf8 ffffffffa01f4eff ffff8817f1e44244 ffff8817f96ec000
Jul 14 12:06:23 head kernel: ffff8817f1e45068 0000000000000009 ffff8817f195fc38 ffffffffa01f4ffa
Jul 14 12:06:23 head kernel: ffff8817f1f62000 0000000000000009 ffff8817f1e44244 ffff8817f195fcd0
Jul 14 12:06:23 head kernel: Call Trace:
Jul 14 12:06:23 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffffa01f6440>] nfs4_preprocess_seqid_op+0x60/0x1a0 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffffa01dee82>] ? rqst_exp_find+0x92/0x190 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffffa01fb0ee>] nfsd4_close+0x9e/0x380 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:06:23 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:06:23 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:06:23 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:06:23 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:06:23 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:06:23 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:06:23 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:06:23 head kernel: NMI watchdog: BUG: soft lockup - CPU#8 stuck for 23s! [nfsd:538]
Jul 14 12:06:23 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:06:23 head kernel: CPU: 8 PID: 538 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:06:23 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:06:23 head kernel: task: ffff8817f8a464a0 ti: ffff8817f1860000 task.ti: ffff8817f1860000
Jul 14 12:06:23 head kernel: RIP: 0010:[<ffffffff81554177>] [<ffffffff81554177>] _raw_spin_lock+0x37/0x40
Jul 14 12:06:23 head kernel: RSP: 0018:ffff8817f1863c08 EFLAGS: 00000202
Jul 14 12:06:23 head kernel: RAX: 0000000000004d98 RBX: 0000000000000246 RCX: 000000000000001f
Jul 14 12:06:23 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:06:23 head kernel: RBP: ffff8817f1863c08 R08: 0000000000000000 R09: 0000000000000000
Jul 14 12:06:23 head kernel: R10: 0000000000000400 R11: ffff8817f1e42220 R12: ffff882ff7b80de0
Jul 14 12:06:23 head kernel: R13: ffff8817f8b44480 R14: 00000000888ab88f R15: ffff8817f95c1f00
Jul 14 12:06:23 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa80000(0000) knlGS:0000000000000000
Jul 14 12:06:23 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:06:23 head kernel: CR2: 00007f23480ce000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:06:23 head kernel: Stack:
Jul 14 12:06:23 head kernel: ffff8817f1863c38 ffffffffa01f4eff ffff8817f1e42240 ffff8817f96ec000
Jul 14 12:06:23 head kernel: ffff8817f1e43068 0000000000000007 ffff8817f1863c78 ffffffffa01f4ffa
Jul 14 12:06:23 head kernel: ffff8817f1863c98 ffffffff818adc00 ffff8817f1863d10 ffff8817f1e43068
Jul 14 12:06:23 head kernel: Call Trace:
Jul 14 12:06:23 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffffa01fa6e0>] nfs4_preprocess_stateid_op+0x190/0x330 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffffa01e779a>] nfsd4_write+0x8a/0x1f0 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:06:23 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:06:23 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:06:23 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:06:23 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:06:23 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:06:23 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:06:23 head kernel: Code: 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 <0f> b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f
Jul 14 12:06:23 head kernel: NMI watchdog: BUG: soft lockup - CPU#10 stuck for 23s! [nfsd:540]
Jul 14 12:06:23 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:06:23 head kernel: CPU: 10 PID: 540 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:06:23 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:06:23 head kernel: task: ffff8817f8a45080 ti: ffff8817f1a78000 task.ti: ffff8817f1a78000
Jul 14 12:06:23 head kernel: RIP: 0010:[<ffffffff81554177>] [<ffffffff81554177>] _raw_spin_lock+0x37/0x40
Jul 14 12:06:23 head kernel: RSP: 0018:ffff8817f1a7bcc8 EFLAGS: 00000206
Jul 14 12:06:23 head kernel: RAX: 0000000000003706 RBX: ffffffffa0183eec RCX: 0000000000000020
Jul 14 12:06:23 head kernel: RDX: 000000000000001c RSI: 00000000000000d0 RDI: ffff8817f96ec130
Jul 14 12:06:23 head kernel: RBP: ffff8817f1a7bcc8 R08: ffff881792d83840 R09: ffff8817f1e47000
Jul 14 12:06:23 head kernel: R10: 0000000000000004 R11: ffff8817f1e46080 R12: ffff882ff904e718
Jul 14 12:06:23 head kernel: R13: ffff8817f1a7bc60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:06:23 head kernel: FS: 0000000000000000(0000) GS:ffff88181faa0000(0000) knlGS:0000000000000000
Jul 14 12:06:23 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:06:23 head kernel: CR2: 00007f22ec0c6000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:06:23 head kernel: Stack:
Jul 14 12:06:23 head kernel: ffff8817f1a7bd48 ffffffffa01f7d76 0000000015de9b97 00000000b16b0475
Jul 14 12:06:23 head kernel: ffff8817f1a7bd38 ffff8817f1f64000 ffff881792d83840 ffff8817f1e47068
Jul 14 12:06:23 head kernel: ffffffff818adc00 00000000b16b0475 ffff8817f1a7bdd8 ffff8817f1e47000
Jul 14 12:06:23 head kernel: Call Trace:
Jul 14 12:06:23 head kernel: [<ffffffffa01f7d76>] nfsd4_sequence+0xe6/0x610 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:06:23 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:06:23 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:06:23 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:06:23 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:06:23 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:06:23 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:06:23 head kernel: Code: 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 <0f> b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f
Jul 14 12:06:23 head kernel: NMI watchdog: BUG: soft lockup - CPU#14 stuck for 23s! [nfsd:541]
Jul 14 12:06:23 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:06:23 head kernel: CPU: 14 PID: 541 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:06:23 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:06:23 head kernel: task: ffff8817f1b80000 ti: ffff8817f1b7c000 task.ti: ffff8817f1b7c000
Jul 14 12:06:23 head kernel: RIP: 0010:[<ffffffff81554177>] [<ffffffff81554177>] _raw_spin_lock+0x37/0x40
Jul 14 12:06:23 head kernel: RSP: 0018:ffff8817f1b7fc08 EFLAGS: 00000212
Jul 14 12:06:23 head kernel: RAX: 0000000000007ebf RBX: 0000000000000246 RCX: 0000000000000021
Jul 14 12:06:23 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:06:23 head kernel: RBP: ffff8817f1b7fc08 R08: 0000000000000000 R09: 0000000000000000
Jul 14 12:06:23 head kernel: R10: 0000000000000400 R11: ffff8817f1a80220 R12: ffff882ff7b80de0
Jul 14 12:06:23 head kernel: R13: ffff8817f8b44480 R14: 0000000060a0f8c6 R15: ffff8817f95c1f00
Jul 14 12:06:23 head kernel: FS: 0000000000000000(0000) GS:ffff88181fae0000(0000) knlGS:0000000000000000
Jul 14 12:06:23 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:06:23 head kernel: CR2: 00007f235c0d5000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:06:23 head kernel: Stack:
Jul 14 12:06:23 head kernel: ffff8817f1b7fc38 ffffffffa01f4eff ffff8817f1a80240 ffff8817f96ec000
Jul 14 12:06:23 head kernel: ffff8817f1a81068 0000000000000007 ffff8817f1b7fc78 ffffffffa01f4ffa
Jul 14 12:06:23 head kernel: ffff8817f1b7fc98 ffffffff818adc00 ffff8817f1b7fd10 ffff8817f1a81068
Jul 14 12:06:23 head kernel: Call Trace:
Jul 14 12:06:23 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffffa01fa6e0>] nfs4_preprocess_stateid_op+0x190/0x330 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffffa01e779a>] nfsd4_write+0x8a/0x1f0 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:06:23 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:06:23 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:06:23 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:06:23 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:06:23 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:06:23 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:06:23 head kernel: Code: 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 <0f> b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f
Jul 14 12:06:35 head kernel: NMI watchdog: BUG: soft lockup - CPU#11 stuck for 23s! [kworker/u96:2:9888]
Jul 14 12:06:35 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:06:35 head kernel: CPU: 11 PID: 9888 Comm: kworker/u96:2 Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:06:35 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:06:35 head kernel: Workqueue: nfsd4 laundromat_main [nfsd]
Jul 14 12:06:35 head kernel: task: ffff882ff208a840 ti: ffff8818ca7d0000 task.ti: ffff8818ca7d0000
Jul 14 12:06:35 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:06:35 head kernel: RSP: 0018:ffff8818ca7d3d68 EFLAGS: 00000287
Jul 14 12:06:35 head kernel: RAX: 0000000000007264 RBX: 0000000000000000 RCX: 0000000000000022
Jul 14 12:06:35 head kernel: RDX: 000000000000001c RSI: 000000000000005a RDI: ffff8817f96ec130
Jul 14 12:06:35 head kernel: RBP: ffff8818ca7d3d68 R08: ffff8818ca7d0000 R09: 0000000000000001
Jul 14 12:06:35 head kernel: R10: ffff882ffa0c1038 R11: 00000000000ec472 R12: 0000000000000001
Jul 14 12:06:35 head kernel: R13: ffff882ff208ae40 R14: ffff88301f2b0a80 R15: ffff88301f273640
Jul 14 12:06:35 head kernel: FS: 0000000000000000(0000) GS:ffff88301f2a0000(0000) knlGS:0000000000000000
Jul 14 12:06:35 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:06:35 head kernel: CR2: 00007f951cad1000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:06:35 head kernel: Stack:
Jul 14 12:06:35 head kernel: ffff8818ca7d3df8 ffffffffa01f6680 000000000000005a ffff8817f96ec130
Jul 14 12:06:35 head kernel: ffff8817f96ec0a0 ffff8817f96ec000 ffff8818ca7d3dc8 0000000000000292
Jul 14 12:06:35 head kernel: ffff8814ae5ec0c0 ffff8818ca7d3db0 ffff8818ca7d3db0 00000000612153c8
Jul 14 12:06:35 head kernel: Call Trace:
Jul 14 12:06:35 head kernel: [<ffffffffa01f6680>] laundromat_main+0x80/0x480 [nfsd]
Jul 14 12:06:35 head kernel: [<ffffffff8108b7c5>] process_one_work+0x145/0x400
Jul 14 12:06:35 head kernel: [<ffffffff8108bd8b>] worker_thread+0x6b/0x4a0
Jul 14 12:06:35 head kernel: [<ffffffff8108bd20>] ? init_pwq.part.22+0x10/0x10
Jul 14 12:06:35 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:06:35 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:06:35 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:06:35 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:06:35 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:06:41 head pbs_server[30205]: LOG_ERROR::svr_is_request, bad attempt to connect from 192.168.2.236:706 (address not trusted - check entry in server_priv/nodes)
Jul 14 12:06:43 head pbs_server[30205]: LOG_ERROR::svr_is_request, bad attempt to connect from 192.168.2.233:646 (address not trusted - check entry in server_priv/nodes)
Jul 14 12:06:51 head kernel: NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [nfsd:537]
Jul 14 12:06:51 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:06:51 head kernel: CPU: 0 PID: 537 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:06:51 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:06:51 head kernel: task: ffff8817f8a46eb0 ti: ffff8817f1f5c000 task.ti: ffff8817f1f5c000
Jul 14 12:06:51 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:06:51 head kernel: RSP: 0018:ffff8817f1f5fcc8 EFLAGS: 00000297
Jul 14 12:06:51 head kernel: RAX: 0000000000000623 RBX: ffff8817f96ec000 RCX: 00000000000000c1
Jul 14 12:06:51 head kernel: RDX: 00000000000000c0 RSI: 000000000000132a RDI: ffff88010e29cb40
Jul 14 12:06:51 head kernel: RBP: ffff8817f1f5fcc8 R08: ffff8817db320540 R09: ffff88010e306a00
Jul 14 12:06:51 head kernel: R10: ffff88010e29cb40 R11: ffff88010e29c800 R12: ffff882ff904e718
Jul 14 12:06:51 head kernel: R13: ffff8817f1f5fc60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:06:51 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa00000(0000) knlGS:0000000000000000
Jul 14 12:06:51 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:06:51 head kernel: CR2: 00007f23500d8000 CR3: 0000000001811000 CR4: 00000000001407f0
Jul 14 12:06:51 head kernel: Stack:
Jul 14 12:06:51 head kernel: ffff8817f1f5fd48 ffffffffa01f7fc4 ffff8817db320540 ffff88010e306a00
Jul 14 12:06:51 head kernel: ffff88010e29c800 ffff88010e29cb40 ffff88164fcf8000 ffff8817f1e41068
Jul 14 12:06:51 head kernel: 00000000818adc00 00000000f1e7181a ffff8817f1f5fdd8 ffff8817f1e41000
Jul 14 12:06:51 head kernel: Call Trace:
Jul 14 12:06:51 head kernel: [<ffffffffa01f7fc4>] nfsd4_sequence+0x334/0x610 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:06:51 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:06:51 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:06:51 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:06:51 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:06:51 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:06:51 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:06:51 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:06:51 head kernel: NMI watchdog: BUG: soft lockup - CPU#4 stuck for 23s! [nfsd:535]
Jul 14 12:06:51 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:06:51 head kernel: CPU: 4 PID: 535 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:06:51 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:06:51 head kernel: task: ffff8817f8a43250 ti: ffff8817f1d34000 task.ti: ffff8817f1d34000
Jul 14 12:06:51 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:06:51 head kernel: RSP: 0018:ffff8817f1d37cc8 EFLAGS: 00000297
Jul 14 12:06:51 head kernel: RAX: 0000000000004c41 RBX: ffffffffa0183eec RCX: 000000000000001d
Jul 14 12:06:51 head kernel: RDX: 000000000000001c RSI: 00000000000000d0 RDI: ffff8817f96ec130
Jul 14 12:06:51 head kernel: RBP: ffff8817f1d37cc8 R08: ffff8817dfc3e840 R09: ffff8817fab11000
Jul 14 12:06:51 head kernel: R10: 0000000000000004 R11: ffff8817fab13080 R12: ffff882ff904e718
Jul 14 12:06:51 head kernel: R13: ffff8817f1d37c60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:06:51 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa40000(0000) knlGS:0000000000000000
Jul 14 12:06:51 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:06:51 head kernel: CR2: 00007f216c0e2000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:06:51 head kernel: Stack:
Jul 14 12:06:51 head kernel: ffff8817f1d37d48 ffffffffa01f7d76 0000000015de9b97 000000006f7b8096
Jul 14 12:06:51 head kernel: ffff8817f1d37d38 ffff8817f5302000 ffff8817dfc3e840 ffff8817fab11068
Jul 14 12:06:51 head kernel: ffffffff818adc00 000000006f7b8096 ffff8817fa590000 ffff8817fab11000
Jul 14 12:06:51 head kernel: Call Trace:
Jul 14 12:06:51 head kernel: [<ffffffffa01f7d76>] nfsd4_sequence+0xe6/0x610 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:06:51 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:06:51 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:06:51 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:06:51 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:06:51 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:06:51 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:06:51 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:06:51 head kernel: NMI watchdog: BUG: soft lockup - CPU#6 stuck for 23s! [nfsd:539]
Jul 14 12:06:51 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:06:51 head kernel: CPU: 6 PID: 539 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:06:51 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:06:51 head kernel: task: ffff8817f8a45a90 ti: ffff8817f195c000 task.ti: ffff8817f195c000
Jul 14 12:06:51 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:06:51 head kernel: RSP: 0018:ffff8817f195fbc8 EFLAGS: 00000293
Jul 14 12:06:51 head kernel: RAX: 00000000000073af RBX: ffff8801178cc900 RCX: 000000000000001e
Jul 14 12:06:51 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:06:51 head kernel: RBP: ffff8817f195fbc8 R08: 0000000000000000 R09: ffff8817f96ec000
Jul 14 12:06:51 head kernel: R10: ffff8817f96ec000 R11: ffff8817f1e44220 R12: ffffffff8124f74c
Jul 14 12:06:51 head kernel: R13: ffff8817f195fc98 R14: ffff8814ec9b3380 R15: ffff8817f8bc1ce0
Jul 14 12:06:51 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa60000(0000) knlGS:0000000000000000
Jul 14 12:06:51 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:06:51 head kernel: CR2: 00007f23380df000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:06:51 head kernel: Stack:
Jul 14 12:06:51 head kernel: ffff8817f195fbf8 ffffffffa01f4eff ffff8817f1e44244 ffff8817f96ec000
Jul 14 12:06:51 head kernel: ffff8817f1e45068 0000000000000009 ffff8817f195fc38 ffffffffa01f4ffa
Jul 14 12:06:51 head kernel: ffff8817f1f62000 0000000000000009 ffff8817f1e44244 ffff8817f195fcd0
Jul 14 12:06:51 head kernel: Call Trace:
Jul 14 12:06:51 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffffa01f6440>] nfs4_preprocess_seqid_op+0x60/0x1a0 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffffa01dee82>] ? rqst_exp_find+0x92/0x190 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffffa01fb0ee>] nfsd4_close+0x9e/0x380 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:06:51 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:06:51 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:06:51 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:06:51 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:06:51 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:06:51 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:06:51 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:06:51 head kernel: NMI watchdog: BUG: soft lockup - CPU#8 stuck for 23s! [nfsd:538]
Jul 14 12:06:51 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:06:51 head kernel: CPU: 8 PID: 538 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:06:51 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:06:51 head kernel: task: ffff8817f8a464a0 ti: ffff8817f1860000 task.ti: ffff8817f1860000
Jul 14 12:06:51 head kernel: RIP: 0010:[<ffffffff81554177>] [<ffffffff81554177>] _raw_spin_lock+0x37/0x40
Jul 14 12:06:51 head kernel: RSP: 0018:ffff8817f1863c08 EFLAGS: 00000206
Jul 14 12:06:51 head kernel: RAX: 0000000000000da5 RBX: 0000000000000246 RCX: 000000000000001f
Jul 14 12:06:51 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:06:51 head kernel: RBP: ffff8817f1863c08 R08: 0000000000000000 R09: 0000000000000000
Jul 14 12:06:51 head kernel: R10: 0000000000000400 R11: ffff8817f1e42220 R12: ffff882ff7b80de0
Jul 14 12:06:51 head kernel: R13: ffff8817f8b44480 R14: 00000000888ab88f R15: ffff8817f95c1f00
Jul 14 12:06:51 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa80000(0000) knlGS:0000000000000000
Jul 14 12:06:51 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:06:51 head kernel: CR2: 00007f23480ce000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:06:51 head kernel: Stack:
Jul 14 12:06:51 head kernel: ffff8817f1863c38 ffffffffa01f4eff ffff8817f1e42240 ffff8817f96ec000
Jul 14 12:06:51 head kernel: ffff8817f1e43068 0000000000000007 ffff8817f1863c78 ffffffffa01f4ffa
Jul 14 12:06:51 head kernel: ffff8817f1863c98 ffffffff818adc00 ffff8817f1863d10 ffff8817f1e43068
Jul 14 12:06:51 head kernel: Call Trace:
Jul 14 12:06:51 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffffa01fa6e0>] nfs4_preprocess_stateid_op+0x190/0x330 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffffa01e779a>] nfsd4_write+0x8a/0x1f0 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:06:51 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:06:51 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:06:51 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:06:51 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:06:51 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:06:51 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:06:51 head kernel: Code: 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 <0f> b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f
Jul 14 12:06:51 head kernel: NMI watchdog: BUG: soft lockup - CPU#10 stuck for 23s! [nfsd:540]
Jul 14 12:06:51 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:06:51 head kernel: CPU: 10 PID: 540 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:06:51 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:06:51 head kernel: task: ffff8817f8a45080 ti: ffff8817f1a78000 task.ti: ffff8817f1a78000
Jul 14 12:06:51 head kernel: RIP: 0010:[<ffffffff81554177>] [<ffffffff81554177>] _raw_spin_lock+0x37/0x40
Jul 14 12:06:51 head kernel: RSP: 0018:ffff8817f1a7bcc8 EFLAGS: 00000216
Jul 14 12:06:51 head kernel: RAX: 0000000000003bff RBX: ffffffffa0183eec RCX: 0000000000000020
Jul 14 12:06:51 head kernel: RDX: 000000000000001c RSI: 00000000000000d0 RDI: ffff8817f96ec130
Jul 14 12:06:51 head kernel: RBP: ffff8817f1a7bcc8 R08: ffff881792d83840 R09: ffff8817f1e47000
Jul 14 12:06:51 head kernel: R10: 0000000000000004 R11: ffff8817f1e46080 R12: ffff882ff904e718
Jul 14 12:06:51 head kernel: R13: ffff8817f1a7bc60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:06:51 head kernel: FS: 0000000000000000(0000) GS:ffff88181faa0000(0000) knlGS:0000000000000000
Jul 14 12:06:51 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:06:51 head kernel: CR2: 00007f22ec0c6000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:06:51 head kernel: Stack:
Jul 14 12:06:51 head kernel: ffff8817f1a7bd48 ffffffffa01f7d76 0000000015de9b97 00000000b16b0475
Jul 14 12:06:51 head kernel: ffff8817f1a7bd38 ffff8817f1f64000 ffff881792d83840 ffff8817f1e47068
Jul 14 12:06:51 head kernel: ffffffff818adc00 00000000b16b0475 ffff8817f1a7bdd8 ffff8817f1e47000
Jul 14 12:06:51 head kernel: Call Trace:
Jul 14 12:06:51 head kernel: [<ffffffffa01f7d76>] nfsd4_sequence+0xe6/0x610 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:06:51 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:06:51 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:06:51 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:06:51 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:06:51 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:06:51 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:06:51 head kernel: Code: 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 <0f> b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f
Jul 14 12:06:51 head kernel: NMI watchdog: BUG: soft lockup - CPU#14 stuck for 23s! [nfsd:541]
Jul 14 12:06:51 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:06:51 head kernel: CPU: 14 PID: 541 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:06:51 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:06:51 head kernel: task: ffff8817f1b80000 ti: ffff8817f1b7c000 task.ti: ffff8817f1b7c000
Jul 14 12:06:51 head kernel: RIP: 0010:[<ffffffff8155417a>] [<ffffffff8155417a>] _raw_spin_lock+0x3a/0x40
Jul 14 12:06:51 head kernel: RSP: 0018:ffff8817f1b7fc08 EFLAGS: 00000206
Jul 14 12:06:51 head kernel: RAX: 00000000000042b7 RBX: 0000000000000246 RCX: 0000000000000021
Jul 14 12:06:51 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:06:51 head kernel: RBP: ffff8817f1b7fc08 R08: 0000000000000000 R09: 0000000000000000
Jul 14 12:06:51 head kernel: R10: 0000000000000400 R11: ffff8817f1a80220 R12: ffff882ff7b80de0
Jul 14 12:06:51 head kernel: R13: ffff8817f8b44480 R14: 0000000060a0f8c6 R15: ffff8817f95c1f00
Jul 14 12:06:51 head kernel: FS: 0000000000000000(0000) GS:ffff88181fae0000(0000) knlGS:0000000000000000
Jul 14 12:06:51 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:06:51 head kernel: CR2: 00007f235c0d5000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:06:51 head kernel: Stack:
Jul 14 12:06:51 head kernel: ffff8817f1b7fc38 ffffffffa01f4eff ffff8817f1a80240 ffff8817f96ec000
Jul 14 12:06:51 head kernel: ffff8817f1a81068 0000000000000007 ffff8817f1b7fc78 ffffffffa01f4ffa
Jul 14 12:06:51 head kernel: ffff8817f1b7fc98 ffffffff818adc00 ffff8817f1b7fd10 ffff8817f1a81068
Jul 14 12:06:51 head kernel: Call Trace:
Jul 14 12:06:51 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffffa01fa6e0>] nfs4_preprocess_stateid_op+0x190/0x330 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffffa01e779a>] nfsd4_write+0x8a/0x1f0 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:06:51 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:06:51 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:06:51 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:06:51 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:06:51 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:06:51 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:06:51 head kernel: Code: 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 0f b6 17 <38> ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f 1f 44 00
Jul 14 12:07:03 head kernel: NMI watchdog: BUG: soft lockup - CPU#11 stuck for 22s! [kworker/u96:2:9888]
Jul 14 12:07:03 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:07:03 head kernel: CPU: 11 PID: 9888 Comm: kworker/u96:2 Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:07:03 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:07:03 head kernel: Workqueue: nfsd4 laundromat_main [nfsd]
Jul 14 12:07:03 head kernel: task: ffff882ff208a840 ti: ffff8818ca7d0000 task.ti: ffff8818ca7d0000
Jul 14 12:07:03 head kernel: RIP: 0010:[<ffffffff81554177>] [<ffffffff81554177>] _raw_spin_lock+0x37/0x40
Jul 14 12:07:03 head kernel: RSP: 0018:ffff8818ca7d3d68 EFLAGS: 00000202
Jul 14 12:07:03 head kernel: RAX: 0000000000000afe RBX: 0000000000000000 RCX: 0000000000000022
Jul 14 12:07:03 head kernel: RDX: 000000000000001c RSI: 000000000000005a RDI: ffff8817f96ec130
Jul 14 12:07:03 head kernel: RBP: ffff8818ca7d3d68 R08: ffff8818ca7d0000 R09: 0000000000000001
Jul 14 12:07:03 head kernel: R10: ffff882ffa0c1038 R11: 00000000000ec472 R12: 0000000000000001
Jul 14 12:07:03 head kernel: R13: ffff882ff208ae40 R14: ffff88301f2b0a80 R15: ffff88301f273640
Jul 14 12:07:03 head kernel: FS: 0000000000000000(0000) GS:ffff88301f2a0000(0000) knlGS:0000000000000000
Jul 14 12:07:03 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:07:03 head kernel: CR2: 00007f951cad1000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:07:03 head kernel: Stack:
Jul 14 12:07:03 head kernel: ffff8818ca7d3df8 ffffffffa01f6680 000000000000005a ffff8817f96ec130
Jul 14 12:07:03 head kernel: ffff8817f96ec0a0 ffff8817f96ec000 ffff8818ca7d3dc8 0000000000000292
Jul 14 12:07:03 head kernel: ffff8814ae5ec0c0 ffff8818ca7d3db0 ffff8818ca7d3db0 00000000612153c8
Jul 14 12:07:03 head kernel: Call Trace:
Jul 14 12:07:03 head kernel: [<ffffffffa01f6680>] laundromat_main+0x80/0x480 [nfsd]
Jul 14 12:07:03 head kernel: [<ffffffff8108b7c5>] process_one_work+0x145/0x400
Jul 14 12:07:03 head kernel: [<ffffffff8108bd8b>] worker_thread+0x6b/0x4a0
Jul 14 12:07:03 head kernel: [<ffffffff8108bd20>] ? init_pwq.part.22+0x10/0x10
Jul 14 12:07:03 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:07:03 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:07:03 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:07:03 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:07:03 head kernel: Code: 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 <0f> b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f
Jul 14 12:07:19 head kernel: NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [nfsd:537]
Jul 14 12:07:19 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:07:19 head kernel: CPU: 0 PID: 537 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:07:19 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:07:19 head kernel: task: ffff8817f8a46eb0 ti: ffff8817f1f5c000 task.ti: ffff8817f1f5c000
Jul 14 12:07:19 head kernel: RIP: 0010:[<ffffffff8155417a>] [<ffffffff8155417a>] _raw_spin_lock+0x3a/0x40
Jul 14 12:07:19 head kernel: RSP: 0018:ffff8817f1f5fcc8 EFLAGS: 00000206
Jul 14 12:07:19 head kernel: RAX: 0000000000003baa RBX: ffff8817f96ec000 RCX: 00000000000000c1
Jul 14 12:07:19 head kernel: RDX: 00000000000000c0 RSI: 000000000000132a RDI: ffff88010e29cb40
Jul 14 12:07:19 head kernel: RBP: ffff8817f1f5fcc8 R08: ffff8817db320540 R09: ffff88010e306a00
Jul 14 12:07:19 head kernel: R10: ffff88010e29cb40 R11: ffff88010e29c800 R12: ffff882ff904e718
Jul 14 12:07:19 head kernel: R13: ffff8817f1f5fc60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:07:19 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa00000(0000) knlGS:0000000000000000
Jul 14 12:07:19 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:07:19 head kernel: CR2: 00007f23500d8000 CR3: 0000000001811000 CR4: 00000000001407f0
Jul 14 12:07:19 head kernel: Stack:
Jul 14 12:07:19 head kernel: ffff8817f1f5fd48 ffffffffa01f7fc4 ffff8817db320540 ffff88010e306a00
Jul 14 12:07:19 head kernel: ffff88010e29c800 ffff88010e29cb40 ffff88164fcf8000 ffff8817f1e41068
Jul 14 12:07:19 head kernel: 00000000818adc00 00000000f1e7181a ffff8817f1f5fdd8 ffff8817f1e41000
Jul 14 12:07:19 head kernel: Call Trace:
Jul 14 12:07:19 head kernel: [<ffffffffa01f7fc4>] nfsd4_sequence+0x334/0x610 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:07:19 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:07:19 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:07:19 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:07:19 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:07:19 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:07:19 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:07:19 head kernel: Code: 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 0f b6 17 <38> ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f 1f 44 00
Jul 14 12:07:19 head kernel: NMI watchdog: BUG: soft lockup - CPU#4 stuck for 23s! [nfsd:535]
Jul 14 12:07:19 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:07:19 head kernel: CPU: 4 PID: 535 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:07:19 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:07:19 head kernel: task: ffff8817f8a43250 ti: ffff8817f1d34000 task.ti: ffff8817f1d34000
Jul 14 12:07:19 head kernel: RIP: 0010:[<ffffffff8155417a>] [<ffffffff8155417a>] _raw_spin_lock+0x3a/0x40
Jul 14 12:07:19 head kernel: RSP: 0018:ffff8817f1d37cc8 EFLAGS: 00000202
Jul 14 12:07:19 head kernel: RAX: 0000000000005329 RBX: ffffffffa0183eec RCX: 000000000000001d
Jul 14 12:07:19 head kernel: RDX: 000000000000001c RSI: 00000000000000d0 RDI: ffff8817f96ec130
Jul 14 12:07:19 head kernel: RBP: ffff8817f1d37cc8 R08: ffff8817dfc3e840 R09: ffff8817fab11000
Jul 14 12:07:19 head kernel: R10: 0000000000000004 R11: ffff8817fab13080 R12: ffff882ff904e718
Jul 14 12:07:19 head kernel: R13: ffff8817f1d37c60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:07:19 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa40000(0000) knlGS:0000000000000000
Jul 14 12:07:19 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:07:19 head kernel: CR2: 00007f216c0e2000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:07:19 head kernel: Stack:
Jul 14 12:07:19 head kernel: ffff8817f1d37d48 ffffffffa01f7d76 0000000015de9b97 000000006f7b8096
Jul 14 12:07:19 head kernel: ffff8817f1d37d38 ffff8817f5302000 ffff8817dfc3e840 ffff8817fab11068
Jul 14 12:07:19 head kernel: ffffffff818adc00 000000006f7b8096 ffff8817fa590000 ffff8817fab11000
Jul 14 12:07:19 head kernel: Call Trace:
Jul 14 12:07:19 head kernel: [<ffffffffa01f7d76>] nfsd4_sequence+0xe6/0x610 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:07:19 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:07:19 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:07:19 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:07:19 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:07:19 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:07:19 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:07:19 head kernel: Code: 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 0f b6 17 <38> ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f 1f 44 00
Jul 14 12:07:19 head kernel: NMI watchdog: BUG: soft lockup - CPU#6 stuck for 23s! [nfsd:539]
Jul 14 12:07:19 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:07:19 head kernel: CPU: 6 PID: 539 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:07:19 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:07:19 head kernel: task: ffff8817f8a45a90 ti: ffff8817f195c000 task.ti: ffff8817f195c000
Jul 14 12:07:19 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:07:19 head kernel: RSP: 0018:ffff8817f195fbc8 EFLAGS: 00000293
Jul 14 12:07:19 head kernel: RAX: 0000000000002086 RBX: ffff8801178cc900 RCX: 000000000000001e
Jul 14 12:07:19 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:07:19 head kernel: RBP: ffff8817f195fbc8 R08: 0000000000000000 R09: ffff8817f96ec000
Jul 14 12:07:19 head kernel: R10: ffff8817f96ec000 R11: ffff8817f1e44220 R12: ffffffff8124f74c
Jul 14 12:07:19 head kernel: R13: ffff8817f195fc98 R14: ffff8814ec9b3380 R15: ffff8817f8bc1ce0
Jul 14 12:07:19 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa60000(0000) knlGS:0000000000000000
Jul 14 12:07:19 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:07:19 head kernel: CR2: 00007f23380df000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:07:19 head kernel: Stack:
Jul 14 12:07:19 head kernel: ffff8817f195fbf8 ffffffffa01f4eff ffff8817f1e44244 ffff8817f96ec000
Jul 14 12:07:19 head kernel: ffff8817f1e45068 0000000000000009 ffff8817f195fc38 ffffffffa01f4ffa
Jul 14 12:07:19 head kernel: ffff8817f1f62000 0000000000000009 ffff8817f1e44244 ffff8817f195fcd0
Jul 14 12:07:19 head kernel: Call Trace:
Jul 14 12:07:19 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffffa01f6440>] nfs4_preprocess_seqid_op+0x60/0x1a0 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffffa01dee82>] ? rqst_exp_find+0x92/0x190 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffffa01fb0ee>] nfsd4_close+0x9e/0x380 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:07:19 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:07:19 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:07:19 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:07:19 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:07:19 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:07:19 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:07:19 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:07:19 head kernel: NMI watchdog: BUG: soft lockup - CPU#8 stuck for 23s! [nfsd:538]
Jul 14 12:07:19 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:07:19 head kernel: CPU: 8 PID: 538 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:07:19 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:07:19 head kernel: task: ffff8817f8a464a0 ti: ffff8817f1860000 task.ti: ffff8817f1860000
Jul 14 12:07:19 head kernel: RIP: 0010:[<ffffffff81554177>] [<ffffffff81554177>] _raw_spin_lock+0x37/0x40
Jul 14 12:07:19 head kernel: RSP: 0018:ffff8817f1863c08 EFLAGS: 00000202
Jul 14 12:07:19 head kernel: RAX: 0000000000002d9d RBX: 0000000000000246 RCX: 000000000000001f
Jul 14 12:07:19 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:07:19 head kernel: RBP: ffff8817f1863c08 R08: 0000000000000000 R09: 0000000000000000
Jul 14 12:07:19 head kernel: R10: 0000000000000400 R11: ffff8817f1e42220 R12: ffff882ff7b80de0
Jul 14 12:07:19 head kernel: R13: ffff8817f8b44480 R14: 00000000888ab88f R15: ffff8817f95c1f00
Jul 14 12:07:19 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa80000(0000) knlGS:0000000000000000
Jul 14 12:07:19 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:07:19 head kernel: CR2: 00007f23480ce000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:07:19 head kernel: Stack:
Jul 14 12:07:19 head kernel: ffff8817f1863c38 ffffffffa01f4eff ffff8817f1e42240 ffff8817f96ec000
Jul 14 12:07:19 head kernel: ffff8817f1e43068 0000000000000007 ffff8817f1863c78 ffffffffa01f4ffa
Jul 14 12:07:19 head kernel: ffff8817f1863c98 ffffffff818adc00 ffff8817f1863d10 ffff8817f1e43068
Jul 14 12:07:19 head kernel: Call Trace:
Jul 14 12:07:19 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffffa01fa6e0>] nfs4_preprocess_stateid_op+0x190/0x330 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffffa01e779a>] nfsd4_write+0x8a/0x1f0 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:07:19 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:07:19 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:07:19 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:07:19 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:07:19 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:07:19 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:07:19 head kernel: Code: 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 <0f> b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f
Jul 14 12:07:19 head kernel: NMI watchdog: BUG: soft lockup - CPU#10 stuck for 23s! [nfsd:540]
Jul 14 12:07:19 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:07:19 head kernel: CPU: 10 PID: 540 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:07:19 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:07:19 head kernel: task: ffff8817f8a45080 ti: ffff8817f1a78000 task.ti: ffff8817f1a78000
Jul 14 12:07:19 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:07:19 head kernel: RSP: 0018:ffff8817f1a7bcc8 EFLAGS: 00000287
Jul 14 12:07:19 head kernel: RAX: 000000000000165e RBX: ffffffffa0183eec RCX: 0000000000000020
Jul 14 12:07:19 head kernel: RDX: 000000000000001c RSI: 00000000000000d0 RDI: ffff8817f96ec130
Jul 14 12:07:19 head kernel: RBP: ffff8817f1a7bcc8 R08: ffff881792d83840 R09: ffff8817f1e47000
Jul 14 12:07:19 head kernel: R10: 0000000000000004 R11: ffff8817f1e46080 R12: ffff882ff904e718
Jul 14 12:07:19 head kernel: R13: ffff8817f1a7bc60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:07:19 head kernel: FS: 0000000000000000(0000) GS:ffff88181faa0000(0000) knlGS:0000000000000000
Jul 14 12:07:19 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:07:19 head kernel: CR2: 00007f22ec0c6000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:07:19 head kernel: Stack:
Jul 14 12:07:19 head kernel: ffff8817f1a7bd48 ffffffffa01f7d76 0000000015de9b97 00000000b16b0475
Jul 14 12:07:19 head kernel: ffff8817f1a7bd38 ffff8817f1f64000 ffff881792d83840 ffff8817f1e47068
Jul 14 12:07:19 head kernel: ffffffff818adc00 00000000b16b0475 ffff8817f1a7bdd8 ffff8817f1e47000
Jul 14 12:07:19 head kernel: Call Trace:
Jul 14 12:07:19 head kernel: [<ffffffffa01f7d76>] nfsd4_sequence+0xe6/0x610 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:07:19 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:07:19 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:07:19 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:07:19 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:07:19 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:07:19 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:07:19 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:07:19 head kernel: NMI watchdog: BUG: soft lockup - CPU#14 stuck for 22s! [nfsd:541]
Jul 14 12:07:19 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:07:19 head kernel: CPU: 14 PID: 541 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:07:19 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:07:19 head kernel: task: ffff8817f1b80000 ti: ffff8817f1b7c000 task.ti: ffff8817f1b7c000
Jul 14 12:07:19 head kernel: RIP: 0010:[<ffffffff81554177>] [<ffffffff81554177>] _raw_spin_lock+0x37/0x40
Jul 14 12:07:19 head kernel: RSP: 0018:ffff8817f1b7fc08 EFLAGS: 00000206
Jul 14 12:07:19 head kernel: RAX: 0000000000001c27 RBX: 0000000000000246 RCX: 0000000000000021
Jul 14 12:07:19 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:07:19 head kernel: RBP: ffff8817f1b7fc08 R08: 0000000000000000 R09: 0000000000000000
Jul 14 12:07:19 head kernel: R10: 0000000000000400 R11: ffff8817f1a80220 R12: ffff882ff7b80de0
Jul 14 12:07:19 head kernel: R13: ffff8817f8b44480 R14: 0000000060a0f8c6 R15: ffff8817f95c1f00
Jul 14 12:07:19 head kernel: FS: 0000000000000000(0000) GS:ffff88181fae0000(0000) knlGS:0000000000000000
Jul 14 12:07:19 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:07:19 head kernel: CR2: 00007f235c0d5000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:07:19 head kernel: Stack:
Jul 14 12:07:19 head kernel: ffff8817f1b7fc38 ffffffffa01f4eff ffff8817f1a80240 ffff8817f96ec000
Jul 14 12:07:19 head kernel: ffff8817f1a81068 0000000000000007 ffff8817f1b7fc78 ffffffffa01f4ffa
Jul 14 12:07:19 head kernel: ffff8817f1b7fc98 ffffffff818adc00 ffff8817f1b7fd10 ffff8817f1a81068
Jul 14 12:07:19 head kernel: Call Trace:
Jul 14 12:07:19 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffffa01fa6e0>] nfs4_preprocess_stateid_op+0x190/0x330 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffffa01e779a>] nfsd4_write+0x8a/0x1f0 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:07:19 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:07:19 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:07:19 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:07:19 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:07:19 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:07:19 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:07:19 head kernel: Code: 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 <0f> b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f
Jul 14 12:07:26 head pbs_server[30205]: LOG_ERROR::svr_is_request, bad attempt to connect from 192.168.2.236:706 (address not trusted - check entry in server_priv/nodes)
Jul 14 12:07:29 head pbs_server[30205]: LOG_ERROR::svr_is_request, bad attempt to connect from 192.168.2.233:646 (address not trusted - check entry in server_priv/nodes)
Jul 14 12:07:31 head kernel: NMI watchdog: BUG: soft lockup - CPU#11 stuck for 22s! [kworker/u96:2:9888]
Jul 14 12:07:31 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:07:31 head kernel: CPU: 11 PID: 9888 Comm: kworker/u96:2 Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:07:31 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:07:31 head kernel: Workqueue: nfsd4 laundromat_main [nfsd]
Jul 14 12:07:31 head kernel: task: ffff882ff208a840 ti: ffff8818ca7d0000 task.ti: ffff8818ca7d0000
Jul 14 12:07:31 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:07:31 head kernel: RSP: 0018:ffff8818ca7d3d68 EFLAGS: 00000287
Jul 14 12:07:31 head kernel: RAX: 00000000000066c9 RBX: 0000000000000000 RCX: 0000000000000022
Jul 14 12:07:31 head kernel: RDX: 000000000000001c RSI: 000000000000005a RDI: ffff8817f96ec130
Jul 14 12:07:31 head kernel: RBP: ffff8818ca7d3d68 R08: ffff8818ca7d0000 R09: 0000000000000001
Jul 14 12:07:31 head kernel: R10: ffff882ffa0c1038 R11: 00000000000ec472 R12: 0000000000000001
Jul 14 12:07:31 head kernel: R13: ffff882ff208ae40 R14: ffff88301f2b0a80 R15: ffff88301f273640
Jul 14 12:07:31 head kernel: FS: 0000000000000000(0000) GS:ffff88301f2a0000(0000) knlGS:0000000000000000
Jul 14 12:07:31 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:07:31 head kernel: CR2: 00007f951cad1000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:07:31 head kernel: Stack:
Jul 14 12:07:31 head kernel: ffff8818ca7d3df8 ffffffffa01f6680 000000000000005a ffff8817f96ec130
Jul 14 12:07:31 head kernel: ffff8817f96ec0a0 ffff8817f96ec000 ffff8818ca7d3dc8 0000000000000292
Jul 14 12:07:31 head kernel: ffff8814ae5ec0c0 ffff8818ca7d3db0 ffff8818ca7d3db0 00000000612153c8
Jul 14 12:07:31 head kernel: Call Trace:
Jul 14 12:07:31 head kernel: [<ffffffffa01f6680>] laundromat_main+0x80/0x480 [nfsd]
Jul 14 12:07:31 head kernel: [<ffffffff8108b7c5>] process_one_work+0x145/0x400
Jul 14 12:07:31 head kernel: [<ffffffff8108bd8b>] worker_thread+0x6b/0x4a0
Jul 14 12:07:31 head kernel: [<ffffffff8108bd20>] ? init_pwq.part.22+0x10/0x10
Jul 14 12:07:31 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:07:31 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:07:31 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:07:31 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:07:31 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:07:47 head kernel: NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [nfsd:537]
Jul 14 12:07:47 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:07:47 head kernel: CPU: 0 PID: 537 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:07:47 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:07:47 head kernel: task: ffff8817f8a46eb0 ti: ffff8817f1f5c000 task.ti: ffff8817f1f5c000
Jul 14 12:07:47 head kernel: RIP: 0010:[<ffffffff81554177>] [<ffffffff81554177>] _raw_spin_lock+0x37/0x40
Jul 14 12:07:47 head kernel: RSP: 0018:ffff8817f1f5fcc8 EFLAGS: 00000206
Jul 14 12:07:47 head kernel: RAX: 0000000000004e24 RBX: ffff8817f96ec000 RCX: 00000000000000c1
Jul 14 12:07:47 head kernel: RDX: 00000000000000c0 RSI: 000000000000132a RDI: ffff88010e29cb40
Jul 14 12:07:47 head kernel: RBP: ffff8817f1f5fcc8 R08: ffff8817db320540 R09: ffff88010e306a00
Jul 14 12:07:47 head kernel: R10: ffff88010e29cb40 R11: ffff88010e29c800 R12: ffff882ff904e718
Jul 14 12:07:47 head kernel: R13: ffff8817f1f5fc60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:07:47 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa00000(0000) knlGS:0000000000000000
Jul 14 12:07:47 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:07:47 head kernel: CR2: 00007f23500d8000 CR3: 0000000001811000 CR4: 00000000001407f0
Jul 14 12:07:47 head kernel: Stack:
Jul 14 12:07:47 head kernel: ffff8817f1f5fd48 ffffffffa01f7fc4 ffff8817db320540 ffff88010e306a00
Jul 14 12:07:47 head kernel: ffff88010e29c800 ffff88010e29cb40 ffff88164fcf8000 ffff8817f1e41068
Jul 14 12:07:47 head kernel: 00000000818adc00 00000000f1e7181a ffff8817f1f5fdd8 ffff8817f1e41000
Jul 14 12:07:47 head kernel: Call Trace:
Jul 14 12:07:47 head kernel: [<ffffffffa01f7fc4>] nfsd4_sequence+0x334/0x610 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:07:47 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:07:47 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:07:47 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:07:47 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:07:47 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:07:47 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:07:47 head kernel: Code: 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 <0f> b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f
Jul 14 12:07:47 head kernel: NMI watchdog: BUG: soft lockup - CPU#4 stuck for 23s! [nfsd:535]
Jul 14 12:07:47 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:07:47 head kernel: CPU: 4 PID: 535 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:07:47 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:07:47 head kernel: task: ffff8817f8a43250 ti: ffff8817f1d34000 task.ti: ffff8817f1d34000
Jul 14 12:07:47 head kernel: RIP: 0010:[<ffffffff8155417a>] [<ffffffff8155417a>] _raw_spin_lock+0x3a/0x40
Jul 14 12:07:47 head kernel: RSP: 0018:ffff8817f1d37cc8 EFLAGS: 00000202
Jul 14 12:07:47 head kernel: RAX: 0000000000002dbc RBX: ffffffffa0183eec RCX: 000000000000001d
Jul 14 12:07:47 head kernel: RDX: 000000000000001c RSI: 00000000000000d0 RDI: ffff8817f96ec130
Jul 14 12:07:47 head kernel: RBP: ffff8817f1d37cc8 R08: ffff8817dfc3e840 R09: ffff8817fab11000
Jul 14 12:07:47 head kernel: R10: 0000000000000004 R11: ffff8817fab13080 R12: ffff882ff904e718
Jul 14 12:07:47 head kernel: R13: ffff8817f1d37c60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:07:47 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa40000(0000) knlGS:0000000000000000
Jul 14 12:07:47 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:07:47 head kernel: CR2: 00007f216c0e2000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:07:47 head kernel: Stack:
Jul 14 12:07:47 head kernel: ffff8817f1d37d48 ffffffffa01f7d76 0000000015de9b97 000000006f7b8096
Jul 14 12:07:47 head kernel: ffff8817f1d37d38 ffff8817f5302000 ffff8817dfc3e840 ffff8817fab11068
Jul 14 12:07:47 head kernel: ffffffff818adc00 000000006f7b8096 ffff8817fa590000 ffff8817fab11000
Jul 14 12:07:47 head kernel: Call Trace:
Jul 14 12:07:47 head kernel: [<ffffffffa01f7d76>] nfsd4_sequence+0xe6/0x610 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:07:47 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:07:47 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:07:47 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:07:47 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:07:47 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:07:47 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:07:47 head kernel: Code: 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 0f b6 17 <38> ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f 1f 44 00
Jul 14 12:07:47 head kernel: NMI watchdog: BUG: soft lockup - CPU#6 stuck for 23s! [nfsd:539]
Jul 14 12:07:47 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:07:47 head kernel: CPU: 6 PID: 539 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:07:47 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:07:47 head kernel: task: ffff8817f8a45a90 ti: ffff8817f195c000 task.ti: ffff8817f195c000
Jul 14 12:07:47 head kernel: RIP: 0010:[<ffffffff81554177>] [<ffffffff81554177>] _raw_spin_lock+0x37/0x40
Jul 14 12:07:47 head kernel: RSP: 0018:ffff8817f195fbc8 EFLAGS: 00000206
Jul 14 12:07:47 head kernel: RAX: 00000000000040a9 RBX: ffff8801178cc900 RCX: 000000000000001e
Jul 14 12:07:47 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:07:47 head kernel: RBP: ffff8817f195fbc8 R08: 0000000000000000 R09: ffff8817f96ec000
Jul 14 12:07:47 head kernel: R10: ffff8817f96ec000 R11: ffff8817f1e44220 R12: ffffffff8124f74c
Jul 14 12:07:47 head kernel: R13: ffff8817f195fc98 R14: ffff8814ec9b3380 R15: ffff8817f8bc1ce0
Jul 14 12:07:47 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa60000(0000) knlGS:0000000000000000
Jul 14 12:07:47 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:07:47 head kernel: CR2: 00007f23380df000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:07:47 head kernel: Stack:
Jul 14 12:07:47 head kernel: ffff8817f195fbf8 ffffffffa01f4eff ffff8817f1e44244 ffff8817f96ec000
Jul 14 12:07:47 head kernel: ffff8817f1e45068 0000000000000009 ffff8817f195fc38 ffffffffa01f4ffa
Jul 14 12:07:47 head kernel: ffff8817f1f62000 0000000000000009 ffff8817f1e44244 ffff8817f195fcd0
Jul 14 12:07:47 head kernel: Call Trace:
Jul 14 12:07:47 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffffa01f6440>] nfs4_preprocess_seqid_op+0x60/0x1a0 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffffa01dee82>] ? rqst_exp_find+0x92/0x190 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffffa01fb0ee>] nfsd4_close+0x9e/0x380 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:07:47 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:07:47 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:07:47 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:07:47 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:07:47 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:07:47 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:07:47 head kernel: Code: 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 <0f> b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f
Jul 14 12:07:47 head kernel: NMI watchdog: BUG: soft lockup - CPU#8 stuck for 23s! [nfsd:538]
Jul 14 12:07:47 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:07:47 head kernel: CPU: 8 PID: 538 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:07:47 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:07:47 head kernel: task: ffff8817f8a464a0 ti: ffff8817f1860000 task.ti: ffff8817f1860000
Jul 14 12:07:47 head kernel: RIP: 0010:[<ffffffff81554177>] [<ffffffff81554177>] _raw_spin_lock+0x37/0x40
Jul 14 12:07:47 head kernel: RSP: 0018:ffff8817f1863c08 EFLAGS: 00000206
Jul 14 12:07:47 head kernel: RAX: 00000000000015c9 RBX: 0000000000000246 RCX: 000000000000001f
Jul 14 12:07:47 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:07:47 head kernel: RBP: ffff8817f1863c08 R08: 0000000000000000 R09: 0000000000000000
Jul 14 12:07:47 head kernel: R10: 0000000000000400 R11: ffff8817f1e42220 R12: ffff882ff7b80de0
Jul 14 12:07:47 head kernel: R13: ffff8817f8b44480 R14: 00000000888ab88f R15: ffff8817f95c1f00
Jul 14 12:07:47 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa80000(0000) knlGS:0000000000000000
Jul 14 12:07:47 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:07:47 head kernel: CR2: 00007f23480ce000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:07:47 head kernel: Stack:
Jul 14 12:07:47 head kernel: ffff8817f1863c38 ffffffffa01f4eff ffff8817f1e42240 ffff8817f96ec000
Jul 14 12:07:47 head kernel: ffff8817f1e43068 0000000000000007 ffff8817f1863c78 ffffffffa01f4ffa
Jul 14 12:07:47 head kernel: ffff8817f1863c98 ffffffff818adc00 ffff8817f1863d10 ffff8817f1e43068
Jul 14 12:07:47 head kernel: Call Trace:
Jul 14 12:07:47 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffffa01fa6e0>] nfs4_preprocess_stateid_op+0x190/0x330 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffffa01e779a>] nfsd4_write+0x8a/0x1f0 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:07:47 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:07:47 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:07:47 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:07:47 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:07:47 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:07:47 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:07:47 head kernel: Code: 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 <0f> b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f
Jul 14 12:07:47 head kernel: NMI watchdog: BUG: soft lockup - CPU#10 stuck for 22s! [nfsd:540]
Jul 14 12:07:47 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:07:47 head kernel: CPU: 10 PID: 540 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:07:47 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:07:47 head kernel: task: ffff8817f8a45080 ti: ffff8817f1a78000 task.ti: ffff8817f1a78000
Jul 14 12:07:47 head kernel: RIP: 0010:[<ffffffff8155417a>] [<ffffffff8155417a>] _raw_spin_lock+0x3a/0x40
Jul 14 12:07:47 head kernel: RSP: 0018:ffff8817f1a7bcc8 EFLAGS: 00000206
Jul 14 12:07:47 head kernel: RAX: 0000000000006496 RBX: ffffffffa0183eec RCX: 0000000000000020
Jul 14 12:07:47 head kernel: RDX: 000000000000001c RSI: 00000000000000d0 RDI: ffff8817f96ec130
Jul 14 12:07:47 head kernel: RBP: ffff8817f1a7bcc8 R08: ffff881792d83840 R09: ffff8817f1e47000
Jul 14 12:07:47 head kernel: R10: 0000000000000004 R11: ffff8817f1e46080 R12: ffff882ff904e718
Jul 14 12:07:47 head kernel: R13: ffff8817f1a7bc60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:07:47 head kernel: FS: 0000000000000000(0000) GS:ffff88181faa0000(0000) knlGS:0000000000000000
Jul 14 12:07:47 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:07:47 head kernel: CR2: 00007f22ec0c6000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:07:47 head kernel: Stack:
Jul 14 12:07:47 head kernel: ffff8817f1a7bd48 ffffffffa01f7d76 0000000015de9b97 00000000b16b0475
Jul 14 12:07:47 head kernel: ffff8817f1a7bd38 ffff8817f1f64000 ffff881792d83840 ffff8817f1e47068
Jul 14 12:07:47 head kernel: ffffffff818adc00 00000000b16b0475 ffff8817f1a7bdd8 ffff8817f1e47000
Jul 14 12:07:47 head kernel: Call Trace:
Jul 14 12:07:47 head kernel: [<ffffffffa01f7d76>] nfsd4_sequence+0xe6/0x610 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:07:47 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:07:47 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:07:47 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:07:47 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:07:47 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:07:47 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:07:47 head kernel: Code: 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 0f b6 17 <38> ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f 1f 44 00
Jul 14 12:07:47 head kernel: NMI watchdog: BUG: soft lockup - CPU#14 stuck for 22s! [nfsd:541]
Jul 14 12:07:47 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:07:47 head kernel: CPU: 14 PID: 541 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:07:47 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:07:47 head kernel: task: ffff8817f1b80000 ti: ffff8817f1b7c000 task.ti: ffff8817f1b7c000
Jul 14 12:07:47 head kernel: RIP: 0010:[<ffffffff8155417a>] [<ffffffff8155417a>] _raw_spin_lock+0x3a/0x40
Jul 14 12:07:47 head kernel: RSP: 0018:ffff8817f1b7fc08 EFLAGS: 00000206
Jul 14 12:07:47 head kernel: RAX: 0000000000000eed RBX: 0000000000000246 RCX: 0000000000000021
Jul 14 12:07:47 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:07:47 head kernel: RBP: ffff8817f1b7fc08 R08: 0000000000000000 R09: 0000000000000000
Jul 14 12:07:47 head kernel: R10: 0000000000000400 R11: ffff8817f1a80220 R12: ffff882ff7b80de0
Jul 14 12:07:47 head kernel: R13: ffff8817f8b44480 R14: 0000000060a0f8c6 R15: ffff8817f95c1f00
Jul 14 12:07:47 head kernel: FS: 0000000000000000(0000) GS:ffff88181fae0000(0000) knlGS:0000000000000000
Jul 14 12:07:47 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:07:47 head kernel: CR2: 00007f235c0d5000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:07:47 head kernel: Stack:
Jul 14 12:07:47 head kernel: ffff8817f1b7fc38 ffffffffa01f4eff ffff8817f1a80240 ffff8817f96ec000
Jul 14 12:07:47 head kernel: ffff8817f1a81068 0000000000000007 ffff8817f1b7fc78 ffffffffa01f4ffa
Jul 14 12:07:47 head kernel: ffff8817f1b7fc98 ffffffff818adc00 ffff8817f1b7fd10 ffff8817f1a81068
Jul 14 12:07:47 head kernel: Call Trace:
Jul 14 12:07:47 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffffa01fa6e0>] nfs4_preprocess_stateid_op+0x190/0x330 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffffa01e779a>] nfsd4_write+0x8a/0x1f0 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:07:47 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:07:47 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:07:47 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:07:47 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:07:47 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:07:47 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:07:47 head kernel: Code: 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 0f b6 17 <38> ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f 1f 44 00
Jul 14 12:07:59 head kernel: NMI watchdog: BUG: soft lockup - CPU#11 stuck for 22s! [kworker/u96:2:9888]
Jul 14 12:07:59 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:07:59 head kernel: CPU: 11 PID: 9888 Comm: kworker/u96:2 Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:07:59 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:07:59 head kernel: Workqueue: nfsd4 laundromat_main [nfsd]
Jul 14 12:07:59 head kernel: task: ffff882ff208a840 ti: ffff8818ca7d0000 task.ti: ffff8818ca7d0000
Jul 14 12:07:59 head kernel: RIP: 0010:[<ffffffff81554177>] [<ffffffff81554177>] _raw_spin_lock+0x37/0x40
Jul 14 12:07:59 head kernel: RSP: 0018:ffff8818ca7d3d68 EFLAGS: 00000202
Jul 14 12:07:59 head kernel: RAX: 0000000000001d6d RBX: 0000000000000000 RCX: 0000000000000022
Jul 14 12:07:59 head kernel: RDX: 000000000000001c RSI: 000000000000005a RDI: ffff8817f96ec130
Jul 14 12:07:59 head kernel: RBP: ffff8818ca7d3d68 R08: ffff8818ca7d0000 R09: 0000000000000001
Jul 14 12:07:59 head kernel: R10: ffff882ffa0c1038 R11: 00000000000ec472 R12: 0000000000000001
Jul 14 12:07:59 head kernel: R13: ffff882ff208ae40 R14: ffff88301f2b0a80 R15: ffff88301f273640
Jul 14 12:07:59 head kernel: FS: 0000000000000000(0000) GS:ffff88301f2a0000(0000) knlGS:0000000000000000
Jul 14 12:07:59 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:07:59 head kernel: CR2: 00007f951cad1000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:07:59 head kernel: Stack:
Jul 14 12:07:59 head kernel: ffff8818ca7d3df8 ffffffffa01f6680 000000000000005a ffff8817f96ec130
Jul 14 12:07:59 head kernel: ffff8817f96ec0a0 ffff8817f96ec000 ffff8818ca7d3dc8 0000000000000292
Jul 14 12:07:59 head kernel: ffff8814ae5ec0c0 ffff8818ca7d3db0 ffff8818ca7d3db0 00000000612153c8
Jul 14 12:07:59 head kernel: Call Trace:
Jul 14 12:07:59 head kernel: [<ffffffffa01f6680>] laundromat_main+0x80/0x480 [nfsd]
Jul 14 12:07:59 head kernel: [<ffffffff8108b7c5>] process_one_work+0x145/0x400
Jul 14 12:07:59 head kernel: [<ffffffff8108bd8b>] worker_thread+0x6b/0x4a0
Jul 14 12:07:59 head kernel: [<ffffffff8108bd20>] ? init_pwq.part.22+0x10/0x10
Jul 14 12:07:59 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:07:59 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:07:59 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:07:59 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:07:59 head kernel: Code: 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 <0f> b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f
Jul 14 12:08:11 head pbs_server[30205]: LOG_ERROR::svr_is_request, bad attempt to connect from 192.168.2.236:706 (address not trusted - check entry in server_priv/nodes)
Jul 14 12:08:13 head pbs_server[30205]: LOG_ERROR::svr_is_request, bad attempt to connect from 192.168.2.233:646 (address not trusted - check entry in server_priv/nodes)
Jul 14 12:08:15 head kernel: NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [nfsd:537]
Jul 14 12:08:15 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:08:15 head kernel: CPU: 0 PID: 537 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:08:15 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:08:15 head kernel: task: ffff8817f8a46eb0 ti: ffff8817f1f5c000 task.ti: ffff8817f1f5c000
Jul 14 12:08:15 head kernel: RIP: 0010:[<ffffffff8155417a>] [<ffffffff8155417a>] _raw_spin_lock+0x3a/0x40
Jul 14 12:08:15 head kernel: RSP: 0018:ffff8817f1f5fcc8 EFLAGS: 00000202
Jul 14 12:08:15 head kernel: RAX: 0000000000000b70 RBX: ffff8817f96ec000 RCX: 00000000000000c1
Jul 14 12:08:15 head kernel: RDX: 00000000000000c0 RSI: 000000000000132a RDI: ffff88010e29cb40
Jul 14 12:08:15 head kernel: RBP: ffff8817f1f5fcc8 R08: ffff8817db320540 R09: ffff88010e306a00
Jul 14 12:08:15 head kernel: R10: ffff88010e29cb40 R11: ffff88010e29c800 R12: ffff882ff904e718
Jul 14 12:08:15 head kernel: R13: ffff8817f1f5fc60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:08:15 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa00000(0000) knlGS:0000000000000000
Jul 14 12:08:15 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:08:15 head kernel: CR2: 00007f23500d8000 CR3: 0000000001811000 CR4: 00000000001407f0
Jul 14 12:08:15 head kernel: Stack:
Jul 14 12:08:15 head kernel: ffff8817f1f5fd48 ffffffffa01f7fc4 ffff8817db320540 ffff88010e306a00
Jul 14 12:08:15 head kernel: ffff88010e29c800 ffff88010e29cb40 ffff88164fcf8000 ffff8817f1e41068
Jul 14 12:08:15 head kernel: 00000000818adc00 00000000f1e7181a ffff8817f1f5fdd8 ffff8817f1e41000
Jul 14 12:08:15 head kernel: Call Trace:
Jul 14 12:08:15 head kernel: [<ffffffffa01f7fc4>] nfsd4_sequence+0x334/0x610 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:08:15 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:08:15 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:08:15 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:08:15 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:08:15 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:08:15 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:08:15 head kernel: Code: 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 0f b6 17 <38> ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f 1f 44 00
Jul 14 12:08:15 head kernel: NMI watchdog: BUG: soft lockup - CPU#4 stuck for 23s! [nfsd:535]
Jul 14 12:08:15 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:08:15 head kernel: CPU: 4 PID: 535 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:08:15 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:08:15 head kernel: task: ffff8817f8a43250 ti: ffff8817f1d34000 task.ti: ffff8817f1d34000
Jul 14 12:08:15 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:08:15 head kernel: RSP: 0018:ffff8817f1d37cc8 EFLAGS: 00000297
Jul 14 12:08:15 head kernel: RAX: 000000000000345f RBX: ffffffffa0183eec RCX: 000000000000001d
Jul 14 12:08:15 head kernel: RDX: 000000000000001c RSI: 00000000000000d0 RDI: ffff8817f96ec130
Jul 14 12:08:15 head kernel: RBP: ffff8817f1d37cc8 R08: ffff8817dfc3e840 R09: ffff8817fab11000
Jul 14 12:08:15 head kernel: R10: 0000000000000004 R11: ffff8817fab13080 R12: ffff882ff904e718
Jul 14 12:08:15 head kernel: R13: ffff8817f1d37c60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:08:15 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa40000(0000) knlGS:0000000000000000
Jul 14 12:08:15 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:08:15 head kernel: CR2: 00007f216c0e2000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:08:15 head kernel: Stack:
Jul 14 12:08:15 head kernel: ffff8817f1d37d48 ffffffffa01f7d76 0000000015de9b97 000000006f7b8096
Jul 14 12:08:15 head kernel: ffff8817f1d37d38 ffff8817f5302000 ffff8817dfc3e840 ffff8817fab11068
Jul 14 12:08:15 head kernel: ffffffff818adc00 000000006f7b8096 ffff8817fa590000 ffff8817fab11000
Jul 14 12:08:15 head kernel: Call Trace:
Jul 14 12:08:15 head kernel: [<ffffffffa01f7d76>] nfsd4_sequence+0xe6/0x610 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:08:15 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:08:15 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:08:15 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:08:15 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:08:15 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:08:15 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:08:15 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:08:15 head kernel: NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [nfsd:539]
Jul 14 12:08:15 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:08:15 head kernel: CPU: 6 PID: 539 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:08:15 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:08:15 head kernel: task: ffff8817f8a45a90 ti: ffff8817f195c000 task.ti: ffff8817f195c000
Jul 14 12:08:15 head kernel: RIP: 0010:[<ffffffff8155417a>] [<ffffffff8155417a>] _raw_spin_lock+0x3a/0x40
Jul 14 12:08:15 head kernel: RSP: 0018:ffff8817f195fbc8 EFLAGS: 00000206
Jul 14 12:08:15 head kernel: RAX: 0000000000003769 RBX: ffff8801178cc900 RCX: 000000000000001e
Jul 14 12:08:15 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:08:15 head kernel: RBP: ffff8817f195fbc8 R08: 0000000000000000 R09: ffff8817f96ec000
Jul 14 12:08:15 head kernel: R10: ffff8817f96ec000 R11: ffff8817f1e44220 R12: ffffffff8124f74c
Jul 14 12:08:15 head kernel: R13: ffff8817f195fc98 R14: ffff8814ec9b3380 R15: ffff8817f8bc1ce0
Jul 14 12:08:15 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa60000(0000) knlGS:0000000000000000
Jul 14 12:08:15 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:08:15 head kernel: CR2: 00007f23380df000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:08:15 head kernel: Stack:
Jul 14 12:08:15 head kernel: ffff8817f195fbf8 ffffffffa01f4eff ffff8817f1e44244 ffff8817f96ec000
Jul 14 12:08:15 head kernel: ffff8817f1e45068 0000000000000009 ffff8817f195fc38 ffffffffa01f4ffa
Jul 14 12:08:15 head kernel: ffff8817f1f62000 0000000000000009 ffff8817f1e44244 ffff8817f195fcd0
Jul 14 12:08:15 head kernel: Call Trace:
Jul 14 12:08:15 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffffa01f6440>] nfs4_preprocess_seqid_op+0x60/0x1a0 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffffa01dee82>] ? rqst_exp_find+0x92/0x190 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffffa01fb0ee>] nfsd4_close+0x9e/0x380 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:08:15 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:08:15 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:08:15 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:08:15 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:08:15 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:08:15 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:08:15 head kernel: Code: 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 0f b6 17 <38> ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f 1f 44 00
Jul 14 12:08:15 head kernel: NMI watchdog: BUG: soft lockup - CPU#8 stuck for 22s! [nfsd:538]
Jul 14 12:08:15 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:08:15 head kernel: CPU: 8 PID: 538 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:08:15 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:08:15 head kernel: task: ffff8817f8a464a0 ti: ffff8817f1860000 task.ti: ffff8817f1860000
Jul 14 12:08:15 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:08:15 head kernel: RSP: 0018:ffff8817f1863c08 EFLAGS: 00000293
Jul 14 12:08:15 head kernel: RAX: 0000000000003f57 RBX: 0000000000000246 RCX: 000000000000001f
Jul 14 12:08:15 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:08:15 head kernel: RBP: ffff8817f1863c08 R08: 0000000000000000 R09: 0000000000000000
Jul 14 12:08:15 head kernel: R10: 0000000000000400 R11: ffff8817f1e42220 R12: ffff882ff7b80de0
Jul 14 12:08:15 head kernel: R13: ffff8817f8b44480 R14: 00000000888ab88f R15: ffff8817f95c1f00
Jul 14 12:08:15 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa80000(0000) knlGS:0000000000000000
Jul 14 12:08:15 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:08:15 head kernel: CR2: 00007f23480ce000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:08:15 head kernel: Stack:
Jul 14 12:08:15 head kernel: ffff8817f1863c38 ffffffffa01f4eff ffff8817f1e42240 ffff8817f96ec000
Jul 14 12:08:15 head kernel: ffff8817f1e43068 0000000000000007 ffff8817f1863c78 ffffffffa01f4ffa
Jul 14 12:08:15 head kernel: ffff8817f1863c98 ffffffff818adc00 ffff8817f1863d10 ffff8817f1e43068
Jul 14 12:08:15 head kernel: Call Trace:
Jul 14 12:08:15 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffffa01fa6e0>] nfs4_preprocess_stateid_op+0x190/0x330 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffffa01e779a>] nfsd4_write+0x8a/0x1f0 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:08:15 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:08:15 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:08:15 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:08:15 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:08:15 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:08:15 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:08:15 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:08:15 head kernel: NMI watchdog: BUG: soft lockup - CPU#10 stuck for 22s! [nfsd:540]
Jul 14 12:08:15 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:08:15 head kernel: CPU: 10 PID: 540 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:08:15 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:08:15 head kernel: task: ffff8817f8a45080 ti: ffff8817f1a78000 task.ti: ffff8817f1a78000
Jul 14 12:08:15 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:08:15 head kernel: RSP: 0018:ffff8817f1a7bcc8 EFLAGS: 00000287
Jul 14 12:08:15 head kernel: RAX: 00000000000030b1 RBX: ffffffffa0183eec RCX: 0000000000000020
Jul 14 12:08:15 head kernel: RDX: 000000000000001c RSI: 00000000000000d0 RDI: ffff8817f96ec130
Jul 14 12:08:15 head kernel: RBP: ffff8817f1a7bcc8 R08: ffff881792d83840 R09: ffff8817f1e47000
Jul 14 12:08:15 head kernel: R10: 0000000000000004 R11: ffff8817f1e46080 R12: ffff882ff904e718
Jul 14 12:08:15 head kernel: R13: ffff8817f1a7bc60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:08:15 head kernel: FS: 0000000000000000(0000) GS:ffff88181faa0000(0000) knlGS:0000000000000000
Jul 14 12:08:15 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:08:15 head kernel: CR2: 00007f22ec0c6000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:08:15 head kernel: Stack:
Jul 14 12:08:15 head kernel: ffff8817f1a7bd48 ffffffffa01f7d76 0000000015de9b97 00000000b16b0475
Jul 14 12:08:15 head kernel: ffff8817f1a7bd38 ffff8817f1f64000 ffff881792d83840 ffff8817f1e47068
Jul 14 12:08:15 head kernel: ffffffff818adc00 00000000b16b0475 ffff8817f1a7bdd8 ffff8817f1e47000
Jul 14 12:08:15 head kernel: Call Trace:
Jul 14 12:08:15 head kernel: [<ffffffffa01f7d76>] nfsd4_sequence+0xe6/0x610 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:08:15 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:08:15 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:08:15 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:08:15 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:08:15 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:08:15 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:08:15 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:08:15 head kernel: NMI watchdog: BUG: soft lockup - CPU#14 stuck for 22s! [nfsd:541]
Jul 14 12:08:15 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:08:15 head kernel: CPU: 14 PID: 541 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:08:15 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:08:15 head kernel: task: ffff8817f1b80000 ti: ffff8817f1b7c000 task.ti: ffff8817f1b7c000
Jul 14 12:08:15 head kernel: RIP: 0010:[<ffffffff8155417a>] [<ffffffff8155417a>] _raw_spin_lock+0x3a/0x40
Jul 14 12:08:15 head kernel: RSP: 0018:ffff8817f1b7fc08 EFLAGS: 00000202
Jul 14 12:08:15 head kernel: RAX: 000000000000606d RBX: 0000000000000246 RCX: 0000000000000021
Jul 14 12:08:15 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:08:15 head kernel: RBP: ffff8817f1b7fc08 R08: 0000000000000000 R09: 0000000000000000
Jul 14 12:08:15 head kernel: R10: 0000000000000400 R11: ffff8817f1a80220 R12: ffff882ff7b80de0
Jul 14 12:08:15 head kernel: R13: ffff8817f8b44480 R14: 0000000060a0f8c6 R15: ffff8817f95c1f00
Jul 14 12:08:15 head kernel: FS: 0000000000000000(0000) GS:ffff88181fae0000(0000) knlGS:0000000000000000
Jul 14 12:08:15 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:08:15 head kernel: CR2: 00007f235c0d5000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:08:15 head kernel: Stack:
Jul 14 12:08:15 head kernel: ffff8817f1b7fc38 ffffffffa01f4eff ffff8817f1a80240 ffff8817f96ec000
Jul 14 12:08:15 head kernel: ffff8817f1a81068 0000000000000007 ffff8817f1b7fc78 ffffffffa01f4ffa
Jul 14 12:08:15 head kernel: ffff8817f1b7fc98 ffffffff818adc00 ffff8817f1b7fd10 ffff8817f1a81068
Jul 14 12:08:15 head kernel: Call Trace:
Jul 14 12:08:15 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffffa01fa6e0>] nfs4_preprocess_stateid_op+0x190/0x330 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffffa01e779a>] nfsd4_write+0x8a/0x1f0 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:08:15 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:08:15 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:08:15 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:08:15 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:08:15 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:08:15 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:08:15 head kernel: Code: 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 0f b6 17 <38> ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f 1f 44 00
Jul 14 12:08:27 head kernel: NMI watchdog: BUG: soft lockup - CPU#11 stuck for 22s! [kworker/u96:2:9888]
Jul 14 12:08:27 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:08:27 head kernel: CPU: 11 PID: 9888 Comm: kworker/u96:2 Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:08:27 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:08:27 head kernel: Workqueue: nfsd4 laundromat_main [nfsd]
Jul 14 12:08:27 head kernel: task: ffff882ff208a840 ti: ffff8818ca7d0000 task.ti: ffff8818ca7d0000
Jul 14 12:08:27 head kernel: RIP: 0010:[<ffffffff81554177>] [<ffffffff81554177>] _raw_spin_lock+0x37/0x40
Jul 14 12:08:27 head kernel: RSP: 0018:ffff8818ca7d3d68 EFLAGS: 00000206
Jul 14 12:08:27 head kernel: RAX: 0000000000000244 RBX: 0000000000000000 RCX: 0000000000000022
Jul 14 12:08:27 head kernel: RDX: 000000000000001c RSI: 000000000000005a RDI: ffff8817f96ec130
Jul 14 12:08:27 head kernel: RBP: ffff8818ca7d3d68 R08: ffff8818ca7d0000 R09: 0000000000000001
Jul 14 12:08:27 head kernel: R10: ffff882ffa0c1038 R11: 00000000000ec472 R12: 0000000000000001
Jul 14 12:08:27 head kernel: R13: ffff882ff208ae40 R14: ffff88301f2b0a80 R15: ffff88301f273640
Jul 14 12:08:27 head kernel: FS: 0000000000000000(0000) GS:ffff88301f2a0000(0000) knlGS:0000000000000000
Jul 14 12:08:27 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:08:27 head kernel: CR2: 00007f951cad1000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:08:27 head kernel: Stack:
Jul 14 12:08:27 head kernel: ffff8818ca7d3df8 ffffffffa01f6680 000000000000005a ffff8817f96ec130
Jul 14 12:08:27 head kernel: ffff8817f96ec0a0 ffff8817f96ec000 ffff8818ca7d3dc8 0000000000000292
Jul 14 12:08:27 head kernel: ffff8814ae5ec0c0 ffff8818ca7d3db0 ffff8818ca7d3db0 00000000612153c8
Jul 14 12:08:27 head kernel: Call Trace:
Jul 14 12:08:27 head kernel: [<ffffffffa01f6680>] laundromat_main+0x80/0x480 [nfsd]
Jul 14 12:08:27 head kernel: [<ffffffff8108b7c5>] process_one_work+0x145/0x400
Jul 14 12:08:27 head kernel: [<ffffffff8108bd8b>] worker_thread+0x6b/0x4a0
Jul 14 12:08:27 head kernel: [<ffffffff8108bd20>] ? init_pwq.part.22+0x10/0x10
Jul 14 12:08:27 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:08:27 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:08:27 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:08:27 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:08:27 head kernel: Code: 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 <0f> b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f
Jul 14 12:08:43 head kernel: NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [nfsd:537]
Jul 14 12:08:43 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:08:43 head kernel: CPU: 0 PID: 537 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:08:43 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:08:43 head kernel: task: ffff8817f8a46eb0 ti: ffff8817f1f5c000 task.ti: ffff8817f1f5c000
Jul 14 12:08:43 head kernel: RIP: 0010:[<ffffffff81554177>] [<ffffffff81554177>] _raw_spin_lock+0x37/0x40
Jul 14 12:08:43 head kernel: RSP: 0018:ffff8817f1f5fcc8 EFLAGS: 00000202
Jul 14 12:08:43 head kernel: RAX: 00000000000013c7 RBX: ffff8817f96ec000 RCX: 00000000000000c1
Jul 14 12:08:43 head kernel: RDX: 00000000000000c0 RSI: 000000000000132a RDI: ffff88010e29cb40
Jul 14 12:08:43 head kernel: RBP: ffff8817f1f5fcc8 R08: ffff8817db320540 R09: ffff88010e306a00
Jul 14 12:08:43 head kernel: R10: ffff88010e29cb40 R11: ffff88010e29c800 R12: ffff882ff904e718
Jul 14 12:08:43 head kernel: R13: ffff8817f1f5fc60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:08:43 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa00000(0000) knlGS:0000000000000000
Jul 14 12:08:43 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:08:43 head kernel: CR2: 00007f23500d8000 CR3: 0000000001811000 CR4: 00000000001407f0
Jul 14 12:08:43 head kernel: Stack:
Jul 14 12:08:43 head kernel: ffff8817f1f5fd48 ffffffffa01f7fc4 ffff8817db320540 ffff88010e306a00
Jul 14 12:08:43 head kernel: ffff88010e29c800 ffff88010e29cb40 ffff88164fcf8000 ffff8817f1e41068
Jul 14 12:08:43 head kernel: 00000000818adc00 00000000f1e7181a ffff8817f1f5fdd8 ffff8817f1e41000
Jul 14 12:08:43 head kernel: Call Trace:
Jul 14 12:08:43 head kernel: [<ffffffffa01f7fc4>] nfsd4_sequence+0x334/0x610 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:08:43 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:08:43 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:08:43 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:08:43 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:08:43 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:08:43 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:08:43 head kernel: Code: 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 <0f> b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f
Jul 14 12:08:43 head kernel: NMI watchdog: BUG: soft lockup - CPU#4 stuck for 22s! [nfsd:535]
Jul 14 12:08:43 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:08:43 head kernel: CPU: 4 PID: 535 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:08:43 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:08:43 head kernel: task: ffff8817f8a43250 ti: ffff8817f1d34000 task.ti: ffff8817f1d34000
Jul 14 12:08:43 head kernel: RIP: 0010:[<ffffffff81554170>] [<ffffffff81554170>] _raw_spin_lock+0x30/0x40
Jul 14 12:08:43 head kernel: RSP: 0018:ffff8817f1d37cc8 EFLAGS: 00000297
Jul 14 12:08:43 head kernel: RAX: 0000000000006e01 RBX: ffffffffa0183eec RCX: 000000000000001d
Jul 14 12:08:43 head kernel: RDX: 000000000000001c RSI: 00000000000000d0 RDI: ffff8817f96ec130
Jul 14 12:08:43 head kernel: RBP: ffff8817f1d37cc8 R08: ffff8817dfc3e840 R09: ffff8817fab11000
Jul 14 12:08:43 head kernel: R10: 0000000000000004 R11: ffff8817fab13080 R12: ffff882ff904e718
Jul 14 12:08:43 head kernel: R13: ffff8817f1d37c60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:08:43 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa40000(0000) knlGS:0000000000000000
Jul 14 12:08:43 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:08:43 head kernel: CR2: 00007f216c0e2000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:08:43 head kernel: Stack:
Jul 14 12:08:43 head kernel: ffff8817f1d37d48 ffffffffa01f7d76 0000000015de9b97 000000006f7b8096
Jul 14 12:08:43 head kernel: ffff8817f1d37d38 ffff8817f5302000 ffff8817dfc3e840 ffff8817fab11068
Jul 14 12:08:43 head kernel: ffffffff818adc00 000000006f7b8096 ffff8817fa590000 ffff8817fab11000
Jul 14 12:08:43 head kernel: Call Trace:
Jul 14 12:08:43 head kernel: [<ffffffffa01f7d76>] nfsd4_sequence+0xe6/0x610 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:08:43 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:08:43 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:08:43 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:08:43 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:08:43 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:08:43 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:08:43 head kernel: Code: 55 65 ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 <f3> 90 83 e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00
Jul 14 12:08:43 head kernel: NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [nfsd:539]
Jul 14 12:08:43 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:08:43 head kernel: CPU: 6 PID: 539 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:08:43 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:08:43 head kernel: task: ffff8817f8a45a90 ti: ffff8817f195c000 task.ti: ffff8817f195c000
Jul 14 12:08:43 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:08:43 head kernel: RSP: 0018:ffff8817f195fbc8 EFLAGS: 00000293
Jul 14 12:08:43 head kernel: RAX: 0000000000002546 RBX: ffff8801178cc900 RCX: 000000000000001e
Jul 14 12:08:43 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:08:43 head kernel: RBP: ffff8817f195fbc8 R08: 0000000000000000 R09: ffff8817f96ec000
Jul 14 12:08:43 head kernel: R10: ffff8817f96ec000 R11: ffff8817f1e44220 R12: ffffffff8124f74c
Jul 14 12:08:43 head kernel: R13: ffff8817f195fc98 R14: ffff8814ec9b3380 R15: ffff8817f8bc1ce0
Jul 14 12:08:43 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa60000(0000) knlGS:0000000000000000
Jul 14 12:08:43 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:08:43 head kernel: CR2: 00007f23380df000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:08:43 head kernel: Stack:
Jul 14 12:08:43 head kernel: ffff8817f195fbf8 ffffffffa01f4eff ffff8817f1e44244 ffff8817f96ec000
Jul 14 12:08:43 head kernel: ffff8817f1e45068 0000000000000009 ffff8817f195fc38 ffffffffa01f4ffa
Jul 14 12:08:43 head kernel: ffff8817f1f62000 0000000000000009 ffff8817f1e44244 ffff8817f195fcd0
Jul 14 12:08:43 head kernel: Call Trace:
Jul 14 12:08:43 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffffa01f6440>] nfs4_preprocess_seqid_op+0x60/0x1a0 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffffa01dee82>] ? rqst_exp_find+0x92/0x190 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffffa01fb0ee>] nfsd4_close+0x9e/0x380 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:08:43 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:08:43 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:08:43 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:08:43 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:08:43 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:08:43 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:08:43 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:08:43 head kernel: NMI watchdog: BUG: soft lockup - CPU#8 stuck for 22s! [nfsd:538]
Jul 14 12:08:43 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:08:43 head kernel: CPU: 8 PID: 538 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:08:43 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:08:43 head kernel: task: ffff8817f8a464a0 ti: ffff8817f1860000 task.ti: ffff8817f1860000
Jul 14 12:08:43 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:08:43 head kernel: RSP: 0018:ffff8817f1863c08 EFLAGS: 00000293
Jul 14 12:08:43 head kernel: RAX: 0000000000005e5a RBX: 0000000000000246 RCX: 000000000000001f
Jul 14 12:08:43 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:08:43 head kernel: RBP: ffff8817f1863c08 R08: 0000000000000000 R09: 0000000000000000
Jul 14 12:08:43 head kernel: R10: 0000000000000400 R11: ffff8817f1e42220 R12: ffff882ff7b80de0
Jul 14 12:08:43 head kernel: R13: ffff8817f8b44480 R14: 00000000888ab88f R15: ffff8817f95c1f00
Jul 14 12:08:43 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa80000(0000) knlGS:0000000000000000
Jul 14 12:08:43 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:08:43 head kernel: CR2: 00007f23480ce000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:08:43 head kernel: Stack:
Jul 14 12:08:43 head kernel: ffff8817f1863c38 ffffffffa01f4eff ffff8817f1e42240 ffff8817f96ec000
Jul 14 12:08:43 head kernel: ffff8817f1e43068 0000000000000007 ffff8817f1863c78 ffffffffa01f4ffa
Jul 14 12:08:43 head kernel: ffff8817f1863c98 ffffffff818adc00 ffff8817f1863d10 ffff8817f1e43068
Jul 14 12:08:43 head kernel: Call Trace:
Jul 14 12:08:43 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffffa01fa6e0>] nfs4_preprocess_stateid_op+0x190/0x330 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffffa01e779a>] nfsd4_write+0x8a/0x1f0 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:08:43 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:08:43 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:08:43 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:08:43 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:08:43 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:08:43 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:08:43 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:08:43 head kernel: NMI watchdog: BUG: soft lockup - CPU#10 stuck for 22s! [nfsd:540]
Jul 14 12:08:43 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:08:43 head kernel: CPU: 10 PID: 540 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:08:43 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:08:43 head kernel: task: ffff8817f8a45080 ti: ffff8817f1a78000 task.ti: ffff8817f1a78000
Jul 14 12:08:43 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:08:43 head kernel: RSP: 0018:ffff8817f1a7bcc8 EFLAGS: 00000287
Jul 14 12:08:43 head kernel: RAX: 0000000000001058 RBX: ffffffffa0183eec RCX: 0000000000000020
Jul 14 12:08:43 head kernel: RDX: 000000000000001c RSI: 00000000000000d0 RDI: ffff8817f96ec130
Jul 14 12:08:43 head kernel: RBP: ffff8817f1a7bcc8 R08: ffff881792d83840 R09: ffff8817f1e47000
Jul 14 12:08:43 head kernel: R10: 0000000000000004 R11: ffff8817f1e46080 R12: ffff882ff904e718
Jul 14 12:08:43 head kernel: R13: ffff8817f1a7bc60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:08:43 head kernel: FS: 0000000000000000(0000) GS:ffff88181faa0000(0000) knlGS:0000000000000000
Jul 14 12:08:43 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:08:43 head kernel: CR2: 00007f22ec0c6000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:08:43 head kernel: Stack:
Jul 14 12:08:43 head kernel: ffff8817f1a7bd48 ffffffffa01f7d76 0000000015de9b97 00000000b16b0475
Jul 14 12:08:43 head kernel: ffff8817f1a7bd38 ffff8817f1f64000 ffff881792d83840 ffff8817f1e47068
Jul 14 12:08:43 head kernel: ffffffff818adc00 00000000b16b0475 ffff8817f1a7bdd8 ffff8817f1e47000
Jul 14 12:08:43 head kernel: Call Trace:
Jul 14 12:08:43 head kernel: [<ffffffffa01f7d76>] nfsd4_sequence+0xe6/0x610 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:08:43 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:08:43 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:08:43 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:08:43 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:08:43 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:08:43 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:08:43 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:08:43 head kernel: NMI watchdog: BUG: soft lockup - CPU#14 stuck for 22s! [nfsd:541]
Jul 14 12:08:43 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:08:43 head kernel: CPU: 14 PID: 541 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:08:43 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:08:43 head kernel: task: ffff8817f1b80000 ti: ffff8817f1b7c000 task.ti: ffff8817f1b7c000
Jul 14 12:08:43 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:08:43 head kernel: RSP: 0018:ffff8817f1b7fc08 EFLAGS: 00000283
Jul 14 12:08:43 head kernel: RAX: 0000000000001dd1 RBX: 0000000000000246 RCX: 0000000000000021
Jul 14 12:08:43 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:08:43 head kernel: RBP: ffff8817f1b7fc08 R08: 0000000000000000 R09: 0000000000000000
Jul 14 12:08:43 head kernel: R10: 0000000000000400 R11: ffff8817f1a80220 R12: ffff882ff7b80de0
Jul 14 12:08:43 head kernel: R13: ffff8817f8b44480 R14: 0000000060a0f8c6 R15: ffff8817f95c1f00
Jul 14 12:08:43 head kernel: FS: 0000000000000000(0000) GS:ffff88181fae0000(0000) knlGS:0000000000000000
Jul 14 12:08:43 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:08:43 head kernel: CR2: 00007f235c0d5000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:08:43 head kernel: Stack:
Jul 14 12:08:43 head kernel: ffff8817f1b7fc38 ffffffffa01f4eff ffff8817f1a80240 ffff8817f96ec000
Jul 14 12:08:43 head kernel: ffff8817f1a81068 0000000000000007 ffff8817f1b7fc78 ffffffffa01f4ffa
Jul 14 12:08:43 head kernel: ffff8817f1b7fc98 ffffffff818adc00 ffff8817f1b7fd10 ffff8817f1a81068
Jul 14 12:08:43 head kernel: Call Trace:
Jul 14 12:08:43 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffffa01fa6e0>] nfs4_preprocess_stateid_op+0x190/0x330 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffffa01e779a>] nfsd4_write+0x8a/0x1f0 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:08:43 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:08:43 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:08:43 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:08:43 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:08:43 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:08:43 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:08:43 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:08:55 head kernel: NMI watchdog: BUG: soft lockup - CPU#11 stuck for 22s! [kworker/u96:2:9888]
Jul 14 12:08:55 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:08:55 head kernel: CPU: 11 PID: 9888 Comm: kworker/u96:2 Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:08:55 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:08:55 head kernel: Workqueue: nfsd4 laundromat_main [nfsd]
Jul 14 12:08:55 head kernel: task: ffff882ff208a840 ti: ffff8818ca7d0000 task.ti: ffff8818ca7d0000
Jul 14 12:08:55 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:08:55 head kernel: RSP: 0018:ffff8818ca7d3d68 EFLAGS: 00000287
Jul 14 12:08:55 head kernel: RAX: 0000000000003265 RBX: 0000000000000000 RCX: 0000000000000022
Jul 14 12:08:55 head kernel: RDX: 000000000000001c RSI: 000000000000005a RDI: ffff8817f96ec130
Jul 14 12:08:55 head kernel: RBP: ffff8818ca7d3d68 R08: ffff8818ca7d0000 R09: 0000000000000001
Jul 14 12:08:55 head kernel: R10: ffff882ffa0c1038 R11: 00000000000ec472 R12: 0000000000000001
Jul 14 12:08:55 head kernel: R13: ffff882ff208ae40 R14: ffff88301f2b0a80 R15: ffff88301f273640
Jul 14 12:08:55 head kernel: FS: 0000000000000000(0000) GS:ffff88301f2a0000(0000) knlGS:0000000000000000
Jul 14 12:08:55 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:08:55 head kernel: CR2: 00007f951cad1000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:08:55 head kernel: Stack:
Jul 14 12:08:55 head kernel: ffff8818ca7d3df8 ffffffffa01f6680 000000000000005a ffff8817f96ec130
Jul 14 12:08:55 head kernel: ffff8817f96ec0a0 ffff8817f96ec000 ffff8818ca7d3dc8 0000000000000292
Jul 14 12:08:55 head kernel: ffff8814ae5ec0c0 ffff8818ca7d3db0 ffff8818ca7d3db0 00000000612153c8
Jul 14 12:08:55 head kernel: Call Trace:
Jul 14 12:08:55 head kernel: [<ffffffffa01f6680>] laundromat_main+0x80/0x480 [nfsd]
Jul 14 12:08:55 head kernel: [<ffffffff8108b7c5>] process_one_work+0x145/0x400
Jul 14 12:08:55 head kernel: [<ffffffff8108bd8b>] worker_thread+0x6b/0x4a0
Jul 14 12:08:55 head kernel: [<ffffffff8108bd20>] ? init_pwq.part.22+0x10/0x10
Jul 14 12:08:55 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:08:55 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:08:55 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:08:55 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:08:55 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:08:56 head pbs_server[30205]: LOG_ERROR::svr_is_request, bad attempt to connect from 192.168.2.236:706 (address not trusted - check entry in server_priv/nodes)
Jul 14 12:08:58 head pbs_server[30205]: LOG_ERROR::svr_is_request, bad attempt to connect from 192.168.2.233:646 (address not trusted - check entry in server_priv/nodes)
Jul 14 12:09:11 head kernel: NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [nfsd:537]
Jul 14 12:09:11 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:09:11 head kernel: CPU: 0 PID: 537 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:09:11 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:09:11 head kernel: task: ffff8817f8a46eb0 ti: ffff8817f1f5c000 task.ti: ffff8817f1f5c000
Jul 14 12:09:11 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:09:11 head kernel: RSP: 0018:ffff8817f1f5fcc8 EFLAGS: 00000297
Jul 14 12:09:11 head kernel: RAX: 00000000000002b6 RBX: ffff8817f96ec000 RCX: 00000000000000c1
Jul 14 12:09:11 head kernel: RDX: 00000000000000c0 RSI: 000000000000132a RDI: ffff88010e29cb40
Jul 14 12:09:11 head kernel: RBP: ffff8817f1f5fcc8 R08: ffff8817db320540 R09: ffff88010e306a00
Jul 14 12:09:11 head kernel: R10: ffff88010e29cb40 R11: ffff88010e29c800 R12: ffff882ff904e718
Jul 14 12:09:11 head kernel: R13: ffff8817f1f5fc60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:09:11 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa00000(0000) knlGS:0000000000000000
Jul 14 12:09:11 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:09:11 head kernel: CR2: 00007f23500d8000 CR3: 0000000001811000 CR4: 00000000001407f0
Jul 14 12:09:11 head kernel: Stack:
Jul 14 12:09:11 head kernel: ffff8817f1f5fd48 ffffffffa01f7fc4 ffff8817db320540 ffff88010e306a00
Jul 14 12:09:11 head kernel: ffff88010e29c800 ffff88010e29cb40 ffff88164fcf8000 ffff8817f1e41068
Jul 14 12:09:11 head kernel: 00000000818adc00 00000000f1e7181a ffff8817f1f5fdd8 ffff8817f1e41000
Jul 14 12:09:11 head kernel: Call Trace:
Jul 14 12:09:11 head kernel: [<ffffffffa01f7fc4>] nfsd4_sequence+0x334/0x610 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:09:11 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:09:11 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:09:11 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:09:11 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:09:11 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:09:11 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:09:11 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:09:11 head kernel: NMI watchdog: BUG: soft lockup - CPU#4 stuck for 22s! [nfsd:535]
Jul 14 12:09:11 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:09:11 head kernel: CPU: 4 PID: 535 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:09:11 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:09:11 head kernel: task: ffff8817f8a43250 ti: ffff8817f1d34000 task.ti: ffff8817f1d34000
Jul 14 12:09:11 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:09:11 head kernel: RSP: 0018:ffff8817f1d37cc8 EFLAGS: 00000297
Jul 14 12:09:11 head kernel: RAX: 0000000000005278 RBX: ffffffffa0183eec RCX: 000000000000001d
Jul 14 12:09:11 head kernel: RDX: 000000000000001c RSI: 00000000000000d0 RDI: ffff8817f96ec130
Jul 14 12:09:11 head kernel: RBP: ffff8817f1d37cc8 R08: ffff8817dfc3e840 R09: ffff8817fab11000
Jul 14 12:09:11 head kernel: R10: 0000000000000004 R11: ffff8817fab13080 R12: ffff882ff904e718
Jul 14 12:09:11 head kernel: R13: ffff8817f1d37c60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:09:11 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa40000(0000) knlGS:0000000000000000
Jul 14 12:09:11 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:09:11 head kernel: CR2: 00007f216c0e2000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:09:11 head kernel: Stack:
Jul 14 12:09:11 head kernel: ffff8817f1d37d48 ffffffffa01f7d76 0000000015de9b97 000000006f7b8096
Jul 14 12:09:11 head kernel: ffff8817f1d37d38 ffff8817f5302000 ffff8817dfc3e840 ffff8817fab11068
Jul 14 12:09:11 head kernel: ffffffff818adc00 000000006f7b8096 ffff8817fa590000 ffff8817fab11000
Jul 14 12:09:11 head kernel: Call Trace:
Jul 14 12:09:11 head kernel: [<ffffffffa01f7d76>] nfsd4_sequence+0xe6/0x610 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:09:11 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:09:11 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:09:11 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:09:11 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:09:11 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:09:11 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:09:11 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:09:11 head kernel: NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [nfsd:539]
Jul 14 12:09:11 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:09:11 head kernel: CPU: 6 PID: 539 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:09:11 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:09:11 head kernel: task: ffff8817f8a45a90 ti: ffff8817f195c000 task.ti: ffff8817f195c000
Jul 14 12:09:11 head kernel: RIP: 0010:[<ffffffff8155417a>] [<ffffffff8155417a>] _raw_spin_lock+0x3a/0x40
Jul 14 12:09:11 head kernel: RSP: 0018:ffff8817f195fbc8 EFLAGS: 00000206
Jul 14 12:09:11 head kernel: RAX: 0000000000001721 RBX: ffff8801178cc900 RCX: 000000000000001e
Jul 14 12:09:11 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:09:11 head kernel: RBP: ffff8817f195fbc8 R08: 0000000000000000 R09: ffff8817f96ec000
Jul 14 12:09:11 head kernel: R10: ffff8817f96ec000 R11: ffff8817f1e44220 R12: ffffffff8124f74c
Jul 14 12:09:11 head kernel: R13: ffff8817f195fc98 R14: ffff8814ec9b3380 R15: ffff8817f8bc1ce0
Jul 14 12:09:11 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa60000(0000) knlGS:0000000000000000
Jul 14 12:09:11 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:09:11 head kernel: CR2: 00007f23380df000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:09:11 head kernel: Stack:
Jul 14 12:09:11 head kernel: ffff8817f195fbf8 ffffffffa01f4eff ffff8817f1e44244 ffff8817f96ec000
Jul 14 12:09:11 head kernel: ffff8817f1e45068 0000000000000009 ffff8817f195fc38 ffffffffa01f4ffa
Jul 14 12:09:11 head kernel: ffff8817f1f62000 0000000000000009 ffff8817f1e44244 ffff8817f195fcd0
Jul 14 12:09:11 head kernel: Call Trace:
Jul 14 12:09:11 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffffa01f6440>] nfs4_preprocess_seqid_op+0x60/0x1a0 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffffa01dee82>] ? rqst_exp_find+0x92/0x190 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffffa01fb0ee>] nfsd4_close+0x9e/0x380 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:09:11 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:09:11 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:09:11 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:09:11 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:09:11 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:09:11 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:09:11 head kernel: Code: 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 0f b6 17 <38> ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f 1f 44 00
Jul 14 12:09:11 head kernel: NMI watchdog: BUG: soft lockup - CPU#8 stuck for 22s! [nfsd:538]
Jul 14 12:09:11 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:09:11 head kernel: CPU: 8 PID: 538 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:09:11 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:09:11 head kernel: task: ffff8817f8a464a0 ti: ffff8817f1860000 task.ti: ffff8817f1860000
Jul 14 12:09:11 head kernel: RIP: 0010:[<ffffffff81554177>] [<ffffffff81554177>] _raw_spin_lock+0x37/0x40
Jul 14 12:09:11 head kernel: RSP: 0018:ffff8817f1863c08 EFLAGS: 00000212
Jul 14 12:09:11 head kernel: RAX: 0000000000007cbf RBX: 0000000000000246 RCX: 000000000000001f
Jul 14 12:09:11 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:09:11 head kernel: RBP: ffff8817f1863c08 R08: 0000000000000000 R09: 0000000000000000
Jul 14 12:09:11 head kernel: R10: 0000000000000400 R11: ffff8817f1e42220 R12: ffff882ff7b80de0
Jul 14 12:09:11 head kernel: R13: ffff8817f8b44480 R14: 00000000888ab88f R15: ffff8817f95c1f00
Jul 14 12:09:11 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa80000(0000) knlGS:0000000000000000
Jul 14 12:09:11 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:09:11 head kernel: CR2: 00007f23480ce000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:09:11 head kernel: Stack:
Jul 14 12:09:11 head kernel: ffff8817f1863c38 ffffffffa01f4eff ffff8817f1e42240 ffff8817f96ec000
Jul 14 12:09:11 head kernel: ffff8817f1e43068 0000000000000007 ffff8817f1863c78 ffffffffa01f4ffa
Jul 14 12:09:11 head kernel: ffff8817f1863c98 ffffffff818adc00 ffff8817f1863d10 ffff8817f1e43068
Jul 14 12:09:11 head kernel: Call Trace:
Jul 14 12:09:11 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffffa01fa6e0>] nfs4_preprocess_stateid_op+0x190/0x330 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffffa01e779a>] nfsd4_write+0x8a/0x1f0 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:09:11 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:09:11 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:09:11 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:09:11 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:09:11 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:09:11 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:09:11 head kernel: Code: 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 <0f> b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f
Jul 14 12:09:11 head kernel: NMI watchdog: BUG: soft lockup - CPU#10 stuck for 22s! [nfsd:540]
Jul 14 12:09:11 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:09:11 head kernel: CPU: 10 PID: 540 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:09:11 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:09:11 head kernel: task: ffff8817f8a45080 ti: ffff8817f1a78000 task.ti: ffff8817f1a78000
Jul 14 12:09:11 head kernel: RIP: 0010:[<ffffffff8155417a>] [<ffffffff8155417a>] _raw_spin_lock+0x3a/0x40
Jul 14 12:09:11 head kernel: RSP: 0018:ffff8817f1a7bcc8 EFLAGS: 00000216
Jul 14 12:09:11 head kernel: RAX: 00000000000065cf RBX: ffffffffa0183eec RCX: 0000000000000020
Jul 14 12:09:11 head kernel: RDX: 000000000000001c RSI: 00000000000000d0 RDI: ffff8817f96ec130
Jul 14 12:09:11 head kernel: RBP: ffff8817f1a7bcc8 R08: ffff881792d83840 R09: ffff8817f1e47000
Jul 14 12:09:11 head kernel: R10: 0000000000000004 R11: ffff8817f1e46080 R12: ffff882ff904e718
Jul 14 12:09:11 head kernel: R13: ffff8817f1a7bc60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:09:11 head kernel: FS: 0000000000000000(0000) GS:ffff88181faa0000(0000) knlGS:0000000000000000
Jul 14 12:09:11 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:09:11 head kernel: CR2: 00007f22ec0c6000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:09:11 head kernel: Stack:
Jul 14 12:09:11 head kernel: ffff8817f1a7bd48 ffffffffa01f7d76 0000000015de9b97 00000000b16b0475
Jul 14 12:09:11 head kernel: ffff8817f1a7bd38 ffff8817f1f64000 ffff881792d83840 ffff8817f1e47068
Jul 14 12:09:11 head kernel: ffffffff818adc00 00000000b16b0475 ffff8817f1a7bdd8 ffff8817f1e47000
Jul 14 12:09:11 head kernel: Call Trace:
Jul 14 12:09:11 head kernel: [<ffffffffa01f7d76>] nfsd4_sequence+0xe6/0x610 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:09:11 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:09:11 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:09:11 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:09:11 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:09:11 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:09:11 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:09:11 head kernel: Code: 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 0f b6 17 <38> ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f 1f 44 00
Jul 14 12:09:11 head kernel: NMI watchdog: BUG: soft lockup - CPU#14 stuck for 22s! [nfsd:541]
Jul 14 12:09:11 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:09:11 head kernel: CPU: 14 PID: 541 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:09:11 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:09:11 head kernel: task: ffff8817f1b80000 ti: ffff8817f1b7c000 task.ti: ffff8817f1b7c000
Jul 14 12:09:11 head kernel: RIP: 0010:[<ffffffff8155417a>] [<ffffffff8155417a>] _raw_spin_lock+0x3a/0x40
Jul 14 12:09:11 head kernel: RSP: 0018:ffff8817f1b7fc08 EFLAGS: 00000206
Jul 14 12:09:11 head kernel: RAX: 00000000000066b2 RBX: 0000000000000246 RCX: 0000000000000021
Jul 14 12:09:11 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:09:11 head kernel: RBP: ffff8817f1b7fc08 R08: 0000000000000000 R09: 0000000000000000
Jul 14 12:09:11 head kernel: R10: 0000000000000400 R11: ffff8817f1a80220 R12: ffff882ff7b80de0
Jul 14 12:09:11 head kernel: R13: ffff8817f8b44480 R14: 0000000060a0f8c6 R15: ffff8817f95c1f00
Jul 14 12:09:11 head kernel: FS: 0000000000000000(0000) GS:ffff88181fae0000(0000) knlGS:0000000000000000
Jul 14 12:09:11 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:09:11 head kernel: CR2: 00007f235c0d5000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:09:11 head kernel: Stack:
Jul 14 12:09:11 head kernel: ffff8817f1b7fc38 ffffffffa01f4eff ffff8817f1a80240 ffff8817f96ec000
Jul 14 12:09:11 head kernel: ffff8817f1a81068 0000000000000007 ffff8817f1b7fc78 ffffffffa01f4ffa
Jul 14 12:09:11 head kernel: ffff8817f1b7fc98 ffffffff818adc00 ffff8817f1b7fd10 ffff8817f1a81068
Jul 14 12:09:11 head kernel: Call Trace:
Jul 14 12:09:11 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffffa01fa6e0>] nfs4_preprocess_stateid_op+0x190/0x330 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffffa01e779a>] nfsd4_write+0x8a/0x1f0 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:09:11 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:09:11 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:09:11 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:09:11 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:09:11 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:09:11 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:09:11 head kernel: Code: 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 0f b6 17 <38> ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f 1f 44 00
Jul 14 12:09:23 head kernel: NMI watchdog: BUG: soft lockup - CPU#11 stuck for 22s! [kworker/u96:2:9888]
Jul 14 12:09:23 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:09:23 head kernel: CPU: 11 PID: 9888 Comm: kworker/u96:2 Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:09:23 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:09:23 head kernel: Workqueue: nfsd4 laundromat_main [nfsd]
Jul 14 12:09:23 head kernel: task: ffff882ff208a840 ti: ffff8818ca7d0000 task.ti: ffff8818ca7d0000
Jul 14 12:09:23 head kernel: RIP: 0010:[<ffffffff81554177>] [<ffffffff81554177>] _raw_spin_lock+0x37/0x40
Jul 14 12:09:23 head kernel: RSP: 0018:ffff8818ca7d3d68 EFLAGS: 00000216
Jul 14 12:09:23 head kernel: RAX: 0000000000004c5f RBX: 0000000000000000 RCX: 0000000000000022
Jul 14 12:09:23 head kernel: RDX: 000000000000001c RSI: 000000000000005a RDI: ffff8817f96ec130
Jul 14 12:09:23 head kernel: RBP: ffff8818ca7d3d68 R08: ffff8818ca7d0000 R09: 0000000000000001
Jul 14 12:09:23 head kernel: R10: ffff882ffa0c1038 R11: 00000000000ec472 R12: 0000000000000001
Jul 14 12:09:23 head kernel: R13: ffff882ff208ae40 R14: ffff88301f2b0a80 R15: ffff88301f273640
Jul 14 12:09:23 head kernel: FS: 0000000000000000(0000) GS:ffff88301f2a0000(0000) knlGS:0000000000000000
Jul 14 12:09:23 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:09:23 head kernel: CR2: 00007f951cad1000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:09:23 head kernel: Stack:
Jul 14 12:09:23 head kernel: ffff8818ca7d3df8 ffffffffa01f6680 000000000000005a ffff8817f96ec130
Jul 14 12:09:23 head kernel: ffff8817f96ec0a0 ffff8817f96ec000 ffff8818ca7d3dc8 0000000000000292
Jul 14 12:09:23 head kernel: ffff8814ae5ec0c0 ffff8818ca7d3db0 ffff8818ca7d3db0 00000000612153c8
Jul 14 12:09:23 head kernel: Call Trace:
Jul 14 12:09:23 head kernel: [<ffffffffa01f6680>] laundromat_main+0x80/0x480 [nfsd]
Jul 14 12:09:23 head kernel: [<ffffffff8108b7c5>] process_one_work+0x145/0x400
Jul 14 12:09:23 head kernel: [<ffffffff8108bd8b>] worker_thread+0x6b/0x4a0
Jul 14 12:09:23 head kernel: [<ffffffff8108bd20>] ? init_pwq.part.22+0x10/0x10
Jul 14 12:09:23 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:09:23 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:09:23 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:09:23 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:09:23 head kernel: Code: 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 <0f> b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f
Jul 14 12:09:39 head kernel: NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [nfsd:537]
Jul 14 12:09:39 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:09:39 head kernel: CPU: 0 PID: 537 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:09:39 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:09:39 head kernel: task: ffff8817f8a46eb0 ti: ffff8817f1f5c000 task.ti: ffff8817f1f5c000
Jul 14 12:09:39 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:09:39 head kernel: RSP: 0018:ffff8817f1f5fcc8 EFLAGS: 00000297
Jul 14 12:09:39 head kernel: RAX: 00000000000047e1 RBX: ffff8817f96ec000 RCX: 00000000000000c1
Jul 14 12:09:39 head kernel: RDX: 00000000000000c0 RSI: 000000000000132a RDI: ffff88010e29cb40
Jul 14 12:09:39 head kernel: RBP: ffff8817f1f5fcc8 R08: ffff8817db320540 R09: ffff88010e306a00
Jul 14 12:09:39 head kernel: R10: ffff88010e29cb40 R11: ffff88010e29c800 R12: ffff882ff904e718
Jul 14 12:09:39 head kernel: R13: ffff8817f1f5fc60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:09:39 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa00000(0000) knlGS:0000000000000000
Jul 14 12:09:39 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:09:39 head kernel: CR2: 00007f23500d8000 CR3: 0000000001811000 CR4: 00000000001407f0
Jul 14 12:09:39 head kernel: Stack:
Jul 14 12:09:39 head kernel: ffff8817f1f5fd48 ffffffffa01f7fc4 ffff8817db320540 ffff88010e306a00
Jul 14 12:09:39 head kernel: ffff88010e29c800 ffff88010e29cb40 ffff88164fcf8000 ffff8817f1e41068
Jul 14 12:09:39 head kernel: 00000000818adc00 00000000f1e7181a ffff8817f1f5fdd8 ffff8817f1e41000
Jul 14 12:09:39 head kernel: Call Trace:
Jul 14 12:09:39 head kernel: [<ffffffffa01f7fc4>] nfsd4_sequence+0x334/0x610 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:09:39 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:09:39 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:09:39 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:09:39 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:09:39 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:09:39 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:09:39 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:09:39 head kernel: NMI watchdog: BUG: soft lockup - CPU#4 stuck for 22s! [nfsd:535]
Jul 14 12:09:39 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:09:39 head kernel: CPU: 4 PID: 535 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:09:39 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:09:39 head kernel: task: ffff8817f8a43250 ti: ffff8817f1d34000 task.ti: ffff8817f1d34000
Jul 14 12:09:39 head kernel: RIP: 0010:[<ffffffff81554170>] [<ffffffff81554170>] _raw_spin_lock+0x30/0x40
Jul 14 12:09:39 head kernel: RSP: 0018:ffff8817f1d37cc8 EFLAGS: 00000297
Jul 14 12:09:39 head kernel: RAX: 0000000000002998 RBX: ffffffffa0183eec RCX: 000000000000001d
Jul 14 12:09:39 head kernel: RDX: 000000000000001c RSI: 00000000000000d0 RDI: ffff8817f96ec130
Jul 14 12:09:39 head kernel: RBP: ffff8817f1d37cc8 R08: ffff8817dfc3e840 R09: ffff8817fab11000
Jul 14 12:09:39 head kernel: R10: 0000000000000004 R11: ffff8817fab13080 R12: ffff882ff904e718
Jul 14 12:09:39 head kernel: R13: ffff8817f1d37c60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:09:39 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa40000(0000) knlGS:0000000000000000
Jul 14 12:09:39 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:09:39 head kernel: CR2: 00007f216c0e2000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:09:39 head kernel: Stack:
Jul 14 12:09:39 head kernel: ffff8817f1d37d48 ffffffffa01f7d76 0000000015de9b97 000000006f7b8096
Jul 14 12:09:39 head kernel: ffff8817f1d37d38 ffff8817f5302000 ffff8817dfc3e840 ffff8817fab11068
Jul 14 12:09:39 head kernel: ffffffff818adc00 000000006f7b8096 ffff8817fa590000 ffff8817fab11000
Jul 14 12:09:39 head kernel: Call Trace:
Jul 14 12:09:39 head kernel: [<ffffffffa01f7d76>] nfsd4_sequence+0xe6/0x610 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:09:39 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:09:39 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:09:39 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:09:39 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:09:39 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:09:39 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:09:39 head kernel: Code: 55 65 ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 <f3> 90 83 e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00
Jul 14 12:09:39 head kernel: NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [nfsd:539]
Jul 14 12:09:39 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:09:39 head kernel: CPU: 6 PID: 539 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:09:39 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:09:39 head kernel: task: ffff8817f8a45a90 ti: ffff8817f195c000 task.ti: ffff8817f195c000
Jul 14 12:09:39 head kernel: RIP: 0010:[<ffffffff8155417a>] [<ffffffff8155417a>] _raw_spin_lock+0x3a/0x40
Jul 14 12:09:39 head kernel: RSP: 0018:ffff8817f195fbc8 EFLAGS: 00000206
Jul 14 12:09:39 head kernel: RAX: 0000000000004450 RBX: ffff8801178cc900 RCX: 000000000000001e
Jul 14 12:09:39 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:09:39 head kernel: RBP: ffff8817f195fbc8 R08: 0000000000000000 R09: ffff8817f96ec000
Jul 14 12:09:39 head kernel: R10: ffff8817f96ec000 R11: ffff8817f1e44220 R12: ffffffff8124f74c
Jul 14 12:09:39 head kernel: R13: ffff8817f195fc98 R14: ffff8814ec9b3380 R15: ffff8817f8bc1ce0
Jul 14 12:09:39 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa60000(0000) knlGS:0000000000000000
Jul 14 12:09:39 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:09:39 head kernel: CR2: 00007f23380df000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:09:39 head kernel: Stack:
Jul 14 12:09:39 head kernel: ffff8817f195fbf8 ffffffffa01f4eff ffff8817f1e44244 ffff8817f96ec000
Jul 14 12:09:39 head kernel: ffff8817f1e45068 0000000000000009 ffff8817f195fc38 ffffffffa01f4ffa
Jul 14 12:09:39 head kernel: ffff8817f1f62000 0000000000000009 ffff8817f1e44244 ffff8817f195fcd0
Jul 14 12:09:39 head kernel: Call Trace:
Jul 14 12:09:39 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffffa01f6440>] nfs4_preprocess_seqid_op+0x60/0x1a0 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffffa01dee82>] ? rqst_exp_find+0x92/0x190 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffffa01fb0ee>] nfsd4_close+0x9e/0x380 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:09:39 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:09:39 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:09:39 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:09:39 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:09:39 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:09:39 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:09:39 head kernel: Code: 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 0f b6 17 <38> ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f 1f 44 00
Jul 14 12:09:39 head kernel: NMI watchdog: BUG: soft lockup - CPU#8 stuck for 22s! [nfsd:538]
Jul 14 12:09:39 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:09:39 head kernel: CPU: 8 PID: 538 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:09:39 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:09:39 head kernel: task: ffff8817f8a464a0 ti: ffff8817f1860000 task.ti: ffff8817f1860000
Jul 14 12:09:39 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:09:39 head kernel: RSP: 0018:ffff8817f1863c08 EFLAGS: 00000293
Jul 14 12:09:39 head kernel: RAX: 0000000000003f2e RBX: 0000000000000246 RCX: 000000000000001f
Jul 14 12:09:39 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:09:39 head kernel: RBP: ffff8817f1863c08 R08: 0000000000000000 R09: 0000000000000000
Jul 14 12:09:39 head kernel: R10: 0000000000000400 R11: ffff8817f1e42220 R12: ffff882ff7b80de0
Jul 14 12:09:39 head kernel: R13: ffff8817f8b44480 R14: 00000000888ab88f R15: ffff8817f95c1f00
Jul 14 12:09:39 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa80000(0000) knlGS:0000000000000000
Jul 14 12:09:39 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:09:39 head kernel: CR2: 00007f23480ce000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:09:39 head kernel: Stack:
Jul 14 12:09:39 head kernel: ffff8817f1863c38 ffffffffa01f4eff ffff8817f1e42240 ffff8817f96ec000
Jul 14 12:09:39 head kernel: ffff8817f1e43068 0000000000000007 ffff8817f1863c78 ffffffffa01f4ffa
Jul 14 12:09:39 head kernel: ffff8817f1863c98 ffffffff818adc00 ffff8817f1863d10 ffff8817f1e43068
Jul 14 12:09:39 head kernel: Call Trace:
Jul 14 12:09:39 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffffa01fa6e0>] nfs4_preprocess_stateid_op+0x190/0x330 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffffa01e779a>] nfsd4_write+0x8a/0x1f0 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:09:39 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:09:39 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:09:39 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:09:39 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:09:39 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:09:39 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:09:39 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:09:39 head kernel: NMI watchdog: BUG: soft lockup - CPU#10 stuck for 22s! [nfsd:540]
Jul 14 12:09:39 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:09:39 head kernel: CPU: 10 PID: 540 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:09:39 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:09:39 head kernel: task: ffff8817f8a45080 ti: ffff8817f1a78000 task.ti: ffff8817f1a78000
Jul 14 12:09:39 head kernel: RIP: 0010:[<ffffffff8155417a>] [<ffffffff8155417a>] _raw_spin_lock+0x3a/0x40
Jul 14 12:09:39 head kernel: RSP: 0018:ffff8817f1a7bcc8 EFLAGS: 00000202
Jul 14 12:09:39 head kernel: RAX: 000000000000404a RBX: ffffffffa0183eec RCX: 0000000000000020
Jul 14 12:09:39 head kernel: RDX: 000000000000001c RSI: 00000000000000d0 RDI: ffff8817f96ec130
Jul 14 12:09:39 head kernel: RBP: ffff8817f1a7bcc8 R08: ffff881792d83840 R09: ffff8817f1e47000
Jul 14 12:09:39 head kernel: R10: 0000000000000004 R11: ffff8817f1e46080 R12: ffff882ff904e718
Jul 14 12:09:39 head kernel: R13: ffff8817f1a7bc60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:09:39 head kernel: FS: 0000000000000000(0000) GS:ffff88181faa0000(0000) knlGS:0000000000000000
Jul 14 12:09:39 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:09:39 head kernel: CR2: 00007f22ec0c6000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:09:39 head kernel: Stack:
Jul 14 12:09:39 head kernel: ffff8817f1a7bd48 ffffffffa01f7d76 0000000015de9b97 00000000b16b0475
Jul 14 12:09:39 head kernel: ffff8817f1a7bd38 ffff8817f1f64000 ffff881792d83840 ffff8817f1e47068
Jul 14 12:09:39 head kernel: ffffffff818adc00 00000000b16b0475 ffff8817f1a7bdd8 ffff8817f1e47000
Jul 14 12:09:39 head kernel: Call Trace:
Jul 14 12:09:39 head kernel: [<ffffffffa01f7d76>] nfsd4_sequence+0xe6/0x610 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:09:39 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:09:39 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:09:39 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:09:39 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:09:39 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:09:39 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:09:39 head kernel: Code: 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 0f b6 17 <38> ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f 1f 44 00
Jul 14 12:09:39 head kernel: NMI watchdog: BUG: soft lockup - CPU#14 stuck for 22s! [nfsd:541]
Jul 14 12:09:39 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:09:39 head kernel: CPU: 14 PID: 541 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:09:39 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:09:39 head kernel: task: ffff8817f1b80000 ti: ffff8817f1b7c000 task.ti: ffff8817f1b7c000
Jul 14 12:09:39 head kernel: RIP: 0010:[<ffffffff8155417a>] [<ffffffff8155417a>] _raw_spin_lock+0x3a/0x40
Jul 14 12:09:39 head kernel: RSP: 0018:ffff8817f1b7fc08 EFLAGS: 00000202
Jul 14 12:09:39 head kernel: RAX: 0000000000001c61 RBX: 0000000000000246 RCX: 0000000000000021
Jul 14 12:09:39 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:09:39 head kernel: RBP: ffff8817f1b7fc08 R08: 0000000000000000 R09: 0000000000000000
Jul 14 12:09:39 head kernel: R10: 0000000000000400 R11: ffff8817f1a80220 R12: ffff882ff7b80de0
Jul 14 12:09:39 head kernel: R13: ffff8817f8b44480 R14: 0000000060a0f8c6 R15: ffff8817f95c1f00
Jul 14 12:09:39 head kernel: FS: 0000000000000000(0000) GS:ffff88181fae0000(0000) knlGS:0000000000000000
Jul 14 12:09:39 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:09:39 head kernel: CR2: 00007f235c0d5000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:09:39 head kernel: Stack:
Jul 14 12:09:39 head kernel: ffff8817f1b7fc38 ffffffffa01f4eff ffff8817f1a80240 ffff8817f96ec000
Jul 14 12:09:39 head kernel: ffff8817f1a81068 0000000000000007 ffff8817f1b7fc78 ffffffffa01f4ffa
Jul 14 12:09:39 head kernel: ffff8817f1b7fc98 ffffffff818adc00 ffff8817f1b7fd10 ffff8817f1a81068
Jul 14 12:09:39 head kernel: Call Trace:
Jul 14 12:09:39 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffffa01fa6e0>] nfs4_preprocess_stateid_op+0x190/0x330 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffffa01e779a>] nfsd4_write+0x8a/0x1f0 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:09:39 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:09:39 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:09:39 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:09:39 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:09:39 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:09:39 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:09:39 head kernel: Code: 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 0f b6 17 <38> ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f 1f 44 00
Jul 14 12:09:41 head pbs_server[30205]: LOG_ERROR::svr_is_request, bad attempt to connect from 192.168.2.236:706 (address not trusted - check entry in server_priv/nodes)
Jul 14 12:09:43 head pbs_server[30205]: LOG_ERROR::svr_is_request, bad attempt to connect from 192.168.2.233:646 (address not trusted - check entry in server_priv/nodes)
Jul 14 12:09:51 head kernel: NMI watchdog: BUG: soft lockup - CPU#11 stuck for 22s! [kworker/u96:2:9888]
Jul 14 12:09:51 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:09:51 head kernel: CPU: 11 PID: 9888 Comm: kworker/u96:2 Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:09:51 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:09:51 head kernel: Workqueue: nfsd4 laundromat_main [nfsd]
Jul 14 12:09:51 head kernel: task: ffff882ff208a840 ti: ffff8818ca7d0000 task.ti: ffff8818ca7d0000
Jul 14 12:09:51 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:09:51 head kernel: RSP: 0018:ffff8818ca7d3d68 EFLAGS: 00000287
Jul 14 12:09:51 head kernel: RAX: 0000000000007bd9 RBX: 0000000000000000 RCX: 0000000000000022
Jul 14 12:09:51 head kernel: RDX: 000000000000001c RSI: 000000000000005a RDI: ffff8817f96ec130
Jul 14 12:09:51 head kernel: RBP: ffff8818ca7d3d68 R08: ffff8818ca7d0000 R09: 0000000000000001
Jul 14 12:09:51 head kernel: R10: ffff882ffa0c1038 R11: 00000000000ec472 R12: 0000000000000001
Jul 14 12:09:51 head kernel: R13: ffff882ff208ae40 R14: ffff88301f2b0a80 R15: ffff88301f273640
Jul 14 12:09:51 head kernel: FS: 0000000000000000(0000) GS:ffff88301f2a0000(0000) knlGS:0000000000000000
Jul 14 12:09:51 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:09:51 head kernel: CR2: 00007f951cad1000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:09:51 head kernel: Stack:
Jul 14 12:09:51 head kernel: ffff8818ca7d3df8 ffffffffa01f6680 000000000000005a ffff8817f96ec130
Jul 14 12:09:51 head kernel: ffff8817f96ec0a0 ffff8817f96ec000 ffff8818ca7d3dc8 0000000000000292
Jul 14 12:09:51 head kernel: ffff8814ae5ec0c0 ffff8818ca7d3db0 ffff8818ca7d3db0 00000000612153c8
Jul 14 12:09:51 head kernel: Call Trace:
Jul 14 12:09:51 head kernel: [<ffffffffa01f6680>] laundromat_main+0x80/0x480 [nfsd]
Jul 14 12:09:51 head kernel: [<ffffffff8108b7c5>] process_one_work+0x145/0x400
Jul 14 12:09:51 head kernel: [<ffffffff8108bd8b>] worker_thread+0x6b/0x4a0
Jul 14 12:09:51 head kernel: [<ffffffff8108bd20>] ? init_pwq.part.22+0x10/0x10
Jul 14 12:09:51 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:09:51 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:09:51 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:09:51 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:09:51 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:10:07 head kernel: NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [nfsd:537]
Jul 14 12:10:07 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:10:07 head kernel: CPU: 0 PID: 537 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:10:07 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:10:07 head kernel: task: ffff8817f8a46eb0 ti: ffff8817f1f5c000 task.ti: ffff8817f1f5c000
Jul 14 12:10:07 head kernel: RIP: 0010:[<ffffffff81554177>] [<ffffffff81554177>] _raw_spin_lock+0x37/0x40
Jul 14 12:10:07 head kernel: RSP: 0018:ffff8817f1f5fcc8 EFLAGS: 00000206
Jul 14 12:10:07 head kernel: RAX: 000000000000767b RBX: ffff8817f96ec000 RCX: 00000000000000c1
Jul 14 12:10:07 head kernel: RDX: 00000000000000c0 RSI: 000000000000132a RDI: ffff88010e29cb40
Jul 14 12:10:07 head kernel: RBP: ffff8817f1f5fcc8 R08: ffff8817db320540 R09: ffff88010e306a00
Jul 14 12:10:07 head kernel: R10: ffff88010e29cb40 R11: ffff88010e29c800 R12: ffff882ff904e718
Jul 14 12:10:07 head kernel: R13: ffff8817f1f5fc60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:10:07 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa00000(0000) knlGS:0000000000000000
Jul 14 12:10:07 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:10:07 head kernel: CR2: 00007f23500d8000 CR3: 0000000001811000 CR4: 00000000001407f0
Jul 14 12:10:07 head kernel: Stack:
Jul 14 12:10:07 head kernel: ffff8817f1f5fd48 ffffffffa01f7fc4 ffff8817db320540 ffff88010e306a00
Jul 14 12:10:07 head kernel: ffff88010e29c800 ffff88010e29cb40 ffff88164fcf8000 ffff8817f1e41068
Jul 14 12:10:07 head kernel: 00000000818adc00 00000000f1e7181a ffff8817f1f5fdd8 ffff8817f1e41000
Jul 14 12:10:07 head kernel: Call Trace:
Jul 14 12:10:07 head kernel: [<ffffffffa01f7fc4>] nfsd4_sequence+0x334/0x610 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:10:07 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:10:07 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:10:07 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:10:07 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:10:07 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:10:07 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:10:07 head kernel: Code: 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 <0f> b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f
Jul 14 12:10:07 head kernel: NMI watchdog: BUG: soft lockup - CPU#4 stuck for 22s! [nfsd:535]
Jul 14 12:10:07 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:10:07 head kernel: CPU: 4 PID: 535 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:10:07 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:10:07 head kernel: task: ffff8817f8a43250 ti: ffff8817f1d34000 task.ti: ffff8817f1d34000
Jul 14 12:10:07 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:10:07 head kernel: RSP: 0018:ffff8817f1d37cc8 EFLAGS: 00000297
Jul 14 12:10:07 head kernel: RAX: 0000000000000a7c RBX: ffffffffa0183eec RCX: 000000000000001d
Jul 14 12:10:07 head kernel: RDX: 000000000000001c RSI: 00000000000000d0 RDI: ffff8817f96ec130
Jul 14 12:10:07 head kernel: RBP: ffff8817f1d37cc8 R08: ffff8817dfc3e840 R09: ffff8817fab11000
Jul 14 12:10:07 head kernel: R10: 0000000000000004 R11: ffff8817fab13080 R12: ffff882ff904e718
Jul 14 12:10:07 head kernel: R13: ffff8817f1d37c60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:10:07 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa40000(0000) knlGS:0000000000000000
Jul 14 12:10:07 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:10:07 head kernel: CR2: 00007f216c0e2000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:10:07 head kernel: Stack:
Jul 14 12:10:07 head kernel: ffff8817f1d37d48 ffffffffa01f7d76 0000000015de9b97 000000006f7b8096
Jul 14 12:10:07 head kernel: ffff8817f1d37d38 ffff8817f5302000 ffff8817dfc3e840 ffff8817fab11068
Jul 14 12:10:07 head kernel: ffffffff818adc00 000000006f7b8096 ffff8817fa590000 ffff8817fab11000
Jul 14 12:10:07 head kernel: Call Trace:
Jul 14 12:10:07 head kernel: [<ffffffffa01f7d76>] nfsd4_sequence+0xe6/0x610 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:10:07 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:10:07 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:10:07 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:10:07 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:10:07 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:10:07 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:10:07 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:10:07 head kernel: NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [nfsd:539]
Jul 14 12:10:07 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:10:07 head kernel: CPU: 6 PID: 539 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:10:07 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:10:07 head kernel: task: ffff8817f8a45a90 ti: ffff8817f195c000 task.ti: ffff8817f195c000
Jul 14 12:10:07 head kernel: RIP: 0010:[<ffffffff8155417a>] [<ffffffff8155417a>] _raw_spin_lock+0x3a/0x40
Jul 14 12:10:07 head kernel: RSP: 0018:ffff8817f195fbc8 EFLAGS: 00000202
Jul 14 12:10:07 head kernel: RAX: 0000000000006c26 RBX: ffff8801178cc900 RCX: 000000000000001e
Jul 14 12:10:07 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:10:07 head kernel: RBP: ffff8817f195fbc8 R08: 0000000000000000 R09: ffff8817f96ec000
Jul 14 12:10:07 head kernel: R10: ffff8817f96ec000 R11: ffff8817f1e44220 R12: ffffffff8124f74c
Jul 14 12:10:07 head kernel: R13: ffff8817f195fc98 R14: ffff8814ec9b3380 R15: ffff8817f8bc1ce0
Jul 14 12:10:07 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa60000(0000) knlGS:0000000000000000
Jul 14 12:10:07 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:10:07 head kernel: CR2: 00007f23380df000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:10:07 head kernel: Stack:
Jul 14 12:10:07 head kernel: ffff8817f195fbf8 ffffffffa01f4eff ffff8817f1e44244 ffff8817f96ec000
Jul 14 12:10:07 head kernel: ffff8817f1e45068 0000000000000009 ffff8817f195fc38 ffffffffa01f4ffa
Jul 14 12:10:07 head kernel: ffff8817f1f62000 0000000000000009 ffff8817f1e44244 ffff8817f195fcd0
Jul 14 12:10:07 head kernel: Call Trace:
Jul 14 12:10:07 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffffa01f6440>] nfs4_preprocess_seqid_op+0x60/0x1a0 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffffa01dee82>] ? rqst_exp_find+0x92/0x190 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffffa01fb0ee>] nfsd4_close+0x9e/0x380 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:10:07 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:10:07 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:10:07 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:10:07 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:10:07 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:10:07 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:10:07 head kernel: Code: 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 0f b6 17 <38> ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f 1f 44 00
Jul 14 12:10:07 head kernel: NMI watchdog: BUG: soft lockup - CPU#8 stuck for 22s! [nfsd:538]
Jul 14 12:10:07 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:10:07 head kernel: CPU: 8 PID: 538 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:10:07 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:10:07 head kernel: task: ffff8817f8a464a0 ti: ffff8817f1860000 task.ti: ffff8817f1860000
Jul 14 12:10:07 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:10:07 head kernel: RSP: 0018:ffff8817f1863c08 EFLAGS: 00000293
Jul 14 12:10:07 head kernel: RAX: 0000000000000f60 RBX: 0000000000000246 RCX: 000000000000001f
Jul 14 12:10:07 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:10:07 head kernel: RBP: ffff8817f1863c08 R08: 0000000000000000 R09: 0000000000000000
Jul 14 12:10:07 head kernel: R10: 0000000000000400 R11: ffff8817f1e42220 R12: ffff882ff7b80de0
Jul 14 12:10:07 head kernel: R13: ffff8817f8b44480 R14: 00000000888ab88f R15: ffff8817f95c1f00
Jul 14 12:10:07 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa80000(0000) knlGS:0000000000000000
Jul 14 12:10:07 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:10:07 head kernel: CR2: 00007f23480ce000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:10:07 head kernel: Stack:
Jul 14 12:10:07 head kernel: ffff8817f1863c38 ffffffffa01f4eff ffff8817f1e42240 ffff8817f96ec000
Jul 14 12:10:07 head kernel: ffff8817f1e43068 0000000000000007 ffff8817f1863c78 ffffffffa01f4ffa
Jul 14 12:10:07 head kernel: ffff8817f1863c98 ffffffff818adc00 ffff8817f1863d10 ffff8817f1e43068
Jul 14 12:10:07 head kernel: Call Trace:
Jul 14 12:10:07 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffffa01fa6e0>] nfs4_preprocess_stateid_op+0x190/0x330 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffffa01e779a>] nfsd4_write+0x8a/0x1f0 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:10:07 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:10:07 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:10:07 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:10:07 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:10:07 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:10:07 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:10:07 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:10:07 head kernel: NMI watchdog: BUG: soft lockup - CPU#10 stuck for 22s! [nfsd:540]
Jul 14 12:10:07 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:10:07 head kernel: CPU: 10 PID: 540 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:10:07 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:10:07 head kernel: task: ffff8817f8a45080 ti: ffff8817f1a78000 task.ti: ffff8817f1a78000
Jul 14 12:10:07 head kernel: RIP: 0010:[<ffffffff81554170>] [<ffffffff81554170>] _raw_spin_lock+0x30/0x40
Jul 14 12:10:07 head kernel: RSP: 0018:ffff8817f1a7bcc8 EFLAGS: 00000287
Jul 14 12:10:07 head kernel: RAX: 00000000000069d2 RBX: ffffffffa0183eec RCX: 0000000000000020
Jul 14 12:10:07 head kernel: RDX: 000000000000001c RSI: 00000000000000d0 RDI: ffff8817f96ec130
Jul 14 12:10:07 head kernel: RBP: ffff8817f1a7bcc8 R08: ffff881792d83840 R09: ffff8817f1e47000
Jul 14 12:10:07 head kernel: R10: 0000000000000004 R11: ffff8817f1e46080 R12: ffff882ff904e718
Jul 14 12:10:07 head kernel: R13: ffff8817f1a7bc60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:10:07 head kernel: FS: 0000000000000000(0000) GS:ffff88181faa0000(0000) knlGS:0000000000000000
Jul 14 12:10:07 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:10:07 head kernel: CR2: 00007f22ec0c6000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:10:07 head kernel: Stack:
Jul 14 12:10:07 head kernel: ffff8817f1a7bd48 ffffffffa01f7d76 0000000015de9b97 00000000b16b0475
Jul 14 12:10:07 head kernel: ffff8817f1a7bd38 ffff8817f1f64000 ffff881792d83840 ffff8817f1e47068
Jul 14 12:10:07 head kernel: ffffffff818adc00 00000000b16b0475 ffff8817f1a7bdd8 ffff8817f1e47000
Jul 14 12:10:07 head kernel: Call Trace:
Jul 14 12:10:07 head kernel: [<ffffffffa01f7d76>] nfsd4_sequence+0xe6/0x610 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:10:07 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:10:07 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:10:07 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:10:07 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:10:07 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:10:07 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:10:07 head kernel: Code: 55 65 ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 <f3> 90 83 e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00
Jul 14 12:10:07 head kernel: NMI watchdog: BUG: soft lockup - CPU#14 stuck for 22s! [nfsd:541]
Jul 14 12:10:07 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:10:07 head kernel: CPU: 14 PID: 541 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:10:07 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:10:07 head kernel: task: ffff8817f1b80000 ti: ffff8817f1b7c000 task.ti: ffff8817f1b7c000
Jul 14 12:10:07 head kernel: RIP: 0010:[<ffffffff81554170>] [<ffffffff81554170>] _raw_spin_lock+0x30/0x40
Jul 14 12:10:07 head kernel: RSP: 0018:ffff8817f1b7fc08 EFLAGS: 00000283
Jul 14 12:10:07 head kernel: RAX: 00000000000046f1 RBX: 0000000000000246 RCX: 0000000000000021
Jul 14 12:10:07 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:10:07 head kernel: RBP: ffff8817f1b7fc08 R08: 0000000000000000 R09: 0000000000000000
Jul 14 12:10:07 head kernel: R10: 0000000000000400 R11: ffff8817f1a80220 R12: ffff882ff7b80de0
Jul 14 12:10:07 head kernel: R13: ffff8817f8b44480 R14: 0000000060a0f8c6 R15: ffff8817f95c1f00
Jul 14 12:10:07 head kernel: FS: 0000000000000000(0000) GS:ffff88181fae0000(0000) knlGS:0000000000000000
Jul 14 12:10:07 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:10:07 head kernel: CR2: 00007f235c0d5000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:10:07 head kernel: Stack:
Jul 14 12:10:07 head kernel: ffff8817f1b7fc38 ffffffffa01f4eff ffff8817f1a80240 ffff8817f96ec000
Jul 14 12:10:07 head kernel: ffff8817f1a81068 0000000000000007 ffff8817f1b7fc78 ffffffffa01f4ffa
Jul 14 12:10:07 head kernel: ffff8817f1b7fc98 ffffffff818adc00 ffff8817f1b7fd10 ffff8817f1a81068
Jul 14 12:10:07 head kernel: Call Trace:
Jul 14 12:10:07 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffffa01fa6e0>] nfs4_preprocess_stateid_op+0x190/0x330 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffffa01e779a>] nfsd4_write+0x8a/0x1f0 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:10:07 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:10:07 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:10:07 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:10:07 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:10:07 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:10:07 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:10:07 head kernel: Code: 55 65 ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 <f3> 90 83 e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00
Jul 14 12:10:19 head kernel: NMI watchdog: BUG: soft lockup - CPU#11 stuck for 23s! [kworker/u96:2:9888]
Jul 14 12:10:19 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:10:19 head kernel: CPU: 11 PID: 9888 Comm: kworker/u96:2 Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:10:19 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:10:19 head kernel: Workqueue: nfsd4 laundromat_main [nfsd]
Jul 14 12:10:19 head kernel: task: ffff882ff208a840 ti: ffff8818ca7d0000 task.ti: ffff8818ca7d0000
Jul 14 12:10:19 head kernel: RIP: 0010:[<ffffffff81554177>] [<ffffffff81554177>] _raw_spin_lock+0x37/0x40
Jul 14 12:10:19 head kernel: RSP: 0018:ffff8818ca7d3d68 EFLAGS: 00000206
Jul 14 12:10:19 head kernel: RAX: 00000000000000be RBX: 0000000000000000 RCX: 0000000000000022
Jul 14 12:10:19 head kernel: RDX: 000000000000001c RSI: 000000000000005a RDI: ffff8817f96ec130
Jul 14 12:10:19 head kernel: RBP: ffff8818ca7d3d68 R08: ffff8818ca7d0000 R09: 0000000000000001
Jul 14 12:10:19 head kernel: R10: ffff882ffa0c1038 R11: 00000000000ec472 R12: 0000000000000001
Jul 14 12:10:19 head kernel: R13: ffff882ff208ae40 R14: ffff88301f2b0a80 R15: ffff88301f273640
Jul 14 12:10:19 head kernel: FS: 0000000000000000(0000) GS:ffff88301f2a0000(0000) knlGS:0000000000000000
Jul 14 12:10:19 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:10:19 head kernel: CR2: 00007f951cad1000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:10:19 head kernel: Stack:
Jul 14 12:10:19 head kernel: ffff8818ca7d3df8 ffffffffa01f6680 000000000000005a ffff8817f96ec130
Jul 14 12:10:19 head kernel: ffff8817f96ec0a0 ffff8817f96ec000 ffff8818ca7d3dc8 0000000000000292
Jul 14 12:10:19 head kernel: ffff8814ae5ec0c0 ffff8818ca7d3db0 ffff8818ca7d3db0 00000000612153c8
Jul 14 12:10:19 head kernel: Call Trace:
Jul 14 12:10:19 head kernel: [<ffffffffa01f6680>] laundromat_main+0x80/0x480 [nfsd]
Jul 14 12:10:19 head kernel: [<ffffffff8108b7c5>] process_one_work+0x145/0x400
Jul 14 12:10:19 head kernel: [<ffffffff8108bd8b>] worker_thread+0x6b/0x4a0
Jul 14 12:10:19 head kernel: [<ffffffff8108bd20>] ? init_pwq.part.22+0x10/0x10
Jul 14 12:10:19 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:10:19 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:10:19 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:10:19 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:10:19 head kernel: Code: 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 <0f> b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f
Jul 14 12:10:26 head pbs_server[30205]: LOG_ERROR::svr_is_request, bad attempt to connect from 192.168.2.236:706 (address not trusted - check entry in server_priv/nodes)
Jul 14 12:10:28 head pbs_server[30205]: LOG_ERROR::svr_is_request, bad attempt to connect from 192.168.2.233:646 (address not trusted - check entry in server_priv/nodes)
Jul 14 12:10:35 head kernel: NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [nfsd:537]
Jul 14 12:10:35 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:10:35 head kernel: CPU: 0 PID: 537 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:10:35 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:10:35 head kernel: task: ffff8817f8a46eb0 ti: ffff8817f1f5c000 task.ti: ffff8817f1f5c000
Jul 14 12:10:35 head kernel: RIP: 0010:[<ffffffff8155417a>] [<ffffffff8155417a>] _raw_spin_lock+0x3a/0x40
Jul 14 12:10:35 head kernel: RSP: 0018:ffff8817f1f5fcc8 EFLAGS: 00000206
Jul 14 12:10:35 head kernel: RAX: 0000000000004033 RBX: ffff8817f96ec000 RCX: 00000000000000c1
Jul 14 12:10:35 head kernel: RDX: 00000000000000c0 RSI: 000000000000132a RDI: ffff88010e29cb40
Jul 14 12:10:35 head kernel: RBP: ffff8817f1f5fcc8 R08: ffff8817db320540 R09: ffff88010e306a00
Jul 14 12:10:35 head kernel: R10: ffff88010e29cb40 R11: ffff88010e29c800 R12: ffff882ff904e718
Jul 14 12:10:35 head kernel: R13: ffff8817f1f5fc60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:10:35 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa00000(0000) knlGS:0000000000000000
Jul 14 12:10:35 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:10:35 head kernel: CR2: 00007f23500d8000 CR3: 0000000001811000 CR4: 00000000001407f0
Jul 14 12:10:35 head kernel: Stack:
Jul 14 12:10:35 head kernel: ffff8817f1f5fd48 ffffffffa01f7fc4 ffff8817db320540 ffff88010e306a00
Jul 14 12:10:35 head kernel: ffff88010e29c800 ffff88010e29cb40 ffff88164fcf8000 ffff8817f1e41068
Jul 14 12:10:35 head kernel: 00000000818adc00 00000000f1e7181a ffff8817f1f5fdd8 ffff8817f1e41000
Jul 14 12:10:35 head kernel: Call Trace:
Jul 14 12:10:35 head kernel: [<ffffffffa01f7fc4>] nfsd4_sequence+0x334/0x610 [nfsd]
Jul 14 12:10:35 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:10:35 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:10:35 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:10:35 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:10:35 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:10:35 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:10:35 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:10:35 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:10:35 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:10:35 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:10:35 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:10:35 head kernel: Code: 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 83 e8 01 74 f1 0f b6 17 <38> ca 75 f2 5d c3 0f 1f 44 00 00 55 48 89 e5 9c 58 0f 1f 44 00
Jul 14 12:10:35 head kernel: NMI watchdog: BUG: soft lockup - CPU#4 stuck for 22s! [nfsd:535]
Jul 14 12:10:35 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:10:35 head kernel: CPU: 4 PID: 535 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:10:35 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:10:35 head kernel: task: ffff8817f8a43250 ti: ffff8817f1d34000 task.ti: ffff8817f1d34000
Jul 14 12:10:35 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:10:35 head kernel: RSP: 0018:ffff8817f1d37cc8 EFLAGS: 00000297
Jul 14 12:10:35 head kernel: RAX: 0000000000007309 RBX: ffffffffa0183eec RCX: 000000000000001d
Jul 14 12:10:35 head kernel: RDX: 000000000000001c RSI: 00000000000000d0 RDI: ffff8817f96ec130
Jul 14 12:10:35 head kernel: RBP: ffff8817f1d37cc8 R08: ffff8817dfc3e840 R09: ffff8817fab11000
Jul 14 12:10:35 head kernel: R10: 0000000000000004 R11: ffff8817fab13080 R12: ffff882ff904e718
Jul 14 12:10:35 head kernel: R13: ffff8817f1d37c60 R14: ffff882ff904e700 R15: ffff8817a0c2f9c0
Jul 14 12:10:35 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa40000(0000) knlGS:0000000000000000
Jul 14 12:10:35 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:10:35 head kernel: CR2: 00007f216c0e2000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:10:35 head kernel: Stack:
Jul 14 12:10:35 head kernel: ffff8817f1d37d48 ffffffffa01f7d76 0000000015de9b97 000000006f7b8096
Jul 14 12:10:35 head kernel: ffff8817f1d37d38 ffff8817f5302000 ffff8817dfc3e840 ffff8817fab11068
Jul 14 12:10:35 head kernel: ffffffff818adc00 000000006f7b8096 ffff8817fa590000 ffff8817fab11000
Jul 14 12:10:35 head kernel: Call Trace:
Jul 14 12:10:35 head kernel: [<ffffffffa01f7d76>] nfsd4_sequence+0xe6/0x610 [nfsd]
Jul 14 12:10:35 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:10:35 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:10:35 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:10:35 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:10:35 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:10:35 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:10:35 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:10:35 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:10:35 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:10:35 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:10:35 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:10:35 head kernel: Code: ff 04 25 20 b8 00 00 48 89 e5 b8 00 01 00 00 f0 66 0f c1 07 0f b6 cc 38 c1 75 06 5d c3 0f 1f 40 00 b8 00 80 00 00 eb 08 90 f3 90 <83> e8 01 74 f1 0f b6 17 38 ca 75 f2 5d c3 0f 1f 44 00 00 55 48
Jul 14 12:10:35 head kernel: NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [nfsd:539]
Jul 14 12:10:35 head kernel: Modules linked in: bonding joydev mousedev hid_generic usbhid hid coretemp x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm crct10dif_pclmul ipmi_devintf crc32_pclmul crc32c_intel ghash_clmulni_intel sb_edac mgag200 edac_core aesni_intel aes_x86_64 ttm drm_kms_helper drm syscopyarea sysfillrect sysimgblt lrw acpi_pad gf128mul ixgbe igb ptp wmi evdev mdio acpi_power_meter iTCO_wdt pps_core hwmon iTCO_vendor_support mac_hid ipmi_si glue_helper i2c_algo_bit i2c_core ablk_helper cryptd dcdbas tpm_tis dca ipmi_msghandler tpm pcspkr button shpchp mei_me mei lpc_ich processor sch_fq_codel nfs nfsd auth_rpcgss oid_registry nfs_acl lockd grace sunrpc fscache ext4 crc16 mbcache jbd2 sd_mod ehci_pci ehci_hcd megaraid_sas usbcore usb_common scsi_mod
Jul 14 12:10:35 head kernel: CPU: 6 PID: 539 Comm: nfsd Tainted: G D W L 3.18.2-2-ARCH #1
Jul 14 12:10:35 head kernel: Hardware name: Dell Inc. PowerVault NX3200/0DCWD1, BIOS 2.2.2 01/16/2014
Jul 14 12:10:35 head kernel: task: ffff8817f8a45a90 ti: ffff8817f195c000 task.ti: ffff8817f195c000
Jul 14 12:10:35 head kernel: RIP: 0010:[<ffffffff81554172>] [<ffffffff81554172>] _raw_spin_lock+0x32/0x40
Jul 14 12:10:35 head kernel: RSP: 0018:ffff8817f195fbc8 EFLAGS: 00000293
Jul 14 12:10:35 head kernel: RAX: 0000000000001ac3 RBX: ffff8801178cc900 RCX: 000000000000001e
Jul 14 12:10:35 head kernel: RDX: 000000000000001c RSI: 000000005580fc2e RDI: ffff8817f96ec130
Jul 14 12:10:35 head kernel: RBP: ffff8817f195fbc8 R08: 0000000000000000 R09: ffff8817f96ec000
Jul 14 12:10:35 head kernel: R10: ffff8817f96ec000 R11: ffff8817f1e44220 R12: ffffffff8124f74c
Jul 14 12:10:35 head kernel: R13: ffff8817f195fc98 R14: ffff8814ec9b3380 R15: ffff8817f8bc1ce0
Jul 14 12:10:35 head kernel: FS: 0000000000000000(0000) GS:ffff88181fa60000(0000) knlGS:0000000000000000
Jul 14 12:10:35 head kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 14 12:10:35 head kernel: CR2: 00007f23380df000 CR3: 0000000001811000 CR4: 00000000001407e0
Jul 14 12:10:35 head kernel: Stack:
Jul 14 12:10:35 head kernel: ffff8817f195fbf8 ffffffffa01f4eff ffff8817f1e44244 ffff8817f96ec000
Jul 14 12:10:35 head kernel: ffff8817f1e45068 0000000000000009 ffff8817f195fc38 ffffffffa01f4ffa
Jul 14 12:10:35 head kernel: ffff8817f1f62000 0000000000000009 ffff8817f1e44244 ffff8817f195fcd0
Jul 14 12:10:35 head kernel: Call Trace:
Jul 14 12:10:35 head kernel: [<ffffffffa01f4eff>] lookup_clientid.isra.54+0x7f/0xf0 [nfsd]
Jul 14 12:10:35 head kernel: [<ffffffffa01f4ffa>] nfsd4_lookup_stateid+0x8a/0xe0 [nfsd]
Jul 14 12:10:35 head kernel: [<ffffffffa01f6440>] nfs4_preprocess_seqid_op+0x60/0x1a0 [nfsd]
Jul 14 12:10:35 head kernel: [<ffffffffa01dee82>] ? rqst_exp_find+0x92/0x190 [nfsd]
Jul 14 12:10:35 head kernel: [<ffffffffa01fb0ee>] nfsd4_close+0x9e/0x380 [nfsd]
Jul 14 12:10:35 head kernel: [<ffffffffa01e8ccf>] nfsd4_proc_compound+0x3ef/0x700 [nfsd]
Jul 14 12:10:35 head kernel: [<ffffffffa01d4f33>] nfsd_dispatch+0xc3/0x210 [nfsd]
Jul 14 12:10:35 head kernel: [<ffffffffa017a6d2>] ? svc_tcp_adjust_wspace+0x12/0x30 [sunrpc]
Jul 14 12:10:35 head kernel: [<ffffffffa0178d6c>] svc_process_common+0x45c/0x670 [sunrpc]
Jul 14 12:10:35 head kernel: [<ffffffffa0179083>] svc_process+0x103/0x170 [sunrpc]
Jul 14 12:10:35 head kernel: [<ffffffffa01d48a7>] nfsd+0x127/0x1a0 [nfsd]
Jul 14 12:10:35 head kernel: [<ffffffffa01d4780>] ? nfsd_destroy+0xa0/0xa0 [nfsd]
Jul 14 12:10:35 head kernel: [<ffffffff81090e0a>] kthread+0xea/0x100
Jul 14 12:10:35 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0
Jul 14 12:10:35 head kernel: [<ffffffff81554bfc>] ret_from_fork+0x7c/0xb0
Jul 14 12:10:35 head kernel: [<ffffffff81090d20>] ? kthread_create_on_node+0x1c0/0x1c0Last edited by chuliqiang (2015-07-16 03:50:02)
Offline
#2 2015-07-15 11:26:36
- Awebb
- Member
- Registered: 2010-05-06
- Posts: 6,688
Re: My NFS is crash and computer CPU is stuck
1. Please use [ code][ /code] tags!
2. This is the output of what exactly?
3. Share your nfs config.
4. Describe what you do to start and connect and under what circumstances the crash happens.
5. See if nfs has its own log files in /var/log.
Offline