You are not logged in.
- Topics: Active | Unanswered
Pages: 1
#1 2018-09-05 02:31:15
- alex.forencich
- Member
- Registered: 2011-05-29
- Posts: 96
btrfs hang
I seem to be getting hangs with btrfs:
Sep 04 16:43:45 atomic kernel: INFO: task kworker/u16:5:220 blocked for more than 120 seconds.
Sep 04 16:43:45 atomic kernel: Tainted: G O 4.18.5-arch1-1-ARCH #1
Sep 04 16:43:45 atomic kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep 04 16:43:45 atomic kernel: kworker/u16:5 D 0 220 2 0x80000000
Sep 04 16:43:45 atomic kernel: Workqueue: btrfs-endio-write btrfs_endio_write_helper [btrfs]
Sep 04 16:43:45 atomic kernel: Call Trace:
Sep 04 16:43:45 atomic kernel: ? __schedule+0x29b/0x8b0
Sep 04 16:43:45 atomic kernel: ? preempt_count_add+0x68/0xa0
Sep 04 16:43:45 atomic kernel: schedule+0x32/0x90
Sep 04 16:43:45 atomic kernel: wait_current_trans+0xb6/0xe0 [btrfs]
Sep 04 16:43:45 atomic kernel: ? wait_woken+0x80/0x80
Sep 04 16:43:45 atomic kernel: start_transaction+0x1d3/0x3f0 [btrfs]
Sep 04 16:43:45 atomic kernel: btrfs_finish_ordered_io+0x27e/0x7f0 [btrfs]
Sep 04 16:43:45 atomic kernel: ? syscall_return_via_sysret+0x14/0x83
Sep 04 16:43:45 atomic kernel: normal_work_helper+0xbd/0x350 [btrfs]
Sep 04 16:43:45 atomic kernel: process_one_work+0x1eb/0x3c0
Sep 04 16:43:45 atomic kernel: worker_thread+0x2d/0x3d0
Sep 04 16:43:45 atomic kernel: ? process_one_work+0x3c0/0x3c0
Sep 04 16:43:45 atomic kernel: kthread+0x112/0x130
Sep 04 16:43:45 atomic kernel: ? kthread_flush_work_fn+0x10/0x10
Sep 04 16:43:45 atomic kernel: ret_from_fork+0x35/0x40
Sep 04 16:43:45 atomic kernel: INFO: task syncthing:2245 blocked for more than 120 seconds.
Sep 04 16:43:45 atomic kernel: Tainted: G O 4.18.5-arch1-1-ARCH #1
Sep 04 16:43:45 atomic kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep 04 16:43:45 atomic kernel: syncthing D 0 2245 1 0x00000080
Sep 04 16:43:45 atomic kernel: Call Trace:
Sep 04 16:43:45 atomic kernel: ? __schedule+0x29b/0x8b0
Sep 04 16:43:45 atomic kernel: ? preempt_count_add+0x68/0xa0
Sep 04 16:43:45 atomic kernel: schedule+0x32/0x90
Sep 04 16:43:45 atomic kernel: wait_for_commit+0x53/0x80 [btrfs]
Sep 04 16:43:45 atomic kernel: ? wait_woken+0x80/0x80
Sep 04 16:43:45 atomic kernel: btrfs_commit_transaction+0x69e/0x8a0 [btrfs]
Sep 04 16:43:45 atomic kernel: ? dput.part.4+0xa4/0x130
Sep 04 16:43:45 atomic kernel: ? btrfs_log_dentry_safe+0x54/0x70 [btrfs]
Sep 04 16:43:45 atomic kernel: btrfs_sync_file+0x269/0x430 [btrfs]
Sep 04 16:43:45 atomic kernel: do_fsync+0x38/0x70
Sep 04 16:43:45 atomic kernel: __x64_sys_fsync+0x10/0x20
Sep 04 16:43:45 atomic kernel: do_syscall_64+0x5b/0x170
Sep 04 16:43:45 atomic kernel: entry_SYSCALL_64_after_hwframe+0x44/0xa9
Sep 04 16:43:45 atomic kernel: RIP: 0033:0x4abb20
Sep 04 16:43:45 atomic kernel: Code: Bad RIP value.
Sep 04 16:43:45 atomic kernel: RSP: 002b:000000c4210e9db8 EFLAGS: 00000212 ORIG_RAX: 000000000000004a
Sep 04 16:43:46 atomic kernel: RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00000000004abb20
Sep 04 16:43:46 atomic kernel: RDX: 0000000000000000 RSI: 0000000000000000 RDI: 000000000000004b
Sep 04 16:43:46 atomic kernel: RBP: 000000c4210e9e00 R08: 0000000000000000 R09: 0000000000000000
Sep 04 16:43:46 atomic kernel: R10: 0000000000000000 R11: 0000000000000212 R12: 000000c422ba4f60
Sep 04 16:43:46 atomic kernel: R13: 0000000000000001 R14: 000000c4203ee0c0 R15: 0000000000000001
Sep 04 16:43:46 atomic kernel: INFO: task kworker/u16:15:2553 blocked for more than 120 seconds.
Sep 04 16:43:46 atomic kernel: Tainted: G O 4.18.5-arch1-1-ARCH #1
Sep 04 16:43:46 atomic kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep 04 16:43:46 atomic kernel: kworker/u16:15 D 0 2553 2 0x80000080
Sep 04 16:43:46 atomic kernel: Workqueue: btrfs-endio-write btrfs_endio_write_helper [btrfs]
Sep 04 16:43:46 atomic kernel: Call Trace:
Sep 04 16:43:46 atomic kernel: ? __schedule+0x29b/0x8b0
Sep 04 16:43:46 atomic kernel: ? preempt_count_add+0x68/0xa0
Sep 04 16:43:46 atomic kernel: schedule+0x32/0x90
Sep 04 16:43:46 atomic kernel: wait_current_trans+0xb6/0xe0 [btrfs]
Sep 04 16:43:46 atomic kernel: ? wait_woken+0x80/0x80
Sep 04 16:43:46 atomic kernel: start_transaction+0x1d3/0x3f0 [btrfs]
Sep 04 16:43:46 atomic kernel: btrfs_finish_ordered_io+0x27e/0x7f0 [btrfs]
Sep 04 16:43:46 atomic kernel: normal_work_helper+0xbd/0x350 [btrfs]
Sep 04 16:43:46 atomic kernel: process_one_work+0x1eb/0x3c0
Sep 04 16:43:46 atomic kernel: worker_thread+0x2d/0x3d0
Sep 04 16:43:46 atomic kernel: ? process_one_work+0x3c0/0x3c0
Sep 04 16:43:46 atomic kernel: kthread+0x112/0x130
Sep 04 16:43:46 atomic kernel: ? kthread_flush_work_fn+0x10/0x10
Sep 04 16:43:46 atomic kernel: ret_from_fork+0x35/0x40
Sep 04 16:43:46 atomic kernel: INFO: task btrfs:3352 blocked for more than 120 seconds.
Sep 04 16:43:46 atomic kernel: Tainted: G O 4.18.5-arch1-1-ARCH #1
Sep 04 16:43:46 atomic kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep 04 16:43:46 atomic kernel: btrfs D 0 3352 1 0x00000080
Sep 04 16:43:46 atomic kernel: Call Trace:
Sep 04 16:43:46 atomic kernel: ? __schedule+0x29b/0x8b0
Sep 04 16:43:46 atomic kernel: ? preempt_count_add+0x68/0xa0
Sep 04 16:43:46 atomic kernel: schedule+0x32/0x90
Sep 04 16:43:46 atomic kernel: wait_for_commit+0x53/0x80 [btrfs]
Sep 04 16:43:46 atomic kernel: ? wait_woken+0x80/0x80
Sep 04 16:43:46 atomic kernel: btrfs_wait_for_commit+0x97/0x130 [btrfs]
Sep 04 16:43:46 atomic kernel: btrfs_inc_block_group_ro+0x50/0x160 [btrfs]
Sep 04 16:43:46 atomic kernel: scrub_enumerate_chunks+0x191/0x620 [btrfs]
Sep 04 16:43:46 atomic kernel: ? wait_woken+0x80/0x80
Sep 04 16:43:46 atomic kernel: btrfs_scrub_dev+0x1b2/0x530 [btrfs]
Sep 04 16:43:46 atomic kernel: ? __kmalloc_track_caller+0x1a1/0x220
Sep 04 16:43:46 atomic kernel: ? preempt_count_add+0x49/0xa0
Sep 04 16:43:46 atomic kernel: btrfs_ioctl+0xa96/0x2d00 [btrfs]
Sep 04 16:43:46 atomic kernel: ? _raw_spin_unlock+0x16/0x30
Sep 04 16:43:46 atomic kernel: ? __handle_mm_fault+0x102f/0x14c0
Sep 04 16:43:46 atomic kernel: ? do_vfs_ioctl+0xa4/0x620
Sep 04 16:43:46 atomic kernel: do_vfs_ioctl+0xa4/0x620
Sep 04 16:43:46 atomic kernel: ? syscall_slow_exit_work+0x19b/0x1b0
Sep 04 16:43:46 atomic kernel: ksys_ioctl+0x60/0x90
Sep 04 16:43:46 atomic kernel: __x64_sys_ioctl+0x16/0x20
Sep 04 16:43:46 atomic kernel: do_syscall_64+0x5b/0x170
Sep 04 16:43:46 atomic kernel: entry_SYSCALL_64_after_hwframe+0x44/0xa9
Sep 04 16:43:46 atomic kernel: RIP: 0033:0x7fdbd77e079b
Sep 04 16:43:46 atomic kernel: Code: Bad RIP value.
Sep 04 16:43:46 atomic kernel: RSP: 002b:00007fdbd76e9d38 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
Sep 04 16:43:46 atomic kernel: RAX: ffffffffffffffda RBX: 000055eb3f1c4660 RCX: 00007fdbd77e079b
Sep 04 16:43:46 atomic kernel: RDX: 000055eb3f1c4660 RSI: 00000000c400941b RDI: 0000000000000003
Sep 04 16:43:46 atomic kernel: RBP: 0000000000000000 R08: 00007fdbd76ea700 R09: 0000000000000000
Sep 04 16:43:46 atomic kernel: R10: 00007fdbd76ea700 R11: 0000000000000246 R12: 00007fffdb96b8ce
Sep 04 16:43:46 atomic kernel: R13: 00007fffdb96b8cf R14: 00007fdbd76ea700 R15: 0000000000000000
Sep 04 16:43:46 atomic kernel: INFO: task btrfs:3353 blocked for more than 120 seconds.
Sep 04 16:43:46 atomic kernel: Tainted: G O 4.18.5-arch1-1-ARCH #1
Sep 04 16:43:46 atomic kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep 04 16:43:47 atomic kernel: btrfs D 0 3353 1 0x00000080
Sep 04 16:43:47 atomic kernel: Call Trace:
Sep 04 16:43:47 atomic kernel: ? __schedule+0x29b/0x8b0
Sep 04 16:43:47 atomic kernel: ? btrfs_async_run_delayed_refs+0x118/0x130 [btrfs]
Sep 04 16:43:47 atomic kernel: ? preempt_count_add+0x68/0xa0
Sep 04 16:43:47 atomic kernel: schedule+0x32/0x90
Sep 04 16:43:47 atomic kernel: wait_for_commit+0x53/0x80 [btrfs]
Sep 04 16:43:47 atomic kernel: ? wait_woken+0x80/0x80
Sep 04 16:43:47 atomic kernel: btrfs_wait_for_commit+0x97/0x130 [btrfs]
Sep 04 16:43:47 atomic kernel: btrfs_inc_block_group_ro+0x50/0x160 [btrfs]
Sep 04 16:43:47 atomic kernel: scrub_enumerate_chunks+0x191/0x620 [btrfs]
Sep 04 16:43:47 atomic kernel: ? wait_woken+0x80/0x80
Sep 04 16:43:47 atomic kernel: btrfs_scrub_dev+0x1b2/0x530 [btrfs]
Sep 04 16:43:47 atomic kernel: ? __kmalloc_track_caller+0x1a1/0x220
Sep 04 16:43:47 atomic kernel: ? preempt_count_add+0x49/0xa0
Sep 04 16:43:47 atomic kernel: btrfs_ioctl+0xa96/0x2d00 [btrfs]
Sep 04 16:43:47 atomic kernel: ? do_vfs_ioctl+0xa4/0x620
Sep 04 16:43:47 atomic kernel: do_vfs_ioctl+0xa4/0x620
Sep 04 16:43:47 atomic kernel: ? syscall_slow_exit_work+0x19b/0x1b0
Sep 04 16:43:47 atomic kernel: ksys_ioctl+0x60/0x90
Sep 04 16:43:47 atomic kernel: ? __switch_to_asm+0x40/0x70
Sep 04 16:43:47 atomic kernel: __x64_sys_ioctl+0x16/0x20
Sep 04 16:43:47 atomic kernel: do_syscall_64+0x5b/0x170
Sep 04 16:43:47 atomic kernel: entry_SYSCALL_64_after_hwframe+0x44/0xa9
Sep 04 16:43:47 atomic kernel: RIP: 0033:0x7fdbd77e079b
Sep 04 16:43:47 atomic kernel: Code: Bad RIP value.
Sep 04 16:43:47 atomic kernel: RSP: 002b:00007fdbd6ee8d38 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
Sep 04 16:43:47 atomic kernel: RAX: ffffffffffffffda RBX: 000055eb3f1c4ae0 RCX: 00007fdbd77e079b
Sep 04 16:43:47 atomic kernel: RDX: 000055eb3f1c4ae0 RSI: 00000000c400941b RDI: 0000000000000003
Sep 04 16:43:47 atomic kernel: RBP: 0000000000000000 R08: 00007fdbd6ee9700 R09: 0000000000000000
Sep 04 16:43:47 atomic kernel: R10: 00007fdbd6ee9700 R11: 0000000000000246 R12: 00007fffdb96b8ce
Sep 04 16:43:47 atomic kernel: R13: 00007fffdb96b8cf R14: 00007fdbd6ee9700 R15: 0000000000000000
Sep 04 16:43:47 atomic kernel: INFO: task btrfs:3354 blocked for more than 120 seconds.
Sep 04 16:43:47 atomic kernel: Tainted: G O 4.18.5-arch1-1-ARCH #1
Sep 04 16:43:47 atomic kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep 04 16:43:47 atomic kernel: btrfs D 0 3354 1 0x00000080
Sep 04 16:43:47 atomic kernel: Call Trace:
Sep 04 16:43:47 atomic kernel: ? __schedule+0x29b/0x8b0
Sep 04 16:43:47 atomic kernel: ? preempt_count_add+0x68/0xa0
Sep 04 16:43:47 atomic kernel: schedule+0x32/0x90
Sep 04 16:43:47 atomic kernel: wait_for_commit+0x53/0x80 [btrfs]
Sep 04 16:43:47 atomic kernel: ? wait_woken+0x80/0x80
Sep 04 16:43:47 atomic kernel: btrfs_wait_for_commit+0x97/0x130 [btrfs]
Sep 04 16:43:47 atomic kernel: btrfs_inc_block_group_ro+0x50/0x160 [btrfs]
Sep 04 16:43:47 atomic kernel: scrub_enumerate_chunks+0x191/0x620 [btrfs]
Sep 04 16:43:47 atomic kernel: ? wait_woken+0x80/0x80
Sep 04 16:43:47 atomic kernel: btrfs_scrub_dev+0x1b2/0x530 [btrfs]
Sep 04 16:43:47 atomic kernel: ? __kmalloc_track_caller+0x1a1/0x220
Sep 04 16:43:47 atomic kernel: ? preempt_count_add+0x49/0xa0
Sep 04 16:43:47 atomic kernel: btrfs_ioctl+0xa96/0x2d00 [btrfs]
Sep 04 16:43:47 atomic kernel: ? do_vfs_ioctl+0xa4/0x620
Sep 04 16:43:47 atomic kernel: do_vfs_ioctl+0xa4/0x620
Sep 04 16:43:47 atomic kernel: ? syscall_slow_exit_work+0x19b/0x1b0
Sep 04 16:43:47 atomic kernel: ksys_ioctl+0x60/0x90
Sep 04 16:43:47 atomic kernel: ? __switch_to_asm+0x40/0x70
Sep 04 16:43:47 atomic kernel: __x64_sys_ioctl+0x16/0x20
Sep 04 16:43:47 atomic kernel: do_syscall_64+0x5b/0x170
Sep 04 16:43:47 atomic kernel: entry_SYSCALL_64_after_hwframe+0x44/0xa9
Sep 04 16:43:47 atomic kernel: RIP: 0033:0x7fdbd77e079b
Sep 04 16:43:47 atomic kernel: Code: Bad RIP value.
Sep 04 16:43:47 atomic kernel: RSP: 002b:00007fdbd66e7d38 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
Sep 04 16:43:47 atomic kernel: RAX: ffffffffffffffda RBX: 000055eb3f1c4f60 RCX: 00007fdbd77e079b
Sep 04 16:43:47 atomic kernel: RDX: 000055eb3f1c4f60 RSI: 00000000c400941b RDI: 0000000000000003
Sep 04 16:43:47 atomic kernel: RBP: 0000000000000000 R08: 00007fdbd66e8700 R09: 0000000000000000
Sep 04 16:43:47 atomic kernel: R10: 00007fdbd66e8700 R11: 0000000000000246 R12: 00007fffdb96b8ce
Sep 04 16:43:47 atomic kernel: R13: 00007fffdb96b8cf R14: 00007fdbd66e8700 R15: 0000000000000000
Sep 04 16:43:47 atomic kernel: INFO: task btrfs:3355 blocked for more than 120 seconds.
Sep 04 16:43:47 atomic kernel: Tainted: G O 4.18.5-arch1-1-ARCH #1
Sep 04 16:43:47 atomic kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep 04 16:43:47 atomic kernel: btrfs D 0 3355 1 0x00000080
Sep 04 16:43:47 atomic kernel: Call Trace:
Sep 04 16:43:47 atomic kernel: ? __schedule+0x29b/0x8b0
Sep 04 16:43:47 atomic kernel: ? preempt_count_add+0x68/0xa0
Sep 04 16:43:47 atomic kernel: schedule+0x32/0x90
Sep 04 16:43:47 atomic kernel: wait_for_commit+0x53/0x80 [btrfs]
Sep 04 16:43:47 atomic kernel: ? wait_woken+0x80/0x80
Sep 04 16:43:47 atomic kernel: btrfs_wait_for_commit+0x97/0x130 [btrfs]
Sep 04 16:43:47 atomic kernel: btrfs_inc_block_group_ro+0x50/0x160 [btrfs]
Sep 04 16:43:47 atomic kernel: scrub_enumerate_chunks+0x191/0x620 [btrfs]
Sep 04 16:43:47 atomic kernel: ? wait_woken+0x80/0x80
Sep 04 16:43:47 atomic kernel: btrfs_scrub_dev+0x1b2/0x530 [btrfs]
Sep 04 16:43:47 atomic kernel: ? __kmalloc_track_caller+0x1a1/0x220
Sep 04 16:43:47 atomic kernel: ? preempt_count_add+0x49/0xa0
Sep 04 16:43:47 atomic kernel: btrfs_ioctl+0xa96/0x2d00 [btrfs]
Sep 04 16:43:47 atomic kernel: ? do_vfs_ioctl+0xa4/0x620
Sep 04 16:43:47 atomic kernel: do_vfs_ioctl+0xa4/0x620
Sep 04 16:43:47 atomic kernel: ? syscall_slow_exit_work+0x19b/0x1b0
Sep 04 16:43:47 atomic kernel: ksys_ioctl+0x60/0x90
Sep 04 16:43:47 atomic kernel: ? __switch_to_asm+0x40/0x70
Sep 04 16:43:47 atomic kernel: __x64_sys_ioctl+0x16/0x20
Sep 04 16:43:47 atomic kernel: do_syscall_64+0x5b/0x170
Sep 04 16:43:47 atomic kernel: entry_SYSCALL_64_after_hwframe+0x44/0xa9
Sep 04 16:43:47 atomic kernel: RIP: 0033:0x7fdbd77e079b
Sep 04 16:43:47 atomic kernel: Code: Bad RIP value.
Sep 04 16:43:47 atomic kernel: RSP: 002b:00007fdbd5ee6d38 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
Sep 04 16:43:47 atomic kernel: RAX: ffffffffffffffda RBX: 000055eb3f1c53e0 RCX: 00007fdbd77e079b
Sep 04 16:43:47 atomic kernel: RDX: 000055eb3f1c53e0 RSI: 00000000c400941b RDI: 0000000000000003
Sep 04 16:43:47 atomic kernel: RBP: 0000000000000000 R08: 00007fdbd5ee7700 R09: 0000000000000000
Sep 04 16:43:47 atomic kernel: R10: 00007fdbd5ee7700 R11: 0000000000000246 R12: 00007fffdb96b8ce
Sep 04 16:43:47 atomic kernel: R13: 00007fffdb96b8cf R14: 00007fdbd5ee7700 R15: 0000000000000000
Sep 04 16:43:47 atomic kernel: INFO: task kworker/u16:6:18402 blocked for more than 120 seconds.
Sep 04 16:43:47 atomic kernel: Tainted: G O 4.18.5-arch1-1-ARCH #1
Sep 04 16:43:47 atomic kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep 04 16:43:47 atomic kernel: kworker/u16:6 D 0 18402 2 0x80000080
Sep 04 16:43:47 atomic kernel: Workqueue: btrfs-endio-write btrfs_endio_write_helper [btrfs]
Sep 04 16:43:47 atomic kernel: Call Trace:
Sep 04 16:43:47 atomic kernel: ? __schedule+0x29b/0x8b0
Sep 04 16:43:47 atomic kernel: ? preempt_count_add+0x68/0xa0
Sep 04 16:43:47 atomic kernel: schedule+0x32/0x90
Sep 04 16:43:47 atomic kernel: wait_current_trans+0xb6/0xe0 [btrfs]
Sep 04 16:43:47 atomic kernel: ? wait_woken+0x80/0x80
Sep 04 16:43:47 atomic kernel: start_transaction+0x1d3/0x3f0 [btrfs]
Sep 04 16:43:47 atomic kernel: btrfs_finish_ordered_io+0x27e/0x7f0 [btrfs]
Sep 04 16:43:47 atomic kernel: ? syscall_return_via_sysret+0x14/0x83
Sep 04 16:43:47 atomic kernel: normal_work_helper+0xbd/0x350 [btrfs]
Sep 04 16:43:47 atomic kernel: process_one_work+0x1eb/0x3c0
Sep 04 16:43:47 atomic kernel: worker_thread+0x2d/0x3d0
Sep 04 16:43:47 atomic kernel: ? process_one_work+0x3c0/0x3c0
Sep 04 16:43:47 atomic kernel: kthread+0x112/0x130
Sep 04 16:43:47 atomic kernel: ? kthread_flush_work_fn+0x10/0x10
Sep 04 16:43:47 atomic kernel: ret_from_fork+0x35/0x40
Sep 04 16:43:47 atomic kernel: INFO: task kworker/u16:7:18698 blocked for more than 120 seconds.
Sep 04 16:43:47 atomic kernel: Tainted: G O 4.18.5-arch1-1-ARCH #1
Sep 04 16:43:47 atomic kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep 04 16:43:47 atomic kernel: kworker/u16:7 D 0 18698 2 0x80000080
Sep 04 16:43:47 atomic kernel: Workqueue: btrfs-endio-write btrfs_endio_write_helper [btrfs]
Sep 04 16:43:47 atomic kernel: Call Trace:
Sep 04 16:43:47 atomic kernel: ? __schedule+0x29b/0x8b0
Sep 04 16:43:47 atomic kernel: ? preempt_count_add+0x68/0xa0
Sep 04 16:43:47 atomic kernel: schedule+0x32/0x90
Sep 04 16:43:47 atomic kernel: wait_current_trans+0xb6/0xe0 [btrfs]
Sep 04 16:43:47 atomic kernel: ? wait_woken+0x80/0x80
Sep 04 16:43:47 atomic kernel: start_transaction+0x1d3/0x3f0 [btrfs]
Sep 04 16:43:47 atomic kernel: btrfs_finish_ordered_io+0x27e/0x7f0 [btrfs]
Sep 04 16:43:47 atomic kernel: ? syscall_return_via_sysret+0x14/0x83
Sep 04 16:43:47 atomic kernel: normal_work_helper+0xbd/0x350 [btrfs]
Sep 04 16:43:47 atomic kernel: process_one_work+0x1eb/0x3c0
Sep 04 16:43:47 atomic kernel: worker_thread+0x2d/0x3d0
Sep 04 16:43:47 atomic kernel: ? process_one_work+0x3c0/0x3c0
Sep 04 16:43:47 atomic kernel: kthread+0x112/0x130
Sep 04 16:43:47 atomic kernel: ? kthread_flush_work_fn+0x10/0x10
Sep 04 16:43:47 atomic kernel: ret_from_fork+0x35/0x40
Sep 04 16:43:47 atomic kernel: INFO: task kworker/u16:3:30532 blocked for more than 120 seconds.
Sep 04 16:43:47 atomic kernel: Tainted: G O 4.18.5-arch1-1-ARCH #1
Sep 04 16:43:48 atomic kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep 04 16:43:48 atomic kernel: kworker/u16:3 D 0 30532 2 0x80000080
Sep 04 16:43:48 atomic kernel: Workqueue: btrfs-endio-write btrfs_endio_write_helper [btrfs]
Sep 04 16:43:48 atomic kernel: Call Trace:
Sep 04 16:43:48 atomic kernel: ? __schedule+0x29b/0x8b0
Sep 04 16:43:48 atomic kernel: ? preempt_count_add+0x68/0xa0
Sep 04 16:43:48 atomic kernel: schedule+0x32/0x90
Sep 04 16:43:48 atomic kernel: wait_current_trans+0xb6/0xe0 [btrfs]
Sep 04 16:43:48 atomic kernel: ? wait_woken+0x80/0x80
Sep 04 16:43:48 atomic kernel: start_transaction+0x1d3/0x3f0 [btrfs]
Sep 04 16:43:48 atomic kernel: btrfs_finish_ordered_io+0x27e/0x7f0 [btrfs]
Sep 04 16:43:48 atomic kernel: ? syscall_return_via_sysret+0x14/0x83
Sep 04 16:43:48 atomic kernel: normal_work_helper+0xbd/0x350 [btrfs]
Sep 04 16:43:48 atomic kernel: process_one_work+0x1eb/0x3c0
Sep 04 16:43:48 atomic kernel: worker_thread+0x2d/0x3d0
Sep 04 16:43:48 atomic kernel: ? process_one_work+0x3c0/0x3c0
Sep 04 16:43:48 atomic kernel: kthread+0x112/0x130
Sep 04 16:43:48 atomic kernel: ? kthread_flush_work_fn+0x10/0x10
Sep 04 16:43:48 atomic kernel: ret_from_fork+0x35/0x40Latest everything installed as of Sept. 4. Has anyone else seen something similar? I'm going to boot into the LTS kernel to see if I am seeing the same thing there.
Last edited by alex.forencich (2018-09-05 03:42:15)
Offline
#2 2018-09-05 03:40:21
- alex.forencich
- Member
- Registered: 2011-05-29
- Posts: 96
Re: btrfs hang
It previously hung yesterday with the following trace:
Sep 03 04:37:46 atomic kernel: INFO: task btrfs-transacti:745 blocked for more than 120 seconds.
Sep 03 04:37:46 atomic kernel: Tainted: G O 4.18.5-arch1-1-ARCH #1
Sep 03 04:37:46 atomic kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep 03 04:37:46 atomic kernel: btrfs-transacti D 0 745 2 0x80000080
Sep 03 04:37:46 atomic kernel: Call Trace:
Sep 03 04:37:46 atomic kernel: ? __schedule+0x29b/0x8b0
Sep 03 04:37:46 atomic kernel: ? preempt_count_add+0x68/0xa0
Sep 03 04:37:46 atomic kernel: schedule+0x32/0x90
Sep 03 04:37:46 atomic kernel: btrfs_start_ordered_extent+0x8c/0x130 [btrfs]
Sep 03 04:37:46 atomic kernel: ? wait_woken+0x80/0x80
Sep 03 04:37:46 atomic kernel: btrfs_wait_ordered_range+0xa0/0x110 [btrfs]
Sep 03 04:37:46 atomic kernel: __btrfs_wait_cache_io+0x42/0x1a0 [btrfs]
Sep 03 04:37:46 atomic kernel: btrfs_write_dirty_block_groups+0xf3/0x360 [btrfs]
Sep 03 04:37:46 atomic kernel: ? _raw_spin_lock+0x13/0x40
Sep 03 04:37:46 atomic kernel: ? _raw_spin_unlock+0x16/0x30
Sep 03 04:37:46 atomic kernel: ? btrfs_run_delayed_refs+0x115/0x180 [btrfs]
Sep 03 04:37:46 atomic kernel: commit_cowonly_roots+0x212/0x2b0 [btrfs]
Sep 03 04:37:46 atomic kernel: btrfs_commit_transaction+0x316/0x8a0 [btrfs]
Sep 03 04:37:46 atomic kernel: ? start_transaction+0x9c/0x3f0 [btrfs]
Sep 03 04:37:46 atomic kernel: transaction_kthread+0x13f/0x170 [btrfs]
Sep 03 04:37:46 atomic kernel: ? btrfs_cleanup_transaction+0x560/0x560 [btrfs]
Sep 03 04:37:46 atomic kernel: kthread+0x112/0x130
Sep 03 04:37:46 atomic kernel: ? kthread_flush_work_fn+0x10/0x10
Sep 03 04:37:46 atomic kernel: ret_from_fork+0x35/0x40
Sep 03 04:37:46 atomic kernel: INFO: task transmission-da:12600 blocked for more than 120 seconds.
Sep 03 04:37:46 atomic kernel: Tainted: G O 4.18.5-arch1-1-ARCH #1
Sep 03 04:37:46 atomic kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep 03 04:37:46 atomic kernel: transmission-da D 0 12600 1 0x00000080
Sep 03 04:37:46 atomic kernel: Call Trace:
Sep 03 04:37:46 atomic kernel: ? __schedule+0x29b/0x8b0
Sep 03 04:37:46 atomic kernel: ? preempt_count_add+0x68/0xa0
Sep 03 04:37:46 atomic kernel: schedule+0x32/0x90
Sep 03 04:37:46 atomic kernel: wait_current_trans+0xb6/0xe0 [btrfs]
Sep 03 04:37:46 atomic kernel: ? wait_woken+0x80/0x80
Sep 03 04:37:46 atomic kernel: start_transaction+0x1d3/0x3f0 [btrfs]
Sep 03 04:37:46 atomic kernel: btrfs_dirty_inode+0x42/0xd0 [btrfs]
Sep 03 04:37:46 atomic kernel: touch_atime+0xc0/0xe0
Sep 03 04:37:46 atomic kernel: generic_file_read_iter+0x689/0x9b0
Sep 03 04:37:46 atomic kernel: __vfs_read+0x13a/0x180
Sep 03 04:37:46 atomic kernel: vfs_read+0x8a/0x130
Sep 03 04:37:46 atomic kernel: ksys_pread64+0x61/0xa0
Sep 03 04:37:46 atomic kernel: do_syscall_64+0x5b/0x170
Sep 03 04:37:46 atomic kernel: entry_SYSCALL_64_after_hwframe+0x44/0xa9
Sep 03 04:37:46 atomic kernel: RIP: 0033:0x7fe388705aa7
Sep 03 04:37:46 atomic kernel: Code: Bad RIP value.
Sep 03 04:37:46 atomic kernel: RSP: 002b:00007fe385fc4ab0 EFLAGS: 00000293 ORIG_RAX: 0000000000000011
Sep 03 04:37:46 atomic kernel: RAX: ffffffffffffffda RBX: 0000000000000030 RCX: 00007fe388705aa7
Sep 03 04:37:46 atomic kernel: RDX: 0000000000002e1d RSI: 00007fe38262d050 RDI: 0000000000000030
Sep 03 04:37:46 atomic kernel: RBP: 00007fe38262d050 R08: 0000000000000000 R09: 00007fe385fc4b80
Sep 03 04:37:46 atomic kernel: R10: 0000000000000000 R11: 0000000000000293 R12: 0000000000002e1d
Sep 03 04:37:46 atomic kernel: R13: 0000000000000000 R14: 00007fe3802e00c0 R15: 0000000000000000
Sep 03 04:37:46 atomic kernel: INFO: task kworker/u16:0:7775 blocked for more than 120 seconds.
Sep 03 04:37:46 atomic kernel: Tainted: G O 4.18.5-arch1-1-ARCH #1
Sep 03 04:37:46 atomic kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep 03 04:37:46 atomic kernel: kworker/u16:0 D 0 7775 2 0x80000080
Sep 03 04:37:46 atomic kernel: Workqueue: btrfs-endio-write btrfs_endio_write_helper [btrfs]
Sep 03 04:37:46 atomic kernel: Call Trace:
Sep 03 04:37:46 atomic kernel: ? __schedule+0x29b/0x8b0
Sep 03 04:37:46 atomic kernel: ? preempt_count_add+0x68/0xa0
Sep 03 04:37:46 atomic kernel: schedule+0x32/0x90
Sep 03 04:37:46 atomic kernel: wait_current_trans+0xb6/0xe0 [btrfs]
Sep 03 04:37:46 atomic kernel: ? wait_woken+0x80/0x80
Sep 03 04:37:46 atomic kernel: start_transaction+0x1d3/0x3f0 [btrfs]
Sep 03 04:37:46 atomic kernel: btrfs_finish_ordered_io+0x27e/0x7f0 [btrfs]
Sep 03 04:37:46 atomic kernel: ? syscall_return_via_sysret+0x14/0x83
Sep 03 04:37:46 atomic kernel: normal_work_helper+0xbd/0x350 [btrfs]
Sep 03 04:37:46 atomic kernel: process_one_work+0x1eb/0x3c0
Sep 03 04:37:46 atomic kernel: worker_thread+0x2d/0x3d0
Sep 03 04:37:46 atomic kernel: ? process_one_work+0x3c0/0x3c0
Sep 03 04:37:46 atomic kernel: kthread+0x112/0x130
Sep 03 04:37:46 atomic kernel: ? kthread_flush_work_fn+0x10/0x10
Sep 03 04:37:46 atomic kernel: ret_from_fork+0x35/0x40
Sep 03 04:37:46 atomic kernel: INFO: task kworker/u16:4:14458 blocked for more than 120 seconds.
Sep 03 04:37:46 atomic kernel: Tainted: G O 4.18.5-arch1-1-ARCH #1
Sep 03 04:37:46 atomic kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep 03 04:37:46 atomic kernel: kworker/u16:4 D 0 14458 2 0x80000080
Sep 03 04:37:46 atomic kernel: Workqueue: btrfs-endio-write btrfs_endio_write_helper [btrfs]
Sep 03 04:37:46 atomic kernel: Call Trace:
Sep 03 04:37:46 atomic kernel: ? __schedule+0x29b/0x8b0
Sep 03 04:37:46 atomic kernel: ? preempt_count_add+0x68/0xa0
Sep 03 04:37:46 atomic kernel: schedule+0x32/0x90
Sep 03 04:37:46 atomic kernel: wait_current_trans+0xb6/0xe0 [btrfs]
Sep 03 04:37:46 atomic kernel: ? wait_woken+0x80/0x80
Sep 03 04:37:46 atomic kernel: start_transaction+0x1d3/0x3f0 [btrfs]
Sep 03 04:37:46 atomic kernel: btrfs_finish_ordered_io+0x27e/0x7f0 [btrfs]
Sep 03 04:37:46 atomic kernel: normal_work_helper+0xbd/0x350 [btrfs]
Sep 03 04:37:46 atomic kernel: process_one_work+0x1eb/0x3c0
Sep 03 04:37:46 atomic kernel: worker_thread+0x2d/0x3d0
Sep 03 04:37:46 atomic kernel: ? process_one_work+0x3c0/0x3c0
Sep 03 04:37:46 atomic kernel: kthread+0x112/0x130
Sep 03 04:37:46 atomic kernel: ? kthread_flush_work_fn+0x10/0x10
Sep 03 04:37:46 atomic kernel: ret_from_fork+0x35/0x40
Sep 03 04:37:46 atomic kernel: INFO: task kworker/u16:9:14855 blocked for more than 120 seconds.
Sep 03 04:37:46 atomic kernel: Tainted: G O 4.18.5-arch1-1-ARCH #1
Sep 03 04:37:46 atomic kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep 03 04:37:46 atomic kernel: kworker/u16:9 D 0 14855 2 0x80000080
Sep 03 04:37:46 atomic kernel: Workqueue: writeback wb_workfn (flush-btrfs-1)
Sep 03 04:37:46 atomic kernel: Call Trace:
Sep 03 04:37:46 atomic kernel: ? __schedule+0x29b/0x8b0
Sep 03 04:37:46 atomic kernel: ? preempt_count_add+0x68/0xa0
Sep 03 04:37:46 atomic kernel: schedule+0x32/0x90
Sep 03 04:37:46 atomic kernel: wait_current_trans+0xb6/0xe0 [btrfs]
Sep 03 04:37:46 atomic kernel: ? wait_woken+0x80/0x80
Sep 03 04:37:46 atomic kernel: start_transaction+0x1d3/0x3f0 [btrfs]
Sep 03 04:37:46 atomic kernel: find_free_extent+0xf30/0x10e0 [btrfs]
Sep 03 04:37:46 atomic kernel: ? _raw_read_unlock+0x18/0x30
Sep 03 04:37:46 atomic kernel: btrfs_reserve_extent+0x9b/0x180 [btrfs]
Sep 03 04:37:46 atomic kernel: cow_file_range.isra.20+0x16d/0x410 [btrfs]
Sep 03 04:37:46 atomic kernel: run_delalloc_range+0xdd/0x3b0 [btrfs]
Sep 03 04:37:46 atomic kernel: writepage_delalloc+0xc7/0x180 [btrfs]
Sep 03 04:37:46 atomic kernel: __extent_writepage+0xfa/0x350 [btrfs]
Sep 03 04:37:46 atomic kernel: ? clear_page_dirty_for_io+0x26d/0x320
Sep 03 04:37:46 atomic kernel: extent_write_cache_pages+0x1b5/0x3a0 [btrfs]
Sep 03 04:37:46 atomic kernel: extent_writepages+0x50/0x80 [btrfs]
Sep 03 04:37:46 atomic kernel: ? find_busiest_group+0x73c/0xaf0
Sep 03 04:37:46 atomic kernel: do_writepages+0x41/0xd0
Sep 03 04:37:46 atomic kernel: ? cpuacct_charge+0x5f/0x90
Sep 03 04:37:46 atomic kernel: ? preempt_count_add+0x68/0xa0
Sep 03 04:37:46 atomic kernel: __writeback_single_inode+0x3d/0x3d0
Sep 03 04:37:46 atomic kernel: ? _raw_spin_lock+0x13/0x40
Sep 03 04:37:46 atomic kernel: writeback_sb_inodes+0x1ec/0x460
Sep 03 04:37:46 atomic kernel: __writeback_inodes_wb+0x5d/0xb0
Sep 03 04:37:46 atomic kernel: wb_writeback+0x28f/0x340
Sep 03 04:37:47 atomic kernel: wb_workfn+0x327/0x430
Sep 03 04:37:47 atomic kernel: process_one_work+0x1eb/0x3c0
Sep 03 04:37:47 atomic kernel: worker_thread+0x2d/0x3d0
Sep 03 04:37:47 atomic kernel: ? process_one_work+0x3c0/0x3c0
Sep 03 04:37:47 atomic kernel: kthread+0x112/0x130
Sep 03 04:37:47 atomic kernel: ? kthread_flush_work_fn+0x10/0x10
Sep 03 04:37:47 atomic kernel: ret_from_fork+0x35/0x40
Sep 03 04:37:47 atomic kernel: INFO: task kworker/u16:1:18743 blocked for more than 120 seconds.
Sep 03 04:37:47 atomic kernel: Tainted: G O 4.18.5-arch1-1-ARCH #1
Sep 03 04:37:47 atomic kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep 03 04:37:47 atomic kernel: kworker/u16:1 D 0 18743 2 0x80000080
Sep 03 04:37:47 atomic kernel: Workqueue: btrfs-endio-write btrfs_endio_write_helper [btrfs]
Sep 03 04:37:47 atomic kernel: Call Trace:
Sep 03 04:37:47 atomic kernel: ? __schedule+0x29b/0x8b0
Sep 03 04:37:47 atomic kernel: ? preempt_count_add+0x68/0xa0
Sep 03 04:37:47 atomic kernel: schedule+0x32/0x90
Sep 03 04:37:47 atomic kernel: wait_current_trans+0xb6/0xe0 [btrfs]
Sep 03 04:37:47 atomic kernel: ? wait_woken+0x80/0x80
Sep 03 04:37:47 atomic kernel: start_transaction+0x1d3/0x3f0 [btrfs]
Sep 03 04:37:47 atomic kernel: btrfs_finish_ordered_io+0x27e/0x7f0 [btrfs]
Sep 03 04:37:47 atomic kernel: normal_work_helper+0xbd/0x350 [btrfs]
Sep 03 04:37:47 atomic kernel: process_one_work+0x1eb/0x3c0
Sep 03 04:37:47 atomic kernel: worker_thread+0x2d/0x3d0
Sep 03 04:37:47 atomic kernel: ? process_one_work+0x3c0/0x3c0
Sep 03 04:37:47 atomic kernel: kthread+0x112/0x130
Sep 03 04:37:47 atomic kernel: ? kthread_flush_work_fn+0x10/0x10
Sep 03 04:37:47 atomic kernel: ret_from_fork+0x35/0x40
Sep 03 04:37:47 atomic kernel: INFO: task kworker/u16:5:18745 blocked for more than 120 seconds.
Sep 03 04:37:47 atomic kernel: Tainted: G O 4.18.5-arch1-1-ARCH #1
Sep 03 04:37:47 atomic kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep 03 04:37:47 atomic kernel: kworker/u16:5 D 0 18745 2 0x80000080
Sep 03 04:37:47 atomic kernel: Workqueue: btrfs-endio-write btrfs_endio_write_helper [btrfs]
Sep 03 04:37:47 atomic kernel: Call Trace:
Sep 03 04:37:47 atomic kernel: ? __schedule+0x29b/0x8b0
Sep 03 04:37:47 atomic kernel: ? preempt_count_add+0x68/0xa0
Sep 03 04:37:47 atomic kernel: schedule+0x32/0x90
Sep 03 04:37:47 atomic kernel: wait_current_trans+0xb6/0xe0 [btrfs]
Sep 03 04:37:47 atomic kernel: ? wait_woken+0x80/0x80
Sep 03 04:37:47 atomic kernel: start_transaction+0x1d3/0x3f0 [btrfs]
Sep 03 04:37:47 atomic kernel: btrfs_finish_ordered_io+0x27e/0x7f0 [btrfs]
Sep 03 04:37:47 atomic kernel: normal_work_helper+0xbd/0x350 [btrfs]
Sep 03 04:37:47 atomic kernel: process_one_work+0x1eb/0x3c0
Sep 03 04:37:47 atomic kernel: worker_thread+0x2d/0x3d0
Sep 03 04:37:47 atomic kernel: ? process_one_work+0x3c0/0x3c0
Sep 03 04:37:47 atomic kernel: kthread+0x112/0x130
Sep 03 04:37:47 atomic kernel: ? kthread_flush_work_fn+0x10/0x10
Sep 03 04:37:47 atomic kernel: ret_from_fork+0x35/0x40
Sep 03 04:37:47 atomic kernel: INFO: task kworker/u16:10:19449 blocked for more than 120 seconds.
Sep 03 04:37:47 atomic kernel: Tainted: G O 4.18.5-arch1-1-ARCH #1
Sep 03 04:37:47 atomic kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep 03 04:37:47 atomic kernel: kworker/u16:10 D 0 19449 2 0x80000080
Sep 03 04:37:47 atomic kernel: Workqueue: btrfs-endio-write btrfs_endio_write_helper [btrfs]
Sep 03 04:37:47 atomic kernel: Call Trace:
Sep 03 04:37:47 atomic kernel: ? __schedule+0x29b/0x8b0
Sep 03 04:37:47 atomic kernel: ? preempt_count_add+0x68/0xa0
Sep 03 04:37:47 atomic kernel: schedule+0x32/0x90
Sep 03 04:37:47 atomic kernel: wait_current_trans+0xb6/0xe0 [btrfs]
Sep 03 04:37:47 atomic kernel: ? wait_woken+0x80/0x80
Sep 03 04:37:47 atomic kernel: start_transaction+0x1d3/0x3f0 [btrfs]
Sep 03 04:37:47 atomic kernel: btrfs_finish_ordered_io+0x27e/0x7f0 [btrfs]
Sep 03 04:37:47 atomic kernel: ? check_preempt_curr+0x62/0x90
Sep 03 04:37:47 atomic kernel: normal_work_helper+0xbd/0x350 [btrfs]
Sep 03 04:37:47 atomic kernel: process_one_work+0x1eb/0x3c0
Sep 03 04:37:47 atomic kernel: worker_thread+0x2d/0x3d0
Sep 03 04:37:47 atomic kernel: ? process_one_work+0x3c0/0x3c0
Sep 03 04:37:47 atomic kernel: kthread+0x112/0x130
Sep 03 04:37:47 atomic kernel: ? kthread_flush_work_fn+0x10/0x10
Sep 03 04:37:47 atomic kernel: ret_from_fork+0x35/0x40
Sep 03 04:37:47 atomic kernel: INFO: task kworker/u16:11:20252 blocked for more than 120 seconds.
Sep 03 04:37:47 atomic kernel: Tainted: G O 4.18.5-arch1-1-ARCH #1
Sep 03 04:37:47 atomic kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep 03 04:37:47 atomic kernel: kworker/u16:11 D 0 20252 2 0x80000080
Sep 03 04:37:47 atomic kernel: Workqueue: btrfs-endio-write btrfs_endio_write_helper [btrfs]
Sep 03 04:37:47 atomic kernel: Call Trace:
Sep 03 04:37:47 atomic kernel: ? __schedule+0x29b/0x8b0
Sep 03 04:37:47 atomic kernel: ? preempt_count_add+0x68/0xa0
Sep 03 04:37:47 atomic kernel: schedule+0x32/0x90
Sep 03 04:37:47 atomic kernel: wait_current_trans+0xb6/0xe0 [btrfs]
Sep 03 04:37:47 atomic kernel: ? wait_woken+0x80/0x80
Sep 03 04:37:47 atomic kernel: start_transaction+0x1d3/0x3f0 [btrfs]
Sep 03 04:37:47 atomic kernel: btrfs_finish_ordered_io+0x27e/0x7f0 [btrfs]
Sep 03 04:37:47 atomic kernel: ? syscall_return_via_sysret+0x14/0x83
Sep 03 04:37:47 atomic kernel: normal_work_helper+0xbd/0x350 [btrfs]
Sep 03 04:37:47 atomic kernel: process_one_work+0x1eb/0x3c0
Sep 03 04:37:47 atomic kernel: worker_thread+0x2d/0x3d0
Sep 03 04:37:47 atomic kernel: ? process_one_work+0x3c0/0x3c0
Sep 03 04:37:47 atomic kernel: kthread+0x112/0x130
Sep 03 04:37:47 atomic kernel: ? kthread_flush_work_fn+0x10/0x10
Sep 03 04:37:47 atomic kernel: ret_from_fork+0x35/0x40
Sep 03 04:37:47 atomic kernel: INFO: task kworker/u16:12:20295 blocked for more than 120 seconds.
Sep 03 04:37:47 atomic kernel: Tainted: G O 4.18.5-arch1-1-ARCH #1
Sep 03 04:37:47 atomic kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep 03 04:37:47 atomic kernel: kworker/u16:12 D 0 20295 2 0x80000080
Sep 03 04:37:47 atomic kernel: Workqueue: btrfs-endio-write btrfs_endio_write_helper [btrfs]
Sep 03 04:37:47 atomic kernel: Call Trace:
Sep 03 04:37:47 atomic kernel: ? __schedule+0x29b/0x8b0
Sep 03 04:37:47 atomic kernel: ? preempt_count_add+0x68/0xa0
Sep 03 04:37:47 atomic kernel: schedule+0x32/0x90
Sep 03 04:37:47 atomic kernel: wait_current_trans+0xb6/0xe0 [btrfs]
Sep 03 04:37:47 atomic kernel: ? wait_woken+0x80/0x80
Sep 03 04:37:47 atomic kernel: start_transaction+0x1d3/0x3f0 [btrfs]
Sep 03 04:37:47 atomic kernel: btrfs_finish_ordered_io+0x27e/0x7f0 [btrfs]
Sep 03 04:37:47 atomic kernel: ? syscall_return_via_sysret+0x14/0x83
Sep 03 04:37:47 atomic kernel: normal_work_helper+0xbd/0x350 [btrfs]
Sep 03 04:37:47 atomic kernel: process_one_work+0x1eb/0x3c0
Sep 03 04:37:47 atomic kernel: worker_thread+0x2d/0x3d0
Sep 03 04:37:47 atomic kernel: ? process_one_work+0x3c0/0x3c0
Sep 03 04:37:47 atomic kernel: kthread+0x112/0x130
Sep 03 04:37:47 atomic kernel: ? kthread_flush_work_fn+0x10/0x10
Sep 03 04:37:47 atomic kernel: ret_from_fork+0x35/0x40The machine was running Linux 4.18.5 at the time. After rebooting, it hung again several hours later with the trace in the previous post.
Last edited by alex.forencich (2018-09-05 03:43:33)
Offline
#3 2018-09-05 05:54:42
- firecat53
- Member
- From: Lake Stevens, WA, USA
- Registered: 2007-05-14
- Posts: 1,542
- Website
Re: btrfs hang
I'd start checking for a bad disk and make sure your data is backed up if possible. Sorry I don't have any more technical troubleshooting ideas, but I've seen hangs similar to this before years ago on my own btrfs server and it didn't end well when I failed to anticipate the failing drive. Could be something completely different though...
Offline
#4 2018-09-05 06:55:57
- alex.forencich
- Member
- Registered: 2011-05-29
- Posts: 96
Re: btrfs hang
I did check the drive SMART data and didn't see anything that appeared to be concerning, aside from some UDMA CRC errors on one drive the seem to have occurred quite a long time ago (~155 hours out of currently ~6600 hours). The last weekly scrub (finished Sept. 1 or so) also seems to have finished with no errors. The array, BTW, is an RAID10 array with 4 drives, and the drives are 8TB WD red drives with TLER set to 70 (7.0 seconds). So even if there are read errors on the drives, this should not cause a 120 second hang at the kernel level.
Last edited by alex.forencich (2018-09-05 07:09:01)
Offline
#5 2018-09-05 07:04:32
- alex.forencich
- Member
- Registered: 2011-05-29
- Posts: 96
Re: btrfs hang
Also, I will note that I have had some btrfs data corruption issues before with a flakey external hard drive. In that case, btrfs complained bitterly (lots and lots of log messages) and returned lots of I/O errors. It did not simply hang when it reached something it could not figure out. In this case, btrfs itself has been absolutely silent, with the only log entries I have seen so far are coming from the kernel reporting hung processes. I'll let btrfs check finish and see what happens when remounting under linux-lts. If it works, it indicates a regression the linux kernel somewhere. If it breaks, it indicates a hardware problem.
Last edited by alex.forencich (2018-09-05 07:06:26)
Offline
#6 2019-02-17 11:35:46
- OdinEidolon
- Member
- From: Belluno - Italy
- Registered: 2011-01-31
- Posts: 498
Re: btrfs hang
I am experiencing a very similar issue since about a week. I documented it here:
https://www.reddit.com/r/btrfs/comments … cannot_be/
No idea what is causing it 
Hardware: 2016 Dell XPS15 - matte FullHD - i5-6300HQ - 32GB DDR4 - Nvidia GTX960M - Samsung 840EVO 250GB SSD - 56Wh
Software: Plasma 5 - rEFInd - linux-ck - preload - prelink - verynice - psd - bumblebee
Offline
Pages: 1