You are not logged in.
- Topics: Active | Unanswered
Pages: 1
#1 2020-12-27 14:05:09
- darthvader
- Member
- From: The Beehive
- Registered: 2013-12-14
- Posts: 24
System freeze after downloading 333GB
Has anyone had their system freeze up after downloading huge amounts of files ie ~10000?
It seems to happen after downloading >256GB and around 333gb the system freezes up, REISUB doesn't work and I've had to hard restart.
How can I diagnosis if this is the issue or is it my system running out of ram? Its happened twice now.
I have no idea where to begin tracing the issue, I'm downloading stuff to the external western digital my passport 4tb ntfs formatted drive.
Linux archlinux 5.10.2-zen1-1-zen #1 ZEN SMP PREEMPT Mon, 21 Dec 2020 19:59:37 +0000 x86_64 GNU/Linux
In sysctl.d: fs.inotify.max_user_watches = 524288
dmesg from the first time:
[230621.406972] BUG: kernel NULL pointer dereference, address: 0000000000000070
[230621.407095] #PF: supervisor read access in kernel mode
[230621.407159] #PF: error_code(0x0000) - not-present page
[230621.407221] PGD 0 P4D 0
[230621.407261] Oops: 0000 [#1] PREEMPT SMP NOPTI
[230621.407318] CPU: 7 PID: 3937819 Comm: kworker/7:3 Tainted: G W OE 5.10.1-zen1-1-zen #1
[230621.407419] Hardware name: Dell Inc. OptiPlex 7070/06XMFM, BIOS 1.4.4 06/10/2020
[230621.407505] Workqueue: usb_hub_wq hub_event
[230621.407562] RIP: 0010:kernfs_find_ns+0x14/0xd0
[230621.407618] Code: 40 40 01 44 89 c0 5b 5d 41 5c 41 5d 41 5e c3 0f 1f 80 00 00 00 00 0f 1f 44 00 00 41 55 48 85 d2 49 89 f5 41 54 0f 95 c1 55 53 <0f> b7 47 70 48 89 d3 66 83 e0 20 0f 95 c2 38 d1 75 56 4c 8b 67 48
[230621.407821] RSP: 0018:ffffb78cdb16f958 EFLAGS: 00010246
[230621.407886] RAX: 0000000000000000 RBX: ffffffff84cd61a0 RCX: 0000000000000000
[230621.407970] RDX: 0000000000000000 RSI: ffffffff84cd62e8 RDI: 0000000000000000
[230621.408053] RBP: ffffffff84cd62e8 R08: ffffffff854b9de8 R09: 000000000000163f
[230621.408135] R10: ffffb78cdb16f818 R11: ffffb78cdb16f810 R12: 0000000000000000
[230621.408218] R13: ffffffff84cd62e8 R14: ffff9fa7e9d7ebd0 R15: ffff9faca4adb030
[230621.408302] FS: 0000000000000000(0000) GS:ffff9fb6fc5c0000(0000) knlGS:0000000000000000
[230621.408395] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[230621.408463] CR2: 0000000000000070 CR3: 0000000d1ac10003 CR4: 00000000003706e0
[230621.408546] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[230621.408629] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[230621.408711] Call Trace:
[230621.408750] kernfs_find_and_get_ns+0x2d/0x60
[230621.408808] sysfs_unmerge_group+0x18/0x60
[230621.408866] dpm_sysfs_remove+0x1f/0x60
[230621.408920] device_del+0xb2/0x600
[230621.408971] delete_partition+0x5b/0x80
[230621.409022] del_gendisk+0x184/0x480
[230621.409072] sd_remove+0x52/0xc0
[230621.409118] device_release_driver_internal+0x1df/0x2c0
[230621.409184] bus_remove_device+0xdf/0x160
[230621.409240] device_del+0x25d/0x600
[230621.409286] ? attribute_container_device_trigger+0xc5/0x100
[230621.409359] __scsi_remove_device+0x118/0x150
[230621.409416] scsi_forget_host+0x54/0x60
[230621.409467] scsi_remove_host+0x77/0x280
[230621.409524] usb_stor_disconnect+0x46/0xb0 [usb_storage]
[230621.409593] usb_unbind_interface+0x8a/0x270
[230621.409648] ? kernfs_find_ns+0x35/0xd0
[230621.409701] device_release_driver_internal+0x1df/0x2c0
[230621.409767] bus_remove_device+0xdf/0x160
[230621.409822] device_del+0x25d/0x600
[230621.409870] ? kobject_cleanup+0x4e/0x140
[230621.409925] usb_disable_device+0xcb/0x380
[230621.409978] usb_disconnect+0xc7/0x2d0
[230621.410028] usb_disconnect+0x8f/0x2d0
[230621.410079] hub_event+0xc9e/0x1ac0
[230621.410129] ? __schedule+0x433/0xbe0
[230621.410181] process_one_work+0x1d6/0x3a0
[230621.410236] worker_thread+0x4d/0x460
[230621.410288] ? flush_delayed_work+0x40/0x40
[230621.410343] kthread+0x19f/0x1d0
[230621.410389] ? __kthread_init_worker+0x50/0x50
[230621.410447] ret_from_fork+0x1f/0x30sometime in between:
Dec 25 03:34:43 archlinux kernel: TCP: eno2: Driver has suspect GRO implementation, TCP performance may be compromised.
Dec 25 04:21:18 archlinux kernel: F2FS-fs (nvme0n1p5): access invalid blkaddr:1969516397
Dec 25 04:21:18 archlinux kernel: ------------[ cut here ]------------
Dec 25 04:21:18 archlinux kernel: WARNING: CPU: 7 PID: 112422 at fs/f2fs/checkpoint.c:189 f2fs_is_valid_blkaddr+0x25a/0x270 [f2fs]
Dec 25 04:21:18 archlinux kernel: Modules linked in: ext4 mbcache jbd2 rfcomm xt_REDIRECT xt_tcpudp nf_nat_pptp nf_conntrack_pptp iptable_filter iptable_nat xt_MASQUERADE >
Dec 25 04:21:18 archlinux kernel: soundwire_bus crct10dif_pclmul intel_pmc_bxt crc32c_intel nls_iso8859_1 ee1004 iTCO_vendor_support mei_wdt mei_hdcp snd_soc_core dell_wm>
Dec 25 04:21:18 archlinux kernel: CPU: 7 PID: 112422 Comm: bsdtar Tainted: G OE 5.10.2-zen1-1-zen #1
Dec 25 04:21:18 archlinux kernel: Hardware name: Dell Inc. OptiPlex 7070/06XMFM, BIOS 1.4.4 06/10/2020
Dec 25 04:21:18 archlinux kernel: RIP: 0010:f2fs_is_valid_blkaddr+0x25a/0x270 [f2fs]
Dec 25 04:21:18 archlinux kernel: Code: 41 48 d3 e0 44 01 c0 39 c6 73 09 41 8b 41 5c e9 01 ff ff ff 89 f2 48 89 df 48 c7 c6 cd 67 83 c0 e8 fb 10 04 00 f0 80 4b 48 04 <0f> >
Dec 25 04:21:18 archlinux kernel: RSP: 0018:ffffa90f7c223e78 EFLAGS: 00010206
Dec 25 04:21:18 archlinux kernel: RAX: 0000000000000000 RBX: ffff9a4908fc3000 RCX: 0000000000000000
Dec 25 04:21:18 archlinux kernel: RDX: 0000000000000000 RSI: ffff9a583c5d8bb0 RDI: ffff9a583c5d8bb0
Dec 25 04:21:18 archlinux kernel: RBP: ffff9a50917cdb00 R08: ffffffff946cb1e8 R09: 0000000000004ffb
Dec 25 04:21:18 archlinux kernel: R10: ffffa90f7c223c18 R11: ffffa90f7c223c10 R12: ffff9a55dbd876a0
Dec 25 04:21:18 archlinux kernel: R13: 0000000000000001 R14: 0000000000000003 R15: 0000000000001000
Dec 25 04:21:18 archlinux kernel: FS: 00007f885031be80(0000) GS:ffff9a583c5c0000(0000) knlGS:0000000000000000
Dec 25 04:21:18 archlinux kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Dec 25 04:21:18 archlinux kernel: CR2: 0000559732d12088 CR3: 000000050ee22006 CR4: 00000000003706e0
Dec 25 04:21:18 archlinux kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Dec 25 04:21:18 archlinux kernel: DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Dec 25 04:21:18 archlinux kernel: Call Trace:
Dec 25 04:21:18 archlinux kernel: f2fs_llseek+0x271/0x850 [f2fs]
Dec 25 04:21:18 archlinux kernel: __x64_sys_lseek+0x68/0xb0
Dec 25 04:21:18 archlinux kernel: do_syscall_64+0x33/0x40
Dec 25 04:21:18 archlinux kernel: entry_SYSCALL_64_after_hwframe+0x44/0xa9
Dec 25 04:21:18 archlinux kernel: RIP: 0033:0x7f88508a2ffb
Dec 25 04:21:18 archlinux kernel: Code: ff ff c3 0f 1f 40 00 48 8b 15 71 0e 0d 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb ba 0f 1f 00 f3 0f 1e fa b8 08 00 00 00 0f 05 <48> >
Dec 25 04:21:18 archlinux kernel: RSP: 002b:00007ffdad6f32a8 EFLAGS: 00000202 ORIG_RAX: 0000000000000008
Dec 25 04:21:18 archlinux kernel: RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f88508a2ffb
Dec 25 04:21:18 archlinux kernel: RDX: 0000000000000003 RSI: 0000000000000000 RDI: 0000000000000005
Dec 25 04:21:18 archlinux kernel: RBP: 0000000000000000 R08: 0000000000000005 R09: 0000000000000002
Dec 25 04:21:18 archlinux kernel: R10: 0000000000000000 R11: 0000000000000202 R12: 0000559732d120c0
Dec 25 04:21:18 archlinux kernel: R13: 00000000ffffffff R14: 00000000000005fb R15: 0000000000000000
Dec 25 04:21:18 archlinux kernel: ---[ end trace 7befcc30549b722a ]---
Dec 25 04:21:18 archlinux kernel: F2FS-fs (nvme0n1p5): access invalid blkaddr:1969516397
Dec 25 04:21:18 archlinux kernel: ------------[ cut here ]------------dmesg from today:
cat: page allocation failure: order:6, mode:0x40dc0(GFP_KERNEL|__GFP_COMP|__GFP_ZERO), nodemask=(null),cpuset=/,mems_allowed=0
Dec 27 23:08:48 archlinux kernel: CPU: 5 PID: 1834004 Comm: cat Tainted: G W OE 5.10.2-zen1-1-zen #1
Dec 27 23:08:48 archlinux kernel: Hardware name: Dell Inc. OptiPlex 7070/06XMFM, BIOS 1.4.4 06/10/2020
Dec 27 23:08:48 archlinux kernel: Call Trace:
Dec 27 23:08:48 archlinux kernel: dump_stack+0x6e/0x89
Dec 27 23:08:48 archlinux kernel: warn_alloc.cold+0x78/0xdc
Dec 27 23:08:48 archlinux kernel: ? __alloc_pages_direct_compact+0x145/0x160
Dec 27 23:08:48 archlinux kernel: __alloc_pages_nodemask+0x1692/0x1730
Dec 27 23:08:48 archlinux kernel: kmalloc_order_trace+0x34/0xe0
Dec 27 23:08:48 archlinux kernel: __kmalloc+0x27d/0x2e0
Dec 27 23:08:48 archlinux kernel: proc_sys_read+0x15c/0x2a0
Dec 27 23:08:48 archlinux kernel: vfs_read+0x2c2/0x3e0
Dec 27 23:08:48 archlinux kernel: __x64_sys_read+0x6d/0xf0
Dec 27 23:08:48 archlinux kernel: do_syscall_64+0x33/0x40
Dec 27 23:08:48 archlinux kernel: entry_SYSCALL_64_after_hwframe+0x44/0xa9
Dec 27 23:08:48 archlinux kernel: RIP: 0033:0x7f1c900b4ec2
Dec 27 23:08:48 archlinux kernel: Code: c0 e9 b2 fe ff ff 50 48 8d 3d aa 36 0a 00 e8 65 eb 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24
Dec 27 23:08:48 archlinux kernel: RSP: 002b:00007ffde57045c8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000
Dec 27 23:08:48 archlinux kernel: RAX: ffffffffffffffda RBX: 0000000000020000 RCX: 00007f1c900b4ec2
Dec 27 23:08:48 archlinux kernel: RDX: 0000000000020000 RSI: 00007f1c901a4000 RDI: 0000000000000004
Dec 27 23:08:48 archlinux kernel: RBP: 00007f1c901a4000 R08: 00007f1c901a3010 R09: 0000000000000000
Dec 27 23:08:48 archlinux kernel: R10: 0000000000000022 R11: 0000000000000246 R12: 000055fa627dfc00
Dec 27 23:08:48 archlinux kernel: R13: 0000000000000004 R14: 0000000000020000 R15: 0000000000020000
Dec 27 23:08:48 archlinux kernel: Mem-Info:
Dec 27 23:08:48 archlinux kernel: active_anon:81143 inactive_anon:3720307 isolated_anon:0
active_file:1608004 inactive_file:9820053 isolated_file:0
unevictable:45654 dirty:6244 writeback:0
slab_reclaimable:681197 slab_unreclaimable:81083
mapped:402005 shmem:371146 pagetables:32901 bounce:0
free:167171 free_pcp:0 free_cma:0
Dec 27 23:08:48 archlinux kernel: Node 0 active_anon:324572kB inactive_anon:14881228kB active_file:6432016kB inactive_file:39280212kB unevictable:182616kB isolated(anon):0kB isolated(file):0kB mapped:1608020kB dirty:24976kB writeback:0kB shmem:1484584kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 3647488kB writeback_tmp:0kB kernel_stack:37888kB all_unreclaimable? no
Dec 27 23:08:48 archlinux kernel: Node 0 DMA free:11808kB min:16kB low:28kB high:40kB reserved_highatomic:0KB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15992kB managed:15904kB mlocked:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Dec 27 23:08:48 archlinux kernel: lowmem_reserve[]: 0 1795 64067 64067 64067
Dec 27 23:08:48 archlinux kernel: Node 0 DMA32 free:251116kB min:1892kB low:3728kB high:5564kB reserved_highatomic:0KB active_anon:4300kB inactive_anon:956336kB active_file:62388kB inactive_file:486112kB unevictable:16kB writepending:0kB present:1915212kB managed:1849120kB mlocked:0kB pagetables:420kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Dec 27 23:08:48 archlinux kernel: lowmem_reserve[]: 0 0 62271 62271 62271
Dec 27 23:08:48 archlinux kernel: Node 0 Normal free:405760kB min:65672kB low:129436kB high:193200kB reserved_highatomic:2048KB active_anon:320272kB inactive_anon:13924892kB active_file:6369700kB inactive_file:38794100kB unevictable:182744kB writepending:24976kB present:64954368kB managed:63772132kB mlocked:0kB pagetables:131184kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Dec 27 23:08:48 archlinux kernel: lowmem_reserve[]: 0 0 0 0 0
Dec 27 23:08:48 archlinux kernel: Node 0 DMA: 2*4kB (U) 1*8kB (U) 1*16kB (U) 2*32kB (U) 1*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 2*4096kB (M) = 11808kB
Dec 27 23:08:48 archlinux kernel: Node 0 DMA32: 395*4kB (UME) 198*8kB (UME) 567*16kB (UME) 457*32kB (UME) 332*64kB (UME) 146*128kB (UME) 182*256kB (UME) 113*512kB (UME) 64*1024kB (UME) 7*2048kB (ME) 0*4096kB = 251116kB
Dec 27 23:08:48 archlinux kernel: Node 0 Normal: 27713*4kB (UMEH) 11775*8kB (UMEH) 5969*16kB (UMEH) 2246*32kB (UMEH) 489*64kB (UMEH) 17*128kB (UEH) 2*256kB (H) 2*512kB (H) 0*1024kB 0*2048kB 0*4096kB = 407436kB
Dec 27 23:08:48 archlinux kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Dec 27 23:08:48 archlinux kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Dec 27 23:08:48 archlinux kernel: 11691410 total pagecache pages
Dec 27 23:08:48 archlinux kernel: 57 pages in swap cache
Dec 27 23:08:48 archlinux kernel: Swap cache stats: add 27050, delete 26993, find 1108/1372
Dec 27 23:08:48 archlinux kernel: Free swap = 16334784kB
Dec 27 23:08:48 archlinux kernel: Total swap = 16409280kB
Dec 27 23:08:48 archlinux kernel: 16721393 pages RAM
Dec 27 23:08:48 archlinux kernel: 0 pages HighMem/MovableOnly
Dec 27 23:08:48 archlinux kernel: 312104 pages reserved
Dec 27 23:08:48 archlinux kernel: 0 pages cma reserved
Dec 27 23:08:48 archlinux kernel: 0 pages hwpoisonedLast edited by darthvader (2020-12-27 14:33:32)
Offline
#2 2020-12-28 14:02:23
- Lone_Wolf
- Administrator
- From: Netherlands, Europe
- Registered: 2005-10-04
- Posts: 15,091
Re: System freeze after downloading 333GB
Dec 25 04:21:18 archlinux kernel: F2FS-fs (nvme0n1p5): access invalid blkaddr:1969516397
Dec 25 04:21:18 archlinux kernel: RIP: 0010:f2fs_is_valid_blkaddr+0x25a/0x270 [f2fs]Have you checked your volumes recently ?
Are you using continuous trim or periodic trim , see https://wiki.archlinux.org/index.php/F2 … ile_system ?
Does the problem also occur if you download large files that exceed 333 Gib combined ?
output of lsblk -f may also be helpful .
Last edited by Lone_Wolf (2020-12-28 14:05:13)
Disliking systemd intensely, but not satisfied with alternatives so focusing on taming systemd.
clean chroot building not flexible enough ?
Try clean chroot manager by graysky
Offline
#3 2020-12-28 15:40:40
- darthvader
- Member
- From: The Beehive
- Registered: 2013-12-14
- Posts: 24
Re: System freeze after downloading 333GB
No I have not, since all the files are going straight to my passport, not to my internal f2fs drive.
In fstab
UUID= / f2fs rw,noatime,lazytime,background_gc=on,discard,no_heap,inline_xattr,inline_data,inline_dentry,flush_merge,extent_cache,mode=adaptive,active_logs=6,alloc_mode=default,fsync_mode=posix, 0 0It just so happens my systems froze twice midway through downloading a 1tb folder, my download has completed so I'm not sure if I can replicate it again.
I suspect it maybe a kernel issue, previously I had a uptime of 63 days using Linux archlinux 5.8.13-zen1-2-zen. Or a ipfs issue, exhausting my open files limit.
$ lsblk -f # relevant parts
NAME FSTYPE FSVER LABEL UUID FSAVAIL FSUSE% MOUNTPOINT
loop0 f2fs 1.13 f2fs - 34.1G 66% /mnt/arch_f2fs
sda
├─sda1
└─sda2 f2fs 1.13 crucial - 1.9T 0% /mnt/crucial
sdc
└─sdc1 ntfs - 1.6T 55% /mnt/passport
zram0 [SWAP]
zram1 [SWAP]
zram2 [SWAP]
zram3 [SWAP]
zram4 [SWAP]
zram5 [SWAP]
zram6 [SWAP]
zram7 [SWAP]
nvme0n1
├─nvme0n1p1 ntfs Recovery -
├─nvme0n1p2 vfat FAT32 - 8.6M 91% /boot
├─nvme0n1p3
├─nvme0n1p4 ntfs - 7G 91% /mnt/Windows
└─nvme0n1p5 f2fs 1.13 archlinux - 38G 76% /Last edited by darthvader (2020-12-28 15:58:10)
Offline
Pages: 1