You are not logged in.

#1 2016-09-01 17:44:13

webdawg
Member
Registered: 2010-12-28
Posts: 62

Intresting Crashes Out of Memory With SATA Disk Erase

So I have something neat for you guys:

I will try and replicate but I have been doing SATA drive check by reading and writing hard drives completly over and over with dd and a BS of 64M.

My firefox and other applications have been getting killed.

I just stopped the drive read and write script and it looks like it stops happening.  We are talking I have been erasing for about 2 weeks strait about 5 drives in total, each right in a row.  Stop one, move to the next.

What about writing a HD over and over is exhausting memory.  Does it have anything to do with my KVM instance in the background...still that is only 512mb of memory out of 4GB.

Let me know what you think.

11538.164279] perf: interrupt took too long (2506 > 2500), lowering kernel.perf_event_max_sample_rate to 79800
[13541.450277] perf: interrupt took too long (3134 > 3132), lowering kernel.perf_event_max_sample_rate to 63600
[18643.633941] perf: interrupt took too long (3922 > 3917), lowering kernel.perf_event_max_sample_rate to 50700
[27624.243316] perf: interrupt took too long (4935 > 4902), lowering kernel.perf_event_max_sample_rate to 40500
[64973.866038] FS-Cache: Loaded
[64973.984180] Key type dns_resolver registered
[64974.033971] FS-Cache: Netfs 'cifs' registered for caching
[64974.034112] Key type cifs.spnego registered
[64974.034119] Key type cifs.idmap registered
[65563.622220] Purging GPU memory, 22 pages freed, 22039 pages still pinned.
[65563.625161] paperconf invoked oom-killer: gfp_mask=0x240c0c0(GFP_KERNEL|__GFP_COMP|__GFP_ZERO), order=3, oom_score_adj=0
[65563.625165] paperconf cpuset=/ mems_allowed=0
[65563.625172] CPU: 0 PID: 4497 Comm: paperconf Tainted: G     U          4.7.2-1-ARCH #1
[65563.625174] Hardware name: Dell Inc. Latitude E5520/0KCT5J, BIOS A14 12/26/2013
[65563.625176]  0000000000000286 00000000a38e5e3a ffff88003dbbb7f0 ffffffff812eb132
[65563.625179]  ffff88003dbbb9d0 ffff88012810b900 ffff88003dbbb860 ffffffff811f6e5c
[65563.625182]  0000000000000000 0101880100000000 00000000a38e5e3a 00000000ffffffff
[65563.625186] Call Trace:
[65563.625192]  [<ffffffff812eb132>] dump_stack+0x63/0x81
[65563.625197]  [<ffffffff811f6e5c>] dump_header+0x60/0x1e8
[65563.625202]  [<ffffffff811762fa>] oom_kill_process+0x22a/0x440
[65563.625205]  [<ffffffff811758d0>] ? find_lock_task_mm+0x50/0x90
[65563.625209]  [<ffffffff8117696a>] out_of_memory+0x40a/0x4b0
[65563.625213]  [<ffffffff812ffe08>] ? find_next_bit+0x18/0x20
[65563.625216]  [<ffffffff8117c05b>] __alloc_pages_nodemask+0xf0b/0xf30
[65563.625220]  [<ffffffff811cb845>] alloc_pages_current+0x95/0x140
[65563.625223]  [<ffffffff8117c309>] alloc_kmem_pages+0x19/0x90
[65563.625227]  [<ffffffff8119a7ae>] kmalloc_order_trace+0x2e/0x100
[65563.625229]  [<ffffffff811d6be3>] __kmalloc+0x213/0x230
[65563.625240]  [<ffffffffa0956730>] cifs_unlock_range+0xd0/0x460 [cifs]
[65563.625248]  [<ffffffffa0956beb>] cifs_lock+0x12b/0xa00 [cifs]
[65563.625252]  [<ffffffff8124d86e>] vfs_lock_file+0x1e/0x40
[65563.625255]  [<ffffffff8124dd21>] locks_remove_posix.part.23+0x91/0x140
[65563.625258]  [<ffffffff811d7f47>] ? kmem_cache_free+0x1e7/0x210
[65563.625261]  [<ffffffff8124ddfb>] locks_remove_posix+0x2b/0x30
[65563.625263]  [<ffffffff811f7d1e>] filp_close+0x4e/0x80
[65563.625267]  [<ffffffff81218295>] put_files_struct+0x75/0xd0
[65563.625270]  [<ffffffff81218397>] exit_files+0x47/0x50
[65563.625273]  [<ffffffff8107e1f0>] do_exit+0x2f0/0xb70
[65563.625277]  [<ffffffff810655f5>] ? __do_page_fault+0x1f5/0x510
[65563.625280]  [<ffffffff8107eaeb>] do_group_exit+0x3b/0xb0
[65563.625282]  [<ffffffff8107eb74>] SyS_exit_group+0x14/0x20
[65563.625286]  [<ffffffff815de7b2>] entry_SYSCALL_64_fastpath+0x1a/0xa4
[65563.625288] Mem-Info:
[65563.625293] active_anon:143614 inactive_anon:26883 isolated_anon:0
                active_file:66054 inactive_file:657526 isolated_file:0
                unevictable:0 dirty:53769 writeback:0 unstable:0
                slab_reclaimable:31741 slab_unreclaimable:5560
                mapped:67757 shmem:27367 pagetables:3523 bounce:0
                free:37065 free_pcp:0 free_cma:0
[65563.625298] Node 0 DMA free:15344kB min:264kB low:328kB high:392kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15972kB managed:15360kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:16kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
[65563.625305] lowmem_reserve[]: 0 3137 3823 3823
[65563.625309] Node 0 DMA32 free:111720kB min:55252kB low:69064kB high:82876kB active_anon:453308kB inactive_anon:86872kB active_file:216052kB inactive_file:2192104kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3302864kB managed:3227236kB mlocked:0kB dirty:176832kB writeback:0kB mapped:224308kB shmem:88480kB slab_reclaimable:101388kB slab_unreclaimable:15992kB kernel_stack:2912kB pagetables:11764kB unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[65563.625316] lowmem_reserve[]: 0 0 685 685
[65563.625319] Node 0 Normal free:21196kB min:12064kB low:15080kB high:18096kB active_anon:121148kB inactive_anon:20660kB active_file:48164kB inactive_file:438000kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:770048kB managed:701632kB mlocked:0kB dirty:38244kB writeback:0kB mapped:46720kB shmem:20988kB slab_reclaimable:25576kB slab_unreclaimable:6232kB kernel_stack:1520kB pagetables:2328kB unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[65563.625326] lowmem_reserve[]: 0 0 0 0
[65563.625329] Node 0 DMA: 0*4kB 0*8kB 1*16kB (U) 1*32kB (U) 1*64kB (U) 1*128kB (U) 1*256kB (U) 1*512kB (U) 0*1024kB 1*2048kB (M) 3*4096kB (M) = 15344kB
[65563.625343] Node 0 DMA32: 6754*4kB (UE) 10529*8kB (UME) 31*16kB (UM) 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 111744kB
[65563.625354] Node 0 Normal: 4786*4kB (UMEH) 185*8kB (UMEH) 2*16kB (H) 3*32kB (H) 4*64kB (H) 2*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 21264kB
[65563.625367] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
[65563.625369] 750956 total pagecache pages
[65563.625371] 0 pages in swap cache
[65563.625373] Swap cache stats: add 0, delete 0, find 0/0
[65563.625374] Free swap  = 0kB
[65563.625375] Total swap = 0kB
[65563.625376] 1022221 pages RAM
[65563.625378] 0 pages HighMem/MovableOnly
[65563.625379] 36164 pages reserved
[65563.625380] 0 pages hwpoisoned
[65563.625381] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds swapents oom_score_adj name
[65563.625387] [  284]     0   284    19300     3596      35       3        0             0 systemd-journal
[65563.625390] [  307]     0   307     9211     1178      20       3        0         -1000 systemd-udevd
[65563.625393] [  387]     0   387    23022      377      15       3        0             0 lvmetad
[65563.625396] [  494]     0   494     9643     1139      22       4        0             0 systemd-logind
[65563.625398] [  495]    81   495     8247      952      21       3        0          -900 dbus-daemon
[65563.625401] [  564]     0   564     1685      476       9       3        0             0 dhcpcd
[65563.625403] [  567]     0   567    22554     1024      48       3        0             0 login
[65563.625406] [  576]  1000   576    13695     1606      29       3        0             0 systemd
[65563.625409] [  578]  1000   578    24618      390      48       3        0             0 (sd-pam)
[65563.625411] [  582]  1000   582     4133      967      14       3        0             0 bash
[65563.625414] [  587]  1000   587     3406      753      11       3        0             0 startx
[65563.625416] [  609]  1000   609     3982      233      14       3        0             0 xinit
[65563.625418] [  610]  1000   610    94932    23575     142       3        0             0 Xorg
[65563.625421] [  612]  1000   612     1041      161       7       3        0             0 xf86-video-inte
[65563.625423] [  614]  1000   614     3406      771      12       3        0             0 sh
[65563.625426] [  615]  1000   615   127125    11999     146       4        0             0 udiskie
[65563.625428] [  620]  1000   620    87842     4526     109       4        0             0 xfce4-session
[65563.625431] [  621]  1000   621     8247      962      21       3        0             0 dbus-daemon
[65563.625433] [  624]   102   624   129314     4057      50       3        0             0 polkitd
[65563.625436] [  632]  1000   632    13211     1218      29       3        0             0 xfconfd
[65563.625438] [  635]  1000   635     2788       78       8       3        0             0 ssh-agent
[65563.625441] [  637]  1000   637    41313      158      16       3        0             0 gpg-agent
[65563.625444] [  638]  1000   638    50138     5025      99       3        0             0 xfwm4
[65563.625446] [  640]  1000   640   128970     6920     116       4        0             0 Thunar
[65563.625448] [  643]     0   643   163110     2768      53       4        0             0 udisksd
[65563.625451] [  651]  1000   651    77976     6358     119       3        0             0 xfce4-panel
[65563.625453] [  652]  1000   652    69438     3677     100       3        0             0 xfsettingsd
[65563.625456] [  654]  1000   654   116162     8261     127       3        0             0 xfdesktop
[65563.625458] [  662]  1000   662   101194     6461      97       3        0             0 xfce4-terminal
[65563.625461] [  664]  1000   664    85904     3586     102       3        0             0 xfce4-power-man
[65563.625463] [  671]  1000   671    83874     1275      32       4        0             0 at-spi-bus-laun
[65563.625466] [  672]  1000   672    83646     3574      93       3        0             0 polkit-gnome-au
[65563.625468] [  682]  1000   682     8186      769      20       3        0             0 dbus-daemon
[65563.625471] [  684]  1000   684    53563     1479      40       3        0             0 at-spi2-registr
[65563.625473] [  687]  1000   687    49017     3477     100       3        0             0 panel-6-systray
[65563.625476] [  688]  1000   688     4133      957      12       3        0             0 bash
[65563.625478] [  689]  1000   689     4133     1031      12       3        0             0 bash
[65563.625480] [  690]  1000   690     4133     1123      12       3        0             0 bash
[65563.625483] [  692]  1000   692    47687     4040      95       3        0             0 panel-8-datetim
[65563.625485] [  702]  1000   702    47376     3633      94       3        0             0 panel-49-cpugra
[65563.625488] [  706]     0   706    73320     2069      39       3        0             0 upowerd
[65563.625490] [  728]  1000   728    39711     4553      80       3        0             0 quicksynergy
[65563.625493] [  873]  1000   873     4133     1142      13       3        0             0 bash
[65563.625495] [ 1092]  1000  1092    88772    13384     133       3        0             0 medit
[65563.625498] [ 1093]  1000  1093     4148     1118      13       3        0             0 bash
[65563.625500] [ 1096]  1000  1096     3604      698      12       3        0             0 gam_server
[65563.625503] [ 1251]  1000  1251    10032     1312      24       3        0             0 ssh
[65563.625505] [ 1479]  1000  1479   304541    95840     455       4        0             0 firefox
[65563.625508] [ 1617]  1000  1617     4133     1098      12       3        0             0 bash
[65563.625510] [ 1626]     0  1626    17508     1286      38       3        0             0 sudo
[65563.625513] [ 1628]     0  1628    10783      756      24       3        0             0 su
[65563.625515] [ 1629]     0  1629     4166     1150      13       3        0             0 bash
[65563.625518] [ 1635]     0  1635     3406      775      11       3        0             0 read_erase_fore
[65563.625520] [ 3477]     0  3477     1464      183       8       3        0             0 dd
[65563.625523] [ 3478]     0  3478     1494      170       7       3        0             0 pv
[65563.625525] [ 3479]     0  3479    17851      550       8       4        0             0 dd
[65563.625528] [ 4278]  1000  4278    31654     1494      28       4        0             0 synergys
[65563.625531] [ 4459]  1000  4459    81706     3015      89       3        0             0 tumblerd
[65563.625533] [ 4468]  1000  4468    50045     1375      30       3        0             0 oosplash
[65563.625536] [ 4486]  1000  4486   233220    29168     288       3        0             0 soffice.bin
[65563.625539] [ 4496]  1000  4496     3406      725      11       3        0             0 sh
[65563.625541] Out of memory: Kill process 1479 (firefox) score 97 or sacrifice child
[65563.625639] Killed process 1479 (firefox) total-vm:1218164kB, anon-rss:270732kB, file-rss:93764kB, shmem-rss:18864kB
[70401.647776] Purging GPU memory, 428 pages freed, 22638 pages still pinned.
[70411.560028] Purging GPU memory, 427 pages freed, 22574 pages still pinned.
[70411.560668] makepkg invoked oom-killer: gfp_mask=0x27000c0(GFP_KERNEL_ACCOUNT|__GFP_NOTRACK), order=2, oom_score_adj=0
[70411.560672] makepkg cpuset=/ mems_allowed=0
[70411.560678] CPU: 3 PID: 5892 Comm: makepkg Tainted: G     U          4.7.2-1-ARCH #1
[70411.560679] Hardware name: Dell Inc. Latitude E5520/0KCT5J, BIOS A14 12/26/2013
[70411.560681]  0000000000000286 0000000080909397 ffff88006f7b3b48 ffffffff812eb132
[70411.560684]  ffff88006f7b3d28 ffff88009d4e8e40 ffff88006f7b3bb8 ffffffff811f6e5c
[70411.560687]  0000000000000000 0101880100000000 0000000080909397 00000000ffffffff
[70411.560690] Call Trace:
[70411.560695]  [<ffffffff812eb132>] dump_stack+0x63/0x81
[70411.560699]  [<ffffffff811f6e5c>] dump_header+0x60/0x1e8
[70411.560704]  [<ffffffff811762fa>] oom_kill_process+0x22a/0x440
[70411.560707]  [<ffffffff8117696a>] out_of_memory+0x40a/0x4b0
[70411.560710]  [<ffffffff812ffe08>] ? find_next_bit+0x18/0x20
[70411.560713]  [<ffffffff8117c05b>] __alloc_pages_nodemask+0xf0b/0xf30
[70411.560716]  [<ffffffff8117c3d4>] alloc_kmem_pages_node+0x54/0xd0
[70411.560718]  [<ffffffff81077c06>] copy_process.part.8+0x136/0x19a0
[70411.560721]  [<ffffffff81212ef7>] ? __d_alloc+0x27/0x1a0
[70411.560724]  [<ffffffff811d741c>] ? kmem_cache_alloc+0x1bc/0x1e0
[70411.560726]  [<ffffffff811fc59c>] ? get_empty_filp+0x5c/0x1c0
[70411.560729]  [<ffffffff811fc616>] ? get_empty_filp+0xd6/0x1c0
[70411.560731]  [<ffffffff81079647>] _do_fork+0xd7/0x3d0
[70411.560734]  [<ffffffff81089ce9>] ? __set_current_blocked+0x49/0x50
[70411.560737]  [<ffffffff810799e9>] SyS_clone+0x19/0x20
[70411.560740]  [<ffffffff81003c07>] do_syscall_64+0x57/0xb0
[70411.560743]  [<ffffffff815de861>] entry_SYSCALL64_slow_path+0x25/0x25
[70411.560745] Mem-Info:
[70411.560749] active_anon:213670 inactive_anon:27934 isolated_anon:0
                active_file:78556 inactive_file:585422 isolated_file:24
                unevictable:0 dirty:201 writeback:0 unstable:0
                slab_reclaimable:16132 slab_unreclaimable:6565
                mapped:53330 shmem:63119 pagetables:3547 bounce:0
                free:40516 free_pcp:30 free_cma:0
[70411.560753] Node 0 DMA free:15344kB min:264kB low:328kB high:392kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15972kB managed:15360kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:16kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
[70411.560759] lowmem_reserve[]: 0 3137 3823 3823
[70411.560763] Node 0 DMA32 free:128336kB min:55252kB low:69064kB high:82876kB active_anon:686988kB inactive_anon:92280kB active_file:256528kB inactive_file:1942640kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3302864kB managed:3227236kB mlocked:0kB dirty:620kB writeback:0kB mapped:174880kB shmem:194344kB slab_reclaimable:53380kB slab_unreclaimable:18880kB kernel_stack:3056kB pagetables:11568kB unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[70411.560769] lowmem_reserve[]: 0 0 685 685
[70411.560772] Node 0 Normal free:18384kB min:12064kB low:15080kB high:18096kB active_anon:167692kB inactive_anon:19456kB active_file:57696kB inactive_file:399048kB unevictable:0kB isolated(anon):0kB isolated(file):96kB present:770048kB managed:701632kB mlocked:0kB dirty:184kB writeback:0kB mapped:38440kB shmem:58132kB slab_reclaimable:11148kB slab_unreclaimable:7364kB kernel_stack:1536kB pagetables:2620kB unstable:0kB bounce:0kB free_pcp:124kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:96 all_unreclaimable? no
[70411.560777] lowmem_reserve[]: 0 0 0 0
[70411.560780] Node 0 DMA: 0*4kB 0*8kB 1*16kB (U) 1*32kB (U) 1*64kB (U) 1*128kB (U) 1*256kB (U) 1*512kB (U) 0*1024kB 1*2048kB (M) 3*4096kB (M) = 15344kB
[70411.560792] Node 0 DMA32: 3253*4kB (UE) 14437*8kB (UME) 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 128508kB
[70411.560801] Node 0 Normal: 4237*4kB (UEH) 173*8kB (UMH) 0*16kB 0*32kB 1*64kB (H) 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 18396kB
[70411.560811] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
[70411.560812] 727019 total pagecache pages
[70411.560814] 0 pages in swap cache
[70411.560815] Swap cache stats: add 0, delete 0, find 0/0
[70411.560817] Free swap  = 0kB
[70411.560818] Total swap = 0kB
[70411.560819] 1022221 pages RAM
[70411.560820] 0 pages HighMem/MovableOnly
[70411.560821] 36164 pages reserved
[70411.560822] 0 pages hwpoisoned
[70411.560823] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds swapents oom_score_adj name
[70411.560828] [  284]     0   284    19300     2297      36       3        0             0 systemd-journal
[70411.560831] [  307]     0   307     9211     1178      20       3        0         -1000 systemd-udevd
[70411.560833] [  387]     0   387    23022      377      15       3        0             0 lvmetad
[70411.560835] [  494]     0   494     9643     1139      22       4        0             0 systemd-logind
[70411.560838] [  495]    81   495     8294      952      21       3        0          -900 dbus-daemon
[70411.560840] [  564]     0   564     1685      476       9       3        0             0 dhcpcd
[70411.560842] [  567]     0   567    22554     1024      48       3        0             0 login
[70411.560845] [  576]  1000   576    13695     1611      29       3        0             0 systemd
[70411.560847] [  578]  1000   578    24618      390      48       3        0             0 (sd-pam)
[70411.560849] [  582]  1000   582     4133      967      14       3        0             0 bash
[70411.560851] [  587]  1000   587     3406      753      11       3        0             0 startx
[70411.560853] [  609]  1000   609     3982      233      14       3        0             0 xinit
[70411.560856] [  610]  1000   610    92603    22506     141       3        0             0 Xorg
[70411.560858] [  612]  1000   612     1041      161       7       3        0             0 xf86-video-inte
[70411.560860] [  614]  1000   614     3406      771      12       3        0             0 sh
[70411.560862] [  615]  1000   615   127125    11999     146       4        0             0 udiskie
[70411.560865] [  620]  1000   620    87886     4526     109       4        0             0 xfce4-session
[70411.560867] [  621]  1000   621     8247      970      21       3        0             0 dbus-daemon
[70411.560869] [  624]   102   624   129314     4057      50       3        0             0 polkitd
[70411.560871] [  632]  1000   632    13211     1218      29       3        0             0 xfconfd
[70411.560873] [  635]  1000   635     2788       78       8       3        0             0 ssh-agent
[70411.560876] [  637]  1000   637    41313      158      16       3        0             0 gpg-agent
[70411.560878] [  638]  1000   638    50138     5025      99       3        0             0 xfwm4
[70411.560880] [  640]  1000   640   129089     7112     116       4        0             0 Thunar
[70411.560882] [  643]     0   643   163098     2774      53       4        0             0 udisksd
[70411.560884] [  651]  1000   651    78024     6414     119       3        0             0 xfce4-panel
[70411.560886] [  652]  1000   652    69438     3677     100       3        0             0 xfsettingsd
[70411.560888] [  654]  1000   654   116162     8229     127       3        0             0 xfdesktop
[70411.560891] [  662]  1000   662   101365     6622      98       3        0             0 xfce4-terminal
[70411.560893] [  664]  1000   664    85904     3586     102       3        0             0 xfce4-power-man
[70411.560895] [  671]  1000   671    83874     1275      32       4        0             0 at-spi-bus-laun
[70411.560897] [  672]  1000   672    83646     3574      93       3        0             0 polkit-gnome-au
[70411.560899] [  682]  1000   682     8186      769      20       3        0             0 dbus-daemon
[70411.560901] [  684]  1000   684    53563     1479      40       3        0             0 at-spi2-registr
[70411.560904] [  687]  1000   687    49017     3477     100       3        0             0 panel-6-systray
[70411.560906] [  688]  1000   688     4133      957      12       3        0             0 bash
[70411.560908] [  689]  1000   689     4133     1031      12       3        0             0 bash
[70411.560910] [  690]  1000   690     4133     1123      12       3        0             0 bash
[70411.560912] [  692]  1000   692    47687     4040      95       3        0             0 panel-8-datetim
[70411.560914] [  702]  1000   702    47376     3633      94       3        0             0 panel-49-cpugra
[70411.560916] [  706]     0   706    73320     2069      39       3        0             0 upowerd
[70411.560918] [  728]  1000   728    39711     4553      80       3        0             0 quicksynergy
[70411.560920] [  873]  1000   873     4133     1142      13       3        0             0 bash
[70411.560922] [ 1092]  1000  1092    88772    13384     133       3        0             0 medit
[70411.560925] [ 1093]  1000  1093     4148     1118      13       3        0             0 bash
[70411.560927] [ 1096]  1000  1096     3604      698      12       3        0             0 gam_server
[70411.560929] [ 1251]  1000  1251    10032     1312      24       3        0             0 ssh
[70411.560931] [ 1617]  1000  1617     4133     1098      12       3        0             0 bash
[70411.560933] [ 1626]     0  1626    17508     1286      38       3        0             0 sudo
[70411.560935] [ 1628]     0  1628    10783      756      24       3        0             0 su
[70411.560937] [ 1629]     0  1629     4166     1150      13       3        0             0 bash
[70411.560939] [ 1635]     0  1635     3406      775      11       3        0             0 read_erase_fore
[70411.560942] [ 4278]  1000  4278    31685     1570      28       4        0             0 synergys
[70411.560944] [ 4500]     0  4500    22186     2151      47       3        0             0 cupsd
[70411.560946] [ 4501]   124  4501    74800     2980      47       4        0             0 colord
[70411.560948] [ 4635]  1000  4635    44031     1070      23       3        0             0 dconf-service
[70411.560951] [ 4782]     0  4782     1464      174       8       3        0             0 dd
[70411.560953] [ 4783]     0  4783     1494      180       8       3        0             0 pv
[70411.560955] [ 4784]     0  4784    17851      484       8       3        0             0 dd
[70411.560957] [ 4811]  1000  4811   403726   161337     661       4        0             0 firefox
[70411.560959] [ 5003]  1000  5003     4158     1078      12       3        0             0 bash
[70411.560961] [ 5005]  1000  5005     6881      924      17       3        0             0 alsamixer
[70411.560964] [ 5210]  1000  5210     4133     1005      12       3        0             0 bash
[70411.560966] [ 5212]  1000  5212     3762     1277      12       3        0             0 yaourt
[70411.560968] [ 5387]  1000  5387     3833     1215      12       3        0             0 makepkg
[70411.560970] [ 5698]  1000  5698     3406      801      11       3        0             0 fakeroot
[70411.560972] [ 5706]  1000  5706     1064       37       8       3        0             0 faked
[70411.560974] [ 5713]  1000  5713     4360     1238      14       3        0             0 makepkg
[70411.560977] [ 5891]  1000  5891     3372      631      10       3        0             0 find
[70411.560979] [ 5892]  1000  5892     4360      902      14       3        0             0 makepkg
[70411.560981] Out of memory: Kill process 4811 (firefox) score 164 or sacrifice child
[70411.561064] Killed process 4811 (firefox) total-vm:1614904kB, anon-rss:525348kB, file-rss:101824kB, shmem-rss:18176kB
[74271.098604] firefox invoked oom-killer: gfp_mask=0x27000c0(GFP_KERNEL_ACCOUNT|__GFP_NOTRACK), order=2, oom_score_adj=0
[74271.098608] firefox cpuset=/ mems_allowed=0
[74271.098616] CPU: 1 PID: 8021 Comm: firefox Tainted: G     U          4.7.2-1-ARCH #1
[74271.098619] Hardware name: Dell Inc. Latitude E5520/0KCT5J, BIOS A14 12/26/2013
[74271.098622]  0000000000000286 00000000c46038a1 ffff8800aff23b48 ffffffff812eb132
[74271.098627]  ffff8800aff23d28 ffff88011ae7aac0 ffff8800aff23bb8 ffffffff811f6e5c
[74271.098631]  0000000000000000 0101880000000000 00000000c46038a1 00000000ffffffff
[74271.098635] Call Trace:
[74271.098641]  [<ffffffff812eb132>] dump_stack+0x63/0x81
[74271.098648]  [<ffffffff811f6e5c>] dump_header+0x60/0x1e8
[74271.098654]  [<ffffffff811762fa>] oom_kill_process+0x22a/0x440
[74271.098659]  [<ffffffff8117696a>] out_of_memory+0x40a/0x4b0
[74271.098664]  [<ffffffff812ffe08>] ? find_next_bit+0x18/0x20
[74271.098669]  [<ffffffff8117c05b>] __alloc_pages_nodemask+0xf0b/0xf30
[74271.098673]  [<ffffffff8117c3d4>] alloc_kmem_pages_node+0x54/0xd0
[74271.098678]  [<ffffffff81077c06>] copy_process.part.8+0x136/0x19a0
[74271.098683]  [<ffffffff81184266>] ? lru_cache_add_active_or_unevictable+0x36/0xb0
[74271.098688]  [<ffffffff811a9864>] ? handle_mm_fault+0xb94/0x1f60
[74271.098692]  [<ffffffff81079647>] _do_fork+0xd7/0x3d0
[74271.098698]  [<ffffffff810655f5>] ? __do_page_fault+0x1f5/0x510
[74271.098701]  [<ffffffff810799e9>] SyS_clone+0x19/0x20
[74271.098706]  [<ffffffff81003c07>] do_syscall_64+0x57/0xb0
[74271.098710]  [<ffffffff815de861>] entry_SYSCALL64_slow_path+0x25/0x25
[74271.098713] Mem-Info:
[74271.098720] active_anon:156650 inactive_anon:25532 isolated_anon:0
                active_file:74318 inactive_file:657388 isolated_file:0
                unevictable:0 dirty:572 writeback:0 unstable:0
                slab_reclaimable:16718 slab_unreclaimable:5944
                mapped:52359 shmem:26476 pagetables:3571 bounce:0
                free:32135 free_pcp:30 free_cma:0
[74271.098727] Node 0 DMA free:15344kB min:264kB low:328kB high:392kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15972kB managed:15360kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:16kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
[74271.098737] lowmem_reserve[]: 0 3137 3823 3823
[74271.098742] Node 0 DMA32 free:94636kB min:55252kB low:69064kB high:82876kB active_anon:513852kB inactive_anon:80836kB active_file:241828kB inactive_file:2175048kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3302864kB managed:3227236kB mlocked:0kB dirty:1804kB writeback:0kB mapped:169928kB shmem:84144kB slab_reclaimable:55568kB slab_unreclaimable:16908kB kernel_stack:2944kB pagetables:11948kB unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:16 all_unreclaimable? no
[74271.098753] lowmem_reserve[]: 0 0 685 685
[74271.098757] Node 0 Normal free:18560kB min:12064kB low:15080kB high:18096kB active_anon:112748kB inactive_anon:21292kB active_file:55444kB inactive_file:454504kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:770048kB managed:701632kB mlocked:0kB dirty:484kB writeback:0kB mapped:39508kB shmem:21760kB slab_reclaimable:11304kB slab_unreclaimable:6852kB kernel_stack:1568kB pagetables:2336kB unstable:0kB bounce:0kB free_pcp:116kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[74271.098767] lowmem_reserve[]: 0 0 0 0
[74271.098772] Node 0 DMA: 0*4kB 0*8kB 1*16kB (U) 1*32kB (U) 1*64kB (U) 1*128kB (U) 1*256kB (U) 1*512kB (U) 0*1024kB 1*2048kB (M) 3*4096kB (M) = 15344kB
[74271.098790] Node 0 DMA32: 6501*4kB (UME) 8611*8kB (UM) 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 94892kB
[74271.098804] Node 0 Normal: 1759*4kB (UMEH) 1405*8kB (UMH) 1*16kB (H) 4*32kB (H) 1*64kB (H) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 18612kB
[74271.098823] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
[74271.098825] 758133 total pagecache pages
[74271.098827] 0 pages in swap cache
[74271.098830] Swap cache stats: add 0, delete 0, find 0/0
[74271.098832] Free swap  = 0kB
[74271.098834] Total swap = 0kB
[74271.098836] 1022221 pages RAM
[74271.098837] 0 pages HighMem/MovableOnly
[74271.098839] 36164 pages reserved
[74271.098841] 0 pages hwpoisoned
[74271.098842] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds swapents oom_score_adj name
[74271.098851] [  284]     0   284    19300     2275      36       3        0             0 systemd-journal
[74271.098855] [  307]     0   307     9211     1178      20       3        0         -1000 systemd-udevd
[74271.098859] [  387]     0   387    23022      377      15       3        0             0 lvmetad
[74271.098863] [  494]     0   494     9643     1139      22       4        0             0 systemd-logind
[74271.098867] [  495]    81   495     8294      952      21       3        0          -900 dbus-daemon
[74271.098870] [  564]     0   564     1685      476       9       3        0             0 dhcpcd
[74271.098874] [  567]     0   567    22554     1024      48       3        0             0 login
[74271.098878] [  576]  1000   576    13695     1611      29       3        0             0 systemd
[74271.098882] [  578]  1000   578    24618      390      48       3        0             0 (sd-pam)
[74271.098886] [  582]  1000   582     4133      967      14       3        0             0 bash
[74271.098889] [  587]  1000   587     3406      753      11       3        0             0 startx
[74271.098893] [  609]  1000   609     3982      233      14       3        0             0 xinit
[74271.098897] [  610]  1000   610    92077    20858     144       3        0             0 Xorg
[74271.098900] [  612]  1000   612     1041      161       7       3        0             0 xf86-video-inte
[74271.098904] [  614]  1000   614     3406      771      12       3        0             0 sh
[74271.098908] [  615]  1000   615   127125    11999     146       4        0             0 udiskie
[74271.098911] [  620]  1000   620    87886     4526     109       4        0             0 xfce4-session
[74271.098915] [  621]  1000   621     8247      970      21       3        0             0 dbus-daemon
[74271.098919] [  624]   102   624   129314     4057      50       3        0             0 polkitd
[74271.098922] [  632]  1000   632    13211     1218      29       3        0             0 xfconfd
[74271.098926] [  635]  1000   635     2788       78       8       3        0             0 ssh-agent
[74271.098930] [  637]  1000   637    41313      158      16       3        0             0 gpg-agent
[74271.098934] [  638]  1000   638    50138     5025      99       3        0             0 xfwm4
[74271.098937] [  640]  1000   640   129089     7112     116       4        0             0 Thunar
[74271.098940] [  643]     0   643   163098     2774      53       4        0             0 udisksd
[74271.098944] [  651]  1000   651    78057     6459     119       3        0             0 xfce4-panel
[74271.098948] [  652]  1000   652    69438     3677     100       3        0             0 xfsettingsd
[74271.098951] [  654]  1000   654   116162     8243     127       3        0             0 xfdesktop
[74271.098955] [  662]  1000   662   101662     6951      98       3        0             0 xfce4-terminal
[74271.098959] [  664]  1000   664    85904     3586     102       3        0             0 xfce4-power-man
[74271.098962] [  671]  1000   671    83874     1275      32       4        0             0 at-spi-bus-laun
[74271.098965] [  672]  1000   672    83646     3574      93       3        0             0 polkit-gnome-au
[74271.098969] [  682]  1000   682     8186      769      20       3        0             0 dbus-daemon
[74271.098972] [  684]  1000   684    53563     1479      40       3        0             0 at-spi2-registr
[74271.098975] [  687]  1000   687    49017     3477     100       3        0             0 panel-6-systray
[74271.098979] [  688]  1000   688     4133      957      12       3        0             0 bash
[74271.098981] [  689]  1000   689     4133     1031      12       3        0             0 bash
[74271.098983] [  690]  1000   690     4133     1123      12       3        0             0 bash
[74271.098985] [  692]  1000   692    47687     4040      95       3        0             0 panel-8-datetim
[74271.098987] [  702]  1000   702    47376     3633      94       3        0             0 panel-49-cpugra
[74271.098989] [  706]     0   706    73320     2069      39       3        0             0 upowerd
[74271.098991] [  728]  1000   728    39711     4553      80       3        0             0 quicksynergy
[74271.098994] [  873]  1000   873     4133     1142      13       3        0             0 bash
[74271.098996] [ 1092]  1000  1092    88772    13384     133       3        0             0 medit
[74271.098998] [ 1093]  1000  1093     4148     1118      13       3        0             0 bash
[74271.099000] [ 1096]  1000  1096     3604      698      12       3        0             0 gam_server
[74271.099003] [ 1251]  1000  1251    10032     1312      24       3        0             0 ssh
[74271.099005] [ 1617]  1000  1617     4133     1098      12       3        0             0 bash
[74271.099007] [ 1626]     0  1626    17508     1286      38       3        0             0 sudo
[74271.099009] [ 1628]     0  1628    10783      756      24       3        0             0 su
[74271.099012] [ 1629]     0  1629     4166     1150      13       3        0             0 bash
[74271.099014] [ 1635]     0  1635     3406      775      11       3        0             0 read_erase_fore
[74271.099016] [ 4278]  1000  4278    31748     1634      28       4        0             0 synergys
[74271.099018] [ 4500]     0  4500    22186     2151      47       3        0             0 cupsd
[74271.099020] [ 4501]   124  4501    74800     2980      47       4        0             0 colord
[74271.099023] [ 4635]  1000  4635    44031     1070      23       3        0             0 dconf-service
[74271.099025] [ 4782]     0  4782     1464      174       8       3        0             0 dd
[74271.099027] [ 4783]     0  4783     1494      180       8       3        0             0 pv
[74271.099029] [ 4784]     0  4784    17851      484       8       3        0             0 dd
[74271.099031] [ 5003]  1000  5003     4158     1078      12       3        0             0 bash
[74271.099033] [ 5005]  1000  5005     6881      924      17       3        0             0 alsamixer
[74271.099035] [ 5210]  1000  5210     4166     1158      12       3        0             0 bash
[74271.099038] [ 8019]  1000  8019     4133     1141      13       3        0             0 bash
[74271.099040] [ 8021]  1000  8021   369743   134275     594       5        0             0 firefox
[74271.099042] [ 8263]  1000  8263   109272     9510     144       3        0             0 hexchat
[74271.099044] [ 8293]  1000  8293     4133     1142      14       3        0             0 bash
[74271.099046] Out of memory: Kill process 8021 (firefox) score 136 or sacrifice child
[74271.099138] Killed process 8021 (firefox) total-vm:1478972kB, anon-rss:421148kB, file-rss:103796kB, shmem-rss:12156kB
[74271.139359] oom_reaper: reaped process 8021 (firefox), now anon-rss:0kB, file-rss:96kB, shmem-rss:12156kB
[74924.798060] Adding 4194300k swap on /dev/mapper/MAINSTORE-swap.  Priority:-1 extents:1 across:4194300k FS
[75265.030381] Purging GPU memory, 4109 pages freed, 3006 pages still pinned.
[75265.030385] 96 and 0 pages still available in the bound and unbound GPU page lists.
[75657.382917] Purging GPU memory, 4181 pages freed, 3912 pages still pinned.
[75657.382922] 96 and 0 pages still available in the bound and unbound GPU page lists.
[75657.384387] Purging GPU memory, 0 pages freed, 3912 pages still pinned.
[75657.384391] 96 and 0 pages still available in the bound and unbound GPU page lists.
[75657.384446] MediaPl~back #3 invoked oom-killer: gfp_mask=0x27000c0(GFP_KERNEL_ACCOUNT|__GFP_NOTRACK), order=2, oom_score_adj=0
[75657.384447] MediaPl~back #3 cpuset=/ mems_allowed=0
[75657.384453] CPU: 3 PID: 8706 Comm: MediaPl~back #3 Tainted: G     U          4.7.2-1-ARCH #1
[75657.384455] Hardware name: Dell Inc. Latitude E5520/0KCT5J, BIOS A14 12/26/2013
[75657.384457]  0000000000000286 0000000043b2756e ffff88010541bb48 ffffffff812eb132
[75657.384460]  ffff88010541bd28 ffff8800b8c08e40 ffff88010541bbb8 ffffffff811f6e5c
[75657.384462]  0000000000000000 0101ffff00000000 0000000043b2756e 00000000ffffffff
[75657.384465] Call Trace:
[75657.384471]  [<ffffffff812eb132>] dump_stack+0x63/0x81
[75657.384476]  [<ffffffff811f6e5c>] dump_header+0x60/0x1e8
[75657.384480]  [<ffffffff811762fa>] oom_kill_process+0x22a/0x440
[75657.384483]  [<ffffffff8117696a>] out_of_memory+0x40a/0x4b0
[75657.384486]  [<ffffffff812ffe08>] ? find_next_bit+0x18/0x20
[75657.384489]  [<ffffffff8117c05b>] __alloc_pages_nodemask+0xf0b/0xf30
[75657.384492]  [<ffffffff8117c3d4>] alloc_kmem_pages_node+0x54/0xd0
[75657.384495]  [<ffffffff81077c06>] copy_process.part.8+0x136/0x19a0
[75657.384498]  [<ffffffff811a99d9>] ? handle_mm_fault+0xd09/0x1f60
[75657.384500]  [<ffffffff81079647>] _do_fork+0xd7/0x3d0
[75657.384504]  [<ffffffff810655f5>] ? __do_page_fault+0x1f5/0x510
[75657.384506]  [<ffffffff810799e9>] SyS_clone+0x19/0x20
[75657.384509]  [<ffffffff81003c07>] do_syscall_64+0x57/0xb0
[75657.384512]  [<ffffffff815de861>] entry_SYSCALL64_slow_path+0x25/0x25
[75657.384514] Mem-Info:
[75657.384519] active_anon:108442 inactive_anon:124560 isolated_anon:0
                active_file:72880 inactive_file:596990 isolated_file:0
                unevictable:1 dirty:2569 writeback:0 unstable:0
                slab_reclaimable:16566 slab_unreclaimable:5931
                mapped:52879 shmem:22445 pagetables:3644 bounce:0
                free:42449 free_pcp:25 free_cma:0
[75657.384523] Node 0 DMA free:15344kB min:264kB low:328kB high:392kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15972kB managed:15360kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:16kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
[75657.384529] lowmem_reserve[]: 0 3137 3823 3823
[75657.384533] Node 0 DMA32 free:132516kB min:55252kB low:69064kB high:82876kB active_anon:361184kB inactive_anon:408440kB active_file:236332kB inactive_file:1965936kB unevictable:4kB isolated(anon):0kB isolated(file):0kB present:3302864kB managed:3227236kB mlocked:4kB dirty:7612kB writeback:0kB mapped:172840kB shmem:71368kB slab_reclaimable:54936kB slab_unreclaimable:16904kB kernel_stack:3120kB pagetables:12092kB unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[75657.384539] lowmem_reserve[]: 0 0 685 685
[75657.384542] Node 0 Normal free:21936kB min:12064kB low:15080kB high:18096kB active_anon:72584kB inactive_anon:89800kB active_file:55188kB inactive_file:422024kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:770048kB managed:701632kB mlocked:0kB dirty:2664kB writeback:0kB mapped:38676kB shmem:18412kB slab_reclaimable:11328kB slab_unreclaimable:6804kB kernel_stack:1584kB pagetables:2484kB unstable:0kB bounce:0kB free_pcp:88kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[75657.384548] lowmem_reserve[]: 0 0 0 0
[75657.384550] Node 0 DMA: 0*4kB 0*8kB 1*16kB (U) 1*32kB (U) 1*64kB (U) 1*128kB (U) 1*256kB (U) 1*512kB (U) 0*1024kB 1*2048kB (M) 3*4096kB (M) = 15344kB
[75657.384563] Node 0 DMA32: 21696*4kB (UE) 5755*8kB (UM) 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 132824kB
[75657.384571] Node 0 Normal: 4718*4kB (UMEH) 351*8kB (UMH) 5*16kB (H) 4*32kB (H) 1*64kB (H) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 22080kB
[75657.384583] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
[75657.384584] 692321 total pagecache pages
[75657.384586] 0 pages in swap cache
[75657.384587] Swap cache stats: add 0, delete 0, find 0/0
[75657.384589] Free swap  = 4194300kB
[75657.384590] Total swap = 4194300kB
[75657.384591] 1022221 pages RAM
[75657.384592] 0 pages HighMem/MovableOnly
[75657.384593] 36164 pages reserved
[75657.384594] 0 pages hwpoisoned
[75657.384595] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds swapents oom_score_adj name
[75657.384601] [  284]     0   284    19300     2240      36       3        0             0 systemd-journal
[75657.384603] [  307]     0   307     9211     1178      20       3        0         -1000 systemd-udevd
[75657.384606] [  387]     0   387    23022      377      15       3        0             0 lvmetad
[75657.384608] [  494]     0   494     9643     1139      22       4        0             0 systemd-logind
[75657.384610] [  495]    81   495     8294      952      21       3        0          -900 dbus-daemon
[75657.384612] [  564]     0   564     1685      476       9       3        0             0 dhcpcd
[75657.384615] [  567]     0   567    22554     1024      48       3        0             0 login
[75657.384617] [  576]  1000   576    13695     1611      29       3        0             0 systemd
[75657.384619] [  578]  1000   578    24618      390      48       3        0             0 (sd-pam)
[75657.384622] [  582]  1000   582     4133      967      14       3        0             0 bash
[75657.384624] [  587]  1000   587     3406      753      11       3        0             0 startx
[75657.384626] [  609]  1000   609     3982      233      14       3        0             0 xinit
[75657.384628] [  610]  1000   610    89971    21986     143       3        0             0 Xorg
[75657.384630] [  612]  1000   612     1041      161       7       3        0             0 xf86-video-inte
[75657.384632] [  614]  1000   614     3406      771      12       3        0             0 sh
[75657.384635] [  615]  1000   615   127125    11999     146       4        0             0 udiskie
[75657.384637] [  620]  1000   620    87886     4526     109       4        0             0 xfce4-session
[75657.384639] [  621]  1000   621     8247      970      21       3        0             0 dbus-daemon
[75657.384641] [  624]   102   624   129314     4057      50       3        0             0 polkitd
[75657.384643] [  632]  1000   632    13211     1218      29       3        0             0 xfconfd
[75657.384646] [  635]  1000   635     2788       78       8       3        0             0 ssh-agent
[75657.384648] [  637]  1000   637    41313      158      16       3        0             0 gpg-agent
[75657.384650] [  638]  1000   638    50138     5025      99       3        0             0 xfwm4
[75657.384652] [  640]  1000   640   129089     7112     116       4        0             0 Thunar
[75657.384654] [  643]     0   643   163098     2775      53       4        0             0 udisksd
[75657.384657] [  651]  1000   651    78057     6476     119       3        0             0 xfce4-panel
[75657.384659] [  652]  1000   652    69438     3681     100       3        0             0 xfsettingsd
[75657.384661] [  654]  1000   654   116162     8243     127       3        0             0 xfdesktop
[75657.384663] [  662]  1000   662   101851     7176      99       3        0             0 xfce4-terminal
[75657.384665] [  664]  1000   664    85904     3586     102       3        0             0 xfce4-power-man
[75657.384667] [  671]  1000   671    83874     1275      32       4        0             0 at-spi-bus-laun
[75657.384669] [  672]  1000   672    83646     3574      93       3        0             0 polkit-gnome-au
[75657.384672] [  682]  1000   682     8186      769      20       3        0             0 dbus-daemon
[75657.384674] [  684]  1000   684    53563     1479      40       3        0             0 at-spi2-registr
[75657.384676] [  687]  1000   687    49017     3477     100       3        0             0 panel-6-systray
[75657.384678] [  688]  1000   688     4133      957      12       3        0             0 bash
[75657.384680] [  689]  1000   689     4133     1031      12       3        0             0 bash
[75657.384682] [  690]  1000   690     4133     1123      12       3        0             0 bash
[75657.384684] [  692]  1000   692    47687     4040      95       3        0             0 panel-8-datetim
[75657.384687] [  702]  1000   702    47376     3633      94       3        0             0 panel-49-cpugra
[75657.384689] [  706]     0   706    73320     2069      39       3        0             0 upowerd
[75657.384691] [  728]  1000   728    39711     4553      80       3        0             0 quicksynergy
[75657.384693] [  873]  1000   873     4133     1142      13       3        0             0 bash
[75657.384695] [ 1092]  1000  1092    88772    13384     133       3        0             0 medit
[75657.384697] [ 1093]  1000  1093     4148     1118      13       3        0             0 bash
[75657.384699] [ 1096]  1000  1096     3604      698      12       3        0             0 gam_server
[75657.384702] [ 1251]  1000  1251    10032     1312      24       3        0             0 ssh
[75657.384704] [ 1617]  1000  1617     4133     1098      12       3        0             0 bash
[75657.384706] [ 1626]     0  1626    17508     1286      38       3        0             0 sudo
[75657.384708] [ 1628]     0  1628    10783      756      24       3        0             0 su
[75657.384710] [ 1629]     0  1629     4166     1150      13       3        0             0 bash
[75657.384713] [ 1635]     0  1635     3406      775      11       3        0             0 read_erase_fore
[75657.384715] [ 4278]  1000  4278    31748     1634      28       4        0             0 synergys
[75657.384717] [ 4500]     0  4500    22186     2151      47       3        0             0 cupsd
[75657.384719] [ 4501]   124  4501    74800     2980      47       4        0             0 colord
[75657.384721] [ 4635]  1000  4635    44031     1070      23       3        0             0 dconf-service
[75657.384724] [ 4782]     0  4782     1464      174       8       3        0             0 dd
[75657.384726] [ 4783]     0  4783     1494      180       8       3        0             0 pv
[75657.384728] [ 4784]     0  4784    17851      484       8       3        0             0 dd
[75657.384730] [ 5003]  1000  5003     4158     1078      12       3        0             0 bash
[75657.384732] [ 5005]  1000  5005     6881      924      17       3        0             0 alsamixer
[75657.384734] [ 5210]  1000  5210     4166     1158      12       3        0             0 bash
[75657.384736] [ 8019]  1000  8019     4159     1204      13       3        0             0 bash
[75657.384739] [ 8263]  1000  8263   109273     9531     144       3        0             0 hexchat
[75657.384741] [ 8293]  1000  8293     4133     1142      14       3        0             0 bash
[75657.384743] [ 8512]  1000  8512   391791   187149     623       5        0             0 firefox
[75657.384745] [ 8599]  1000  8599     4133     1108      12       3        0             0 bash
[75657.384747] [ 8720]  1000  8720     4158     1140      13       3        0             0 bash
[75657.384749] [ 8721]  1000  8721     6881      938      19       3        0             0 alsamixer
[75657.384751] Out of memory: Kill process 8512 (firefox) score 92 or sacrifice child
[75657.384858] Killed process 8512 (firefox) total-vm:1567164kB, anon-rss:639224kB, file-rss:101376kB, shmem-rss:7996kB
[75657.434733] oom_reaper: reaped process 8512 (firefox), now anon-rss:0kB, file-rss:232kB, shmem-rss:8100kB
[75676.010955] Purging GPU memory, 4985 pages freed, 2100 pages still pinned.
[75676.010960] 96 and 0 pages still available in the bound and unbound GPU page lists.
[92644.455870] Purging GPU memory, 4445 pages freed, 4818 pages still pinned.
[92644.455874] 96 and 0 pages still available in the bound and unbound GPU page lists.
[93095.174517] Purging GPU memory, 4892 pages freed, 5962 pages still pinned.
[93095.174521] 96 and 0 pages still available in the bound and unbound GPU page lists.
[124327.711805] perf: interrupt took too long (6201 > 6168), lowering kernel.perf_event_max_sample_rate to 32100
[152260.507025] kvm: zapping shadow pages for mmio generation wraparound
[152260.508604] kvm: zapping shadow pages for mmio generation wraparound
[152270.804908] kvm [14631]: vcpu0, guest rIP: 0xffffffff81051ac4 disabled perfctr wrmsr: 0xc1 data 0xffff
[157583.435149] Purging GPU memory, 4975 pages freed, 8672 pages still pinned.
[157583.435153] 96 and 0 pages still available in the bound and unbound GPU page lists.
[157583.436955] Purging GPU memory, 0 pages freed, 8672 pages still pinned.
[157583.436959] 96 and 0 pages still available in the bound and unbound GPU page lists.
[157583.437010] qemu-system-x86 invoked oom-killer: gfp_mask=0x26040c0(GFP_KERNEL|__GFP_COMP|__GFP_NOTRACK), order=3, oom_score_adj=0
[157583.437012] qemu-system-x86 cpuset=/ mems_allowed=0
[157583.437018] CPU: 2 PID: 15179 Comm: qemu-system-x86 Tainted: G     U          4.7.2-1-ARCH #1
[157583.437019] Hardware name: Dell Inc. Latitude E5520/0KCT5J, BIOS A14 12/26/2013
[157583.437021]  0000000000000286 00000000af50fe2f ffff88004209f8e0 ffffffff812eb132
[157583.437024]  ffff88004209fac0 ffff88012817d580 ffff88004209f950 ffffffff811f6e5c
[157583.437027]  0000000000000000 0101880000000000 00000000af50fe2f 00000000ffffffff
[157583.437030] Call Trace:
[157583.437036]  [<ffffffff812eb132>] dump_stack+0x63/0x81
[157583.437040]  [<ffffffff811f6e5c>] dump_header+0x60/0x1e8
[157583.437045]  [<ffffffff811762fa>] oom_kill_process+0x22a/0x440
[157583.437048]  [<ffffffff8117696a>] out_of_memory+0x40a/0x4b0
[157583.437051]  [<ffffffff812ffe08>] ? find_next_bit+0x18/0x20
[157583.437054]  [<ffffffff8117c05b>] __alloc_pages_nodemask+0xf0b/0xf30
[157583.437058]  [<ffffffff811cb845>] alloc_pages_current+0x95/0x140
[157583.437060]  [<ffffffff811d415a>] new_slab+0x3da/0x5b0
[157583.437062]  [<ffffffff811d65a8>] ___slab_alloc+0x4a8/0x5a0
[157583.437069]  [<ffffffffa05f4473>] ? vmx_create_vcpu+0x43/0xf90 [kvm_intel]
[157583.437073]  [<ffffffffa05f4473>] ? vmx_create_vcpu+0x43/0xf90 [kvm_intel]
[157583.437075]  [<ffffffff811d66cb>] __slab_alloc.isra.20+0x2b/0x40
[157583.437077]  [<ffffffff811d73f5>] kmem_cache_alloc+0x195/0x1e0
[157583.437081]  [<ffffffffa05f4473>] vmx_create_vcpu+0x43/0xf90 [kvm_intel]
[157583.437094]  [<ffffffffa04dab7e>] kvm_arch_vcpu_create+0x3e/0x60 [kvm]
[157583.437102]  [<ffffffffa04c3d10>] kvm_vm_ioctl+0x290/0x700 [kvm]
[157583.437105]  [<ffffffff8120cd72>] do_vfs_ioctl+0xa2/0x5d0
[157583.437109]  [<ffffffff81217e07>] ? __fget+0x77/0xb0
[157583.437112]  [<ffffffff8120d319>] SyS_ioctl+0x79/0x90
[157583.437115]  [<ffffffff81096cde>] ? __task_pid_nr_ns+0x7e/0xd0
[157583.437118]  [<ffffffff815de7b2>] entry_SYSCALL_64_fastpath+0x1a/0xa4
[157583.437120] Mem-Info:
[157583.437125] active_anon:115158 inactive_anon:219697 isolated_anon:0
                 active_file:92476 inactive_file:475552 isolated_file:0
                 unevictable:0 dirty:162 writeback:0 unstable:0
                 slab_reclaimable:18831 slab_unreclaimable:6336
                 mapped:71612 shmem:47680 pagetables:3918 bounce:0
                 free:39574 free_pcp:1 free_cma:0
[157583.437129] Node 0 DMA free:15344kB min:264kB low:328kB high:392kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15972kB managed:15360kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:16kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
[157583.437135] lowmem_reserve[]: 0 3137 3823 3823
[157583.437139] Node 0 DMA32 free:120408kB min:55252kB low:69064kB high:82876kB active_anon:405984kB inactive_anon:699848kB active_file:299904kB inactive_file:1571328kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3302864kB managed:3227236kB mlocked:0kB dirty:312kB writeback:0kB mapped:238996kB shmem:153104kB slab_reclaimable:60068kB slab_unreclaimable:18424kB kernel_stack:2688kB pagetables:12700kB unstable:0kB bounce:0kB free_pcp:120kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[157583.437145] lowmem_reserve[]: 0 0 685 685
[157583.437149] Node 0 Normal free:22544kB min:12064kB low:15080kB high:18096kB active_anon:54648kB inactive_anon:178940kB active_file:70000kB inactive_file:330880kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:770048kB managed:701632kB mlocked:0kB dirty:336kB writeback:0kB mapped:47452kB shmem:37616kB slab_reclaimable:15256kB slab_unreclaimable:6904kB kernel_stack:1776kB pagetables:2972kB unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[157583.437154] lowmem_reserve[]: 0 0 0 0
[157583.437157] Node 0 DMA: 0*4kB 0*8kB 1*16kB (U) 1*32kB (U) 1*64kB (U) 1*128kB (U) 1*256kB (U) 1*512kB (U) 0*1024kB 1*2048kB (M) 3*4096kB (M) = 15344kB
[157583.437169] Node 0 DMA32: 215*4kB (UME) 4340*8kB (UM) 5300*16kB (UM) 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 120380kB
[157583.437178] Node 0 Normal: 1676*4kB (UMEH) 1910*8kB (UMH) 6*16kB (UH) 3*32kB (H) 3*64kB (H) 2*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 22624kB
[157583.437190] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
[157583.437191] 615732 total pagecache pages
[157583.437193] 0 pages in swap cache
[157583.437194] Swap cache stats: add 0, delete 0, find 0/0
[157583.437196] Free swap  = 4194300kB
[157583.437197] Total swap = 4194300kB
[157583.437198] 1022221 pages RAM
[157583.437199] 0 pages HighMem/MovableOnly
[157583.437200] 36164 pages reserved
[157583.437201] 0 pages hwpoisoned
[157583.437202] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds swapents oom_score_adj name
[157583.437207] [  284]     0   284    19300     3347      36       3        0             0 systemd-journal
[157583.437210] [  307]     0   307     9211     1178      20       3        0         -1000 systemd-udevd
[157583.437212] [  387]     0   387    23022      377      15       3        0             0 lvmetad
[157583.437214] [  494]     0   494     9643     1139      22       4        0             0 systemd-logind
[157583.437217] [  495]    81   495     8294      952      21       3        0          -900 dbus-daemon
[157583.437219] [  564]     0   564     1685      476       9       3        0             0 dhcpcd
[157583.437221] [  567]     0   567    22554     1024      48       3        0             0 login
[157583.437223] [  576]  1000   576    13695     1611      29       3        0             0 systemd
[157583.437225] [  578]  1000   578    24618      390      48       3        0             0 (sd-pam)
[157583.437228] [  582]  1000   582     4133      967      14       3        0             0 bash
[157583.437230] [  587]  1000   587     3406      753      11       3        0             0 startx
[157583.437232] [  609]  1000   609     3982      233      14       3        0             0 xinit
[157583.437234] [  610]  1000   610   110288    36989     177       3        0             0 Xorg
[157583.437236] [  612]  1000   612     1041      161       7       3        0             0 xf86-video-inte
[157583.437239] [  614]  1000   614     3406      771      12       3        0             0 sh
[157583.437241] [  615]  1000   615   127125    11999     146       4        0             0 udiskie
[157583.437243] [  620]  1000   620    87886     4526     109       4        0             0 xfce4-session
[157583.437245] [  621]  1000   621     8247      970      21       3        0             0 dbus-daemon
[157583.437247] [  624]   102   624   129314     4057      50       3        0             0 polkitd
[157583.437249] [  632]  1000   632    13211     1218      29       3        0             0 xfconfd
[157583.437251] [  635]  1000   635     2788       78       8       3        0             0 ssh-agent
[157583.437254] [  637]  1000   637    41313      158      16       3        0             0 gpg-agent
[157583.437256] [  638]  1000   638    50173     5167      99       3        0             0 xfwm4
[157583.437258] [  640]  1000   640   129380     7497     118       4        0             0 Thunar
[157583.437260] [  643]     0   643   163098     2790      53       4        0             0 udisksd
[157583.437262] [  651]  1000   651    78274     6717     120       3        0             0 xfce4-panel
[157583.437264] [  652]  1000   652    69438     3681     100       3        0             0 xfsettingsd
[157583.437266] [  654]  1000   654   116199     8311     127       3        0             0 xfdesktop
[157583.437268] [  662]  1000   662   102007     7363      99       3        0             0 xfce4-terminal
[157583.437270] [  664]  1000   664    85904     3586     102       3        0             0 xfce4-power-man
[157583.437273] [  671]  1000   671    83874     1275      32       4        0             0 at-spi-bus-laun
[157583.437275] [  672]  1000   672    83646     3574      93       3        0             0 polkit-gnome-au
[157583.437277] [  682]  1000   682     8186      769      20       3        0             0 dbus-daemon
[157583.437279] [  684]  1000   684    53563     1479      40       3        0             0 at-spi2-registr
[157583.437281] [  687]  1000   687    49017     3477     100       3        0             0 panel-6-systray
[157583.437283] [  692]  1000   692    47687     4040      95       3        0             0 panel-8-datetim
[157583.437285] [  702]  1000   702    47376     3633      94       3        0             0 panel-49-cpugra
[157583.437288] [  706]     0   706    73320     2069      39       3        0             0 upowerd
[157583.437290] [  728]  1000   728    39711     4553      80       3        0             0 quicksynergy
[157583.437292] [ 1092]  1000  1092   213940    15267     151       4        0             0 medit
[157583.437294] [ 1093]  1000  1093     4148     1118      13       3        0             0 bash
[157583.437296] [ 1096]  1000  1096     3604      698      12       3        0             0 gam_server
[157583.437299] [ 1617]  1000  1617     4133     1098      12       3        0             0 bash
[157583.437301] [ 1626]     0  1626    17508     1286      38       3        0             0 sudo
[157583.437303] [ 1628]     0  1628    10783      756      24       3        0             0 su
[157583.437305] [ 1629]     0  1629     4166     1150      13       3        0             0 bash
[157583.437307] [ 1635]     0  1635     3406      775      11       3        0             0 read_erase_fore
[157583.437309] [ 4500]     0  4500    22186     2151      47       3        0             0 cupsd
[157583.437311] [ 4501]   124  4501    74800     2980      47       4        0             0 colord
[157583.437314] [ 4635]  1000  4635    44031     1070      23       3        0             0 dconf-service
[157583.437316] [ 8747]  1000  8747   513983   280015     870       5        0             0 firefox
[157583.437318] [14605]  1000 14605     4166     1159      13       3        0             0 bash
[157583.437320] [14660]  1000 14660    31686     1571      28       3        0             0 synergys
[157583.437323] [15033]  1000 15033     4158     1114      13       3        0             0 bash
[157583.437325] [15081]     0 15081     1464      175       8       3        0             0 dd
[157583.437327] [15082]     0 15082     1494      180       8       3        0             0 pv
[157583.437329] [15083]     0 15083    17851      471       9       3        0             0 dd
[157583.437332] [15150]  1000 15150    83755     2978      90       4        0             0 tumblerd
[157583.437334] [15176]  1000 15176   103639     6480     184       5        0             0 qemu-system-x86
[157583.437336] Out of memory: Kill process 8747 (firefox) score 138 or sacrifice child
[157583.437429] Killed process 8747 (firefox) total-vm:2055932kB, anon-rss:957972kB, file-rss:110320kB, shmem-rss:51768kB
[157583.732530] kvm: zapping shadow pages for mmio generation wraparound
[157583.734509] kvm: zapping shadow pages for mmio generation wraparound
[157590.689638] kvm [15176]: vcpu0, guest rIP: 0xffffffff81051ac4 disabled perfctr wrmsr: 0xc1 data 0xffff
[158053.789106] kvm [15176]: vcpu0, guest rIP: 0xffffffff81051ac4 disabled perfctr wrmsr: 0xc1 data 0xffff
[158891.062868] kvm: zapping shadow pages for mmio generation wraparound
[158891.064805] kvm: zapping shadow pages for mmio generation wraparound
[158898.125284] kvm [15509]: vcpu0, guest rIP: 0xffffffff81051ac4 disabled perfctr wrmsr: 0xc1 data 0xffff
[159012.384652] kvm [15509]: vcpu0, guest rIP: 0xffffffff81051ac4 disabled perfctr wrmsr: 0xc1 data 0xffff
[159250.046969] kvm: zapping shadow pages for mmio generation wraparound
[159250.048892] kvm: zapping shadow pages for mmio generation wraparound
[159257.091605] kvm [15780]: vcpu0, guest rIP: 0xffffffff81051ac4 disabled perfctr wrmsr: 0xc1 data 0xffff
[159387.540689] kvm: zapping shadow pages for mmio generation wraparound
[159387.542881] kvm: zapping shadow pages for mmio generation wraparound
[159394.383885] kvm [15849]: vcpu0, guest rIP: 0xffffffff81051ac4 disabled perfctr wrmsr: 0xc1 data 0xffff
[160815.343703] kvm: zapping shadow pages for mmio generation wraparound
[160815.345474] kvm: zapping shadow pages for mmio generation wraparound
[160822.428849] kvm [16302]: vcpu0, guest rIP: 0xffffffff81051ac4 disabled perfctr wrmsr: 0xc1 data 0xffff
[161378.193149] kvm: zapping shadow pages for mmio generation wraparound
[161378.194965] kvm: zapping shadow pages for mmio generation wraparound
[161384.813913] kvm [16567]: vcpu0, guest rIP: 0xffffffff81051ac4 disabled perfctr wrmsr: 0xc1 data 0xffff
[161444.157584] kvm: zapping shadow pages for mmio generation wraparound
[161444.159303] kvm: zapping shadow pages for mmio generation wraparound
[161450.531900] kvm [16613]: vcpu0, guest rIP: 0xffffffff81051ac4 disabled perfctr wrmsr: 0xc1 data 0xffff

Last edited by webdawg (2016-09-01 17:46:06)

Offline

#2 2016-09-01 19:24:38

Slithery
Administrator
From: Norfolk, UK
Registered: 2013-12-01
Posts: 5,776

Re: Intresting Crashes Out of Memory With SATA Disk Erase

More information needed...

At least share your script with us please...

Why not use a known good application to check your drives (ie badblocks)...


No, it didn't "fix" anything. It just shifted the brokeness one space to the right. - jasonwryan
Closing -- for deletion; Banning -- for muppetry. - jasonwryan

aur - dotfiles

Offline

#3 2016-09-01 21:12:29

webdawg
Member
Registered: 2010-12-28
Posts: 62

Re: Intresting Crashes Out of Memory With SATA Disk Erase

because I did not know that badblocks existed

the bash script just uses dd and does a smartcl -a in between reads and writes

Nothing complicated.

dd if drive to null
dd if=zero to drive

with a pv in the middle

why would dd cause an out of memory error?

You think there is a way to replicate this faster?

Offline

#4 2016-09-03 06:52:38

mich41
Member
Registered: 2012-06-22
Posts: 796

Re: Intresting Crashes Out of Memory With SATA Disk Erase

10% of your RAM is tied up by data queued by dd for writing to the disk. Reduce /proc/sys/vm/dirty_ratio from 10 to 1 (echo 1 to this file as root).

BTW, you don't need dd, just pv </dev/zero >/dev/sdx.

Offline

#5 2016-09-13 13:58:00

webdawg
Member
Registered: 2010-12-28
Posts: 62

Re: Intresting Crashes Out of Memory With SATA Disk Erase

Thanks mich41

Offline

#6 2016-09-13 16:41:33

alphaniner
Member
From: Ancapistan
Registered: 2010-07-12
Posts: 2,810

Re: Intresting Crashes Out of Memory With SATA Disk Erase

If you're using pv just to monitor progress, dd can do that with status=progress .


But whether the Constitution really be one thing, or another, this much is certain - that it has either authorized such a government as we have had, or has been powerless to prevent it. In either case, it is unfit to exist.
-Lysander Spooner

Offline

Board footer

Powered by FluxBB