You are not logged in.

#1 2016-07-19 19:27:36

x-yuri
Member
Registered: 2013-01-06
Posts: 160

Cannot retrieve coredump from journal or disk.

Hi,

I'm trying to investigate phantomjs crashing, but I'm unable to get to the core dump:

$ coredumpctl gdb 12129
           PID: 12129 (phantomjs)
           UID: 1000 (yuri)
           GID: 1000 (yuri)
        Signal: 8 (FPE)
     Timestamp: Tue 2016-07-19 22:10:30 EEST (3min 48s ago)
  Command Line: ./bin/phantomjs 1.js
    Executable: /home/yuri/_/phantomjs/phantomjs-2.1.1-linux-x86_64/bin/phantomjs
 Control Group: /user.slice/user-1000.slice/session-c1.scope
          Unit: session-c1.scope
         Slice: user-1000.slice
       Session: c1
     Owner UID: 1000 (yuri)
       Boot ID: 813b3644010a42749d6fd3f564849eaf
    Machine ID: ca92f7aa804f4142a6c56c42c1bc705b
      Hostname: yuri
       Message: Process 12129 (phantomjs) of user 1000 dumped core.

Cannot retrieve coredump from journal or disk.
Failed to retrieve core: No such file or directory

$ journalctl --verify
7fffec8: Unused data (entry_offset==0)
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/user-1000@012c8056e6544f46ae696598abebe256-000000000019754d-00052a0291080a2f.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/system@4382271eac8b4d0abe0cbc82113b42f0-00000000002b7f5a-00053205e62cd76e.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/user-1000@012c8056e6544f46ae696598abebe256-0000000000110e98-000526ba1203cfb1.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/system@4382271eac8b4d0abe0cbc82113b42f0-00000000003bb283-0005351c8441d54d.journal
7ffff88: Unused data (entry_offset==0)
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/user-1000@012c8056e6544f46ae696598abebe256-00000000002b7f52-00053205dae85a86.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/system@abf3c1e3d4844e6c8eb4cc3997b618e4-0000000000000001-000537b22b20ef8f.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/system@4382271eac8b4d0abe0cbc82113b42f0-000000000021823b-00052deb821b34ab.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/system@4382271eac8b4d0abe0cbc82113b42f0-000000000010fe55-000526b7144dea4f.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/system@4382271eac8b4d0abe0cbc82113b42f0-00000000004355a1-000535b86950a356.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/user-1000@012c8056e6544f46ae696598abebe256-00000000004355a6-000535b86950a655.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/system@4382271eac8b4d0abe0cbc82113b42f0-00000000004b98fb-000536583a190bd2.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/system@4382271eac8b4d0abe0cbc82113b42f0-00000000004ea999-0005367eb4794a02.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/user-1000@012c8056e6544f46ae696598abebe256-00000000004784a4-0005360be4dbb14a.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/system@000537317b61ac1e-1fbebf9be1dd7082.journal~
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/system@4382271eac8b4d0abe0cbc82113b42f0-000000000027f31b-0005306a356c38bd.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/user-1000@8f70c1ddbac444ef820979cc8440eabb-0000000000000465-000537318e83828b.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/user-1000.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/system@4382271eac8b4d0abe0cbc82113b42f0-0000000000131ec8-00052721ba791339.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/user-1000@012c8056e6544f46ae696598abebe256-0000000000338a1c-00053404d6708536.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/system@4382271eac8b4d0abe0cbc82113b42f0-00000000003f610d-00053579579ba855.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/system@4382271eac8b4d0abe0cbc82113b42f0-0000000000338a22-00053404d8bc147a.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/user-1000@012c8056e6544f46ae696598abebe256-00000000003f6108-000535795711e9db.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/system.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/user-1000@012c8056e6544f46ae696598abebe256-00000000001f641d-00052b8725786853.journal
7fffe50: Unused data (entry_offset==0)
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/user-1000@012c8056e6544f46ae696598abebe256-000000000027f2a4-0005306a274c770b.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/system@4382271eac8b4d0abe0cbc82113b42f0-00000000004784a8-0005360be5426b92.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/system@4382271eac8b4d0abe0cbc82113b42f0-0000000000153e76-0005278909d40c50.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/user-1000@012c8056e6544f46ae696598abebe256-00000000002fce81-000533367898b72d.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/system@4382271eac8b4d0abe0cbc82113b42f0-0000000000179ad8-000528bf81778fc4.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/user-1000@000537318e7d3554-160e4e9e01f9b08c.journal~
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/system@4382271eac8b4d0abe0cbc82113b42f0-00000000001cb29b-00052adf4ac07a53.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/user-1000@012c8056e6544f46ae696598abebe256-0000000000155d31-0005278ec5bd8288.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/system@4382271eac8b4d0abe0cbc82113b42f0-000000000037c5f1-000534b527690c63.journal
7fffde8: Unused data (entry_offset==0)
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/user-1000@012c8056e6544f46ae696598abebe256-00000000002468a5-00052f8435a63a57.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/user-1000@012c8056e6544f46ae696598abebe256-00000000000ee1a4-0005264e5ae98ff0.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/user-1000@012c8056e6544f46ae696598abebe256-0000000000133ef6-000527285577fbe8.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/system@4382271eac8b4d0abe0cbc82113b42f0-000000000019754f-00052a0291bf7277.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/user-1000@012c8056e6544f46ae696598abebe256-000000000021825d-00052decdc9cf501.journal
7fffe40: Unused data (entry_offset==0)
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/user-1000@012c8056e6544f46ae696598abebe256-00000000003bb27e-0005351c83e9d46f.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/user-1000@012c8056e6544f46ae696598abebe256-00000000004b98fd-000536583a37ea14.journal
7fffed8: Unused data (entry_offset==0)
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/user-1000@012c8056e6544f46ae696598abebe256-000000000037c5f8-000534b5279c134e.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/user-1000@012c8056e6544f46ae696598abebe256-00000000000ce42d-000525eb924919bb.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/system@4382271eac8b4d0abe0cbc82113b42f0-00000000002fceb9-000533368319817b.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/system@000537b22b794dc6-9ca1eb4d39d445da.journal~
7ffff08: Unused data (entry_offset==0)
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/user-1000@012c8056e6544f46ae696598abebe256-00000000001cb264-00052adf4146d019.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/system@4382271eac8b4d0abe0cbc82113b42f0-00000000001f644c-00052b8733432703.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/user-1000@012c8056e6544f46ae696598abebe256-00000000004ea99a-0005367eb492c4c0.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/system@4382271eac8b4d0abe0cbc82113b42f0-00000000002468c9-00052f843e2fc018.journal
PASS: /var/log/journal/ca92f7aa804f4142a6c56c42c1bc705b/system@4382271eac8b4d0abe0cbc82113b42f0-00000000000ede97-0005264df82c2aad.journal

Thanks in advance.

Offline

#2 2016-07-19 20:25:08

ewaller
Administrator
From: Pasadena, CA
Registered: 2009-07-13
Posts: 19,771

Re: Cannot retrieve coredump from journal or disk.

My guess is that the core is bigger than the maximum size permitted in the journal.  Take a look at man coredump.conf


Nothing is too wonderful to be true, if it be consistent with the laws of nature -- Michael Faraday
Sometimes it is the people no one can imagine anything of who do the things no one can imagine. -- Alan Turing
---
How to Ask Questions the Smart Way

Offline

#3 2016-07-19 23:06:12

x-yuri
Member
Registered: 2013-01-06
Posts: 160

Re: Cannot retrieve coredump from journal or disk.

I added `ProcessSizeMax=100G`, and did `systemctl daemon-reload && systemctl restart systemd-journald`. But `coredumpctl gdb ...` still wouldn't succeed.

Also, I ran `echo "core.%e.%p" > /proc/sys/kernel/core_pattern`, but couln't see coredumps in current directory.

Does it possibly explains anything?

$ journalctl -eu systemd-journald
...
Jul 15 23:07:30 yuri systemd-journald[206]: Runtime journal (/run/log/journal/) is 8.0M, max 197.6M, 189.6M free.
Jul 15 23:07:30 yuri systemd-journald[206]: Journal started
Jul 15 23:07:36 yuri systemd-journald[206]: System journal (/var/log/journal/) is 4.1G, max 4.0G, 0B free.
Jul 15 23:07:36 yuri systemd-journald[206]: Time spent on flushing to /var is 10.829ms for 836 entries.
Jul 19 22:10:17 yuri systemd-journald[206]: Journal stopped
Jul 19 22:10:17 yuri systemd-journald[12121]: System journal (/var/log/journal/) is 3.9G, max 4.0G, 7.7M free.
Jul 19 22:10:17 yuri systemd-journald[12121]: Journal started

Is there an easy way to produce small coredump?

Offline

#4 2016-07-19 23:13:34

ewaller
Administrator
From: Pasadena, CA
Registered: 2009-07-13
Posts: 19,771

Re: Cannot retrieve coredump from journal or disk.

x-yuri wrote:

Is there an easy way to produce small coredump?

I wrote this for just such an occasion smile

ewaller@turing/home/ewaller % cat devel/C/segfaultgenerator/main.c
#include <stdio.h>
int main (int argc, char* argv[])

{
   char* myString;
   myString=0;
   printf ("%s",*myString);
   return 0;
}
ewaller@turing/home/ewaller %

Edit:

ewaller@turing/home/ewaller % cd devel/C/segfaultgenerator/
ewaller@turing/home/ewaller/devel/C/segfaultgenerator % ./a.out
Segmentation fault (core dumped)
ewaller@turing/home/ewaller/devel/C/segfaultgenerator[139] % coredumpctl gdb               
           PID: 16559 (a.out)
           UID: 1000 (ewaller)
           GID: 1000 (ewaller)
        Signal: 11 (SEGV)
     Timestamp: Tue 2016-07-19 16:17:02 PDT (8s ago)
  Command Line: ./a.out
    Executable: /home/ewaller/devel/C/segfaultgenerator/a.out
 Control Group: /user.slice/user-1000.slice/session-c4.scope
          Unit: session-c4.scope
         Slice: user-1000.slice
       Session: c4
     Owner UID: 1000 (ewaller)
       Boot ID: e161ea8798a24e4fa5e6f99e44c087b5
    Machine ID: ca8802a46ad045d99c9662c2f74f3971
      Hostname: turing
      Coredump: /var/lib/systemd/coredump/core.a\x2eout.1000.e161ea8798a24e4fa5e6f99e44c087b5.16559.1468970222000000000000.lz4
       Message: Process 16559 (a.out) of user 1000 dumped core.

                Stack trace of thread 16559:
                #0  0x00000000004004df main (a.out)
                #1  0x00007fe93a1ca741 __libc_start_main (libc.so.6)
                #2  0x0000000000400409 _start (a.out)

GNU gdb (GDB) 7.11.1
Copyright (C) 2016 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-pc-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>.
Find the GDB manual and other documentation resources online at:
<http://www.gnu.org/software/gdb/documentation/>.
For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from /home/ewaller/devel/C/segfaultgenerator/a.out...done.
[New LWP 16559]

warning: Could not load shared library symbols for linux-vdso.so.1.
Do you need "set solib-search-path" or "set sysroot"?
Core was generated by `./a.out'.
Program terminated with signal SIGSEGV, Segmentation fault.
#0  0x00000000004004df in main (argc=1, argv=0x7fff6fba7b58) at main.c:7
7          printf ("%s",*myString);
(gdb) l
2       int main (int argc, char* argv[])
3
4       {
5          char* myString;
6          myString=0;
7          printf ("%s",*myString);
8          return 0;
9       }
(gdb) print myString
$1 = 0x0
(gdb) print *myString
Cannot access memory at address 0x0
(gdb)

Last edited by ewaller (2016-07-20 02:09:52)


Nothing is too wonderful to be true, if it be consistent with the laws of nature -- Michael Faraday
Sometimes it is the people no one can imagine anything of who do the things no one can imagine. -- Alan Turing
---
How to Ask Questions the Smart Way

Offline

Board footer

Powered by FluxBB