What's the cause of "Kernel panic: No working init found"?

Recolic Keghart · 2018-06-05 16:53:00

Today, after performing full system upgrade, my ArchLinux doesn't boot anymore. It says "Kernel panic: No working init found" on boot(View Snapshot). After spending about 3 hours, I found that UID&GID of my `/usr/bin` and `/usr/share` is modified, and `/usr/lib64` is broken. (Reproduced at https://bbs.archlinux.org/viewtopic.php?id=192296, https://bbs.archlinux.org/viewtopic.php?id=197088&p=2, but all of them didn't discuss the reason).

Now the problem has been solved with the solution provided here, but I wonder who caused that. This problem appeared several years ago. I collected installed package list, pacman log, and journal of the system upgrade, but I don't know how could I determine which package is the criminal.

Directory with problem(/usr):

# Correct /usr:
recolic@RECOLICPC ~/t/fbi> ll /usr
total 520K
drwxr-xr-x   6 root root 132K Jun  5 23:36 bin/
drwxr-xr-x   3 root root 4.0K May 12 18:55 doc/
drwxr-xr-x   2 root root 4.0K Apr 24 14:45 etc/
drwxr-xr-x 539 root root  68K Jun  5 16:33 include/
drwxr-xr-x 256 root root 232K Jun  5 21:52 lib/
drwxr-xr-x  40 root root  40K Jun  5 16:33 lib32/
lrwxrwxrwx   1 root root    3 Jan  6 03:17 lib64 -> lib/
drwxr-xr-x  14 root root 4.0K Aug 27  2017 local/
lrwxrwxrwx   1 root root    3 Jan  6 03:17 sbin -> bin/
drwxr-xr-x 316 root root  12K Jun  4 12:49 share/
drwxr-xr-x   2 root root 4.0K Jan  5  2017 src/
drwxr-xr-x   2 root root 4.0K Apr  5 15:58 user-bin/
# Broken /usr: (modify time maybe incorrect!)
recolic@RECOLICPC ~/t/fbi> ll /usr
total 520K
drwxr-xr-x   6 recolic recolic 132K Jun  5 23:36 bin/
drwxr-xr-x   3 root root 4.0K May 12 18:55 doc/
drwxr-xr-x   2 root root 4.0K Apr 24 14:45 etc/
drwxr-xr-x 539 root root  68K Jun  5 16:33 include/
drwxr-xr-x 256 root root 232K Jun  5 21:52 lib/
drwxr-xr-x  40 root root  40K Jun  5 16:33 lib32/
drwxr-xr-x   1 root root    ??K Jan  6 03:17 lib64/
drwxr-xr-x  14 root root 4.0K Aug 27  2017 local/
lrwxrwxrwx   1 root root    3 Jan  6 03:17 sbin -> bin/
drwxr-xr-x 316 recolic recolic  12K Jun  4 12:49 share/
drwxr-xr-x   2 root root 4.0K Jan  5  2017 src/
drwxr-xr-x   2 root root 4.0K Apr  5 15:58 user-bin/

Installed packages:

python-msgpack python-cachecontrol python-distlib python-distro python-lockfile python-progress python-pytoml python-retrying gcc7-libs gcc7 pkgconf python2-urllib3 python2-chardet python2-requests python2-cachecontrol python2-colorama python2-distlib python2-distro python2-webencodings python2-html5lib python2-lockfile python2-msgpack python2-progress python2-pytoml python2-retrying python2-ipaddress translate-shell

Upgraded packages(aur included):

python-pip dvd+rw-tools libsm p11-kit lz4 libsystemd libdaemon libxkbfile xorg-setxkbmap xorg-server-common libfontenc kmod libnftnl systemd xorg-server libxxf86vm lm_sensors libxt libxmu qt5-base qt5-xmlpatterns qt5-declarative qt5-location qt5-sensors qt5-webchannel cdparanoia qt5-webkit libiec61883 vid.stab x265 ffmpeg gamin libbsd libwbclient ldb smbclient libxinerama libxss libxxf86dga libmp4v2 libusb-compat xorg-fonts-encodings xorg-font-util xorg-font-utils qt5-x11extras acetoneiso2 linux acpi_call alsa-firmware pacman librsvg appstream-glib automoc4 bbswitch boost-libs boost btrfs-progs clucene cmake cuda docbook-xml glu dosbox dotconf ecasound fcitx-qt5 fftw git git-lfs nm-connection-editor libmm-glib libmpeg2 zvbi ilmbase gst-plugins-bad telepathy-glib libquvi gnome-control-center gnugo go gts hdf5 hping liblqr libmagick imagemagick jfsutils lib32-systemd lib32-dbus lib32-libdrm lib32-libtheora lib32-libxdmcp lib32-libxext lib32-libvdpau lib32-libxcomposite lib32-libxft lib32-libxt lib32-libxmu lib32-libxxf86vm lib32-wayland lib32-mesa lib32-p11-kit lib32-nss libatasmart libbytesize libglade libgssglue libieee1284 libmusicbrainz5 libpgm libspiro libtiger libxkbui linux-headers mc modemmanager nodejs nvidia otf-fira-code pdfgrep pyalpm pygobject-devel pyqt5-common python-gobject python-setuptools python-pandas python-pyqt5 python-pytorch-cuda python-tensorflow-cuda python-websocket-client python2-gobject python2-setuptools python2-pip python2-pyqt5 qt5-svg qbittorrent qt5-3d qt5-canvas3d qt5-charts qt5-connectivity qt5-datavis3d qt5-doc qt5-examples qt5-gamepad qt5-graphicaleffects qt5-imageformats qt5-multimedia qt5-networkauth qt5-quickcontrols qt5-quickcontrols2 qt5-script qt5-scxml qt5-serialport qt5-serialbus qt5-speech qt5-tools qt5-translations qt5-virtualkeyboard qt5-wayland qt5-webengine qt5-websockets qt5-webview qt5ct qtcreator run-parts shadowsocks-libev systemd-sysvcompat telegram-desktop ttf-fira-code virtualbox-host-modules-arch vlc volume_key wine-staging winetricks wireless_tools xautolock xfsprogs xorg-docs xorg-fonts-alias xorg-luit xorg-server-devel xorg-server-xdmx xorg-server-xephyr xorg-server-xnest xorg-server-xvfb xorg-server-xwayland xorg-smproxy xorg-x11perf xorg-xbiff xorg-xcalc xorg-xclipboard xorg-xclock xorg-xcmsdb xorg-xcursorgen xorg-xdm xorg-xdpyinfo xorg-xedit xorg-xev xorg-xfd xorg-xgamma xorg-xhost xorg-xinput xorg-xkbevd xorg-xkbutils xorg-xlogo xorg-xlsatoms xorg-xmag xorg-xman xorg-xmodmap xorg-xvidtune xorg-xvinfo zip libreoffice-fresh libxfce4util vi clion clion-cmake clion-gdb clion-jre clion-lldb cpplint genymotion goland goland-jre google-chrome kubectl-bin package-query qt-installer-framework qt-installer-framework-docs visual-studio-code-bin

Journal and pacman.log is too large, download it here

Last edited by Recolic Keghart (2018-06-06 03:17:59)

Trilby · 2018-06-05 18:32:35

Please edit your post and double check your links. Most of them that seem to be intended to point to different places all go to the same previous thread.

I see in your log several uses of '--force' which would be unwise, as well as a partial upgrade ... followed by another --force of several packages. I'm not sure exactly how this would lead to your symptoms, but it does not at all surpise me that it would lead to horrible outcomes. There's a fair chance you may not even be aware of these (at least the partial upgrade) as you seem to be using yaourt for everything. I'd advise you stop all three: stop using --force, stop partial upgrading, and stop using yaourt.

Last edited by Trilby (2018-06-05 18:43:59)

Recolic Keghart · 2018-06-06 03:39:43

Trilby wrote:

Please edit your post and double check your links. Most of them that seem to be intended to point to different places all go to the same previous thread.
I see in your log several uses of '--force' which would be unwise, as well as a partial upgrade ... followed by another --force of several packages. I'm not sure exactly how this would lead to your symptoms, but it does not at all surpise me that it would lead to horrible outcomes. There's a fair chance you may not even be aware of these (at least the partial upgrade) as you seem to be using yaourt for everything. I'd advise you stop all three: stop using --force, stop partial upgrading, and stop using yaourt.

Pacman refused to upgrade python-pip because of file conflicts. I'm not sure what's the right solution but --force is the only way I know to upgrade python-* with file conflict...

1 bad link was fixed... Sorry.

I've read archwiki about partial upgrading and I'll avoid partial upgrading, try to avoid --force. Thanks a lot:)

ewaller · 2018-06-06 03:45:47

Recolic Keghart wrote:

I'm not sure what's the right solution but --force is the only way I know to upgrade python-* with file conflict...

That is unfortunate. It won't work anymore.

Edit: Hint: Search the man page for 'overwrite'

Last edited by ewaller (2018-06-06 03:46:44)

Recolic Keghart · 2018-06-06 04:19:48

ewaller wrote:

That is unfortunate. It won't work anymore.
Edit: Hint: Search the man page for 'overwrite'

Got it. Thanks

Last edited by Recolic Keghart (2018-06-06 04:23:16)

Arch Linux

#1 2018-06-05 16:53:00

What's the cause of "Kernel panic: No working init found"?

#2 2018-06-05 18:32:35

Re: What's the cause of "Kernel panic: No working init found"?

#3 2018-06-06 03:39:43

Re: What's the cause of "Kernel panic: No working init found"?

#4 2018-06-06 03:45:47

Re: What's the cause of "Kernel panic: No working init found"?

#5 2018-06-06 04:19:48

Re: What's the cause of "Kernel panic: No working init found"?

Board footer