[SOLVED] linux-zen broke: can not mount boot and not input possible

Wild Penguin · 2020-03-08 00:18:58

Hi,

For some reason linux-zen broke here (after upgrade to 5.5.8.zen1-1). Linux-5.5.8.arch1-1 works without problems on otherwise same configuration, which is good, of course, at least the system is still usable

Bootloader: UEFI, ReFind and Grub installed (booting with either one will have the same results).

Symptoms:
Will be droped into emergency shell, because can not mount newroot. No input is possible. Roughly this (typing by hand:)

Warning: /lib/modules/5.5.8-zen1-1-zen/modules.devname not found - ignoring
Starting version 244.3-1-arch
ERROR: device 'UUID=MyRootUUID' not found. Skipping fsck.
mount: /new_root: can't find UUID=MyRootUUID.
You are now being dropped into an emergency shell.
sh: can't access tty: job control turned off
[rootfs ]$

(and keyboard seems dead, no input is possible; blinking cursor is there)

On my setup, the root fs is on a bcache device with ext4 fs. bcache is in MODULES in mkinitcpio.conf (and works correctly for default Kernel). Also, bcache is in HOOKS.

I've examined both initramfs-linux and initramfs-linux-zen on my system and can not spot any obvious differences. Bcache is in both:

$ lsinitcpio initramfs-linux.img 
bin
buildconfig
config
dev/
etc/
etc/fstab
etc/initrd-release
etc/ld.so.cache
etc/ld.so.conf
etc/modprobe.d/
etc/modprobe.d/amdgpu.conf
etc/modprobe.d/blacklist.conf
etc/mtab
hooks/
hooks/udev
init
init_functions
lib
lib64
new_root/
proc/
run/
sbin
sys/
tmp/
usr/
usr/bin/
usr/bin/[
usr/bin/arch
usr/bin/ash
usr/bin/awk
usr/bin/base64
usr/bin/basename
usr/bin/bc
usr/bin/blkdiscard
usr/bin/blkid
usr/bin/busybox
usr/bin/bzip2
usr/bin/cat
usr/bin/chgrp
usr/bin/chmod
usr/bin/chown
usr/bin/chroot
usr/bin/clear
usr/bin/cp
usr/bin/cpio
usr/bin/cttyhack
usr/bin/cut
usr/bin/dd
usr/bin/depmod
usr/bin/df
usr/bin/dirname
usr/bin/dmesg
usr/bin/du
usr/bin/echo
usr/bin/env
usr/bin/expr
usr/bin/fallocate
usr/bin/false
usr/bin/fatattr
usr/bin/free
usr/bin/fsck
usr/bin/fsck.ext2
usr/bin/fsck.ext3
usr/bin/fsck.ext4
usr/bin/fsfreeze
usr/bin/fstrim
usr/bin/fsync
usr/bin/getopt
usr/bin/grep
usr/bin/gzip
usr/bin/halt
usr/bin/head
usr/bin/hexdump
usr/bin/hexedit
usr/bin/i2ctransfer
usr/bin/ifconfig
usr/bin/init
usr/bin/insmod
usr/bin/install
usr/bin/ip
usr/bin/ipaddr
usr/bin/iplink
usr/bin/ipneigh
usr/bin/iproute
usr/bin/iprule
usr/bin/iptunnel
usr/bin/kbd_mode
usr/bin/kill
usr/bin/killall
usr/bin/kmod
usr/bin/less
usr/bin/link
usr/bin/ln
usr/bin/loadfont
usr/bin/loadkmap
usr/bin/losetup
usr/bin/ls
usr/bin/lsmod
usr/bin/lsscsi
usr/bin/lzop
usr/bin/md5sum
usr/bin/mkdir
usr/bin/mkfifo
usr/bin/mknod
usr/bin/mkpasswd
usr/bin/mktemp
usr/bin/modinfo
usr/bin/modprobe
usr/bin/mount
usr/bin/mountpoint
usr/bin/mv
usr/bin/nc
usr/bin/netstat
usr/bin/nologin
usr/bin/nproc
usr/bin/nsenter
usr/bin/nslookup
usr/bin/nuke
usr/bin/openvt
usr/bin/partprobe
usr/bin/paste
usr/bin/pgrep
usr/bin/pidof
usr/bin/ping
usr/bin/ping6
usr/bin/poweroff
usr/bin/printf
usr/bin/ps
usr/bin/pwd
usr/bin/readlink
usr/bin/realpath
usr/bin/reboot
usr/bin/resume
usr/bin/rm
usr/bin/rmdir
usr/bin/rmmod
usr/bin/route
usr/bin/run-init
usr/bin/sed
usr/bin/seq
usr/bin/setfattr
usr/bin/setfont
usr/bin/sh
usr/bin/sha1sum
usr/bin/sha256sum
usr/bin/sha512sum
usr/bin/shuf
usr/bin/sleep
usr/bin/sort
usr/bin/stat
usr/bin/strings
usr/bin/switch_root
usr/bin/sync
usr/bin/systemd-tmpfiles
usr/bin/tac
usr/bin/tail
usr/bin/tar
usr/bin/tcpsvd
usr/bin/tee
usr/bin/telnet
usr/bin/test
usr/bin/tftp
usr/bin/touch
usr/bin/true
usr/bin/truncate
usr/bin/ts
usr/bin/udevadm
usr/bin/udhcpc
usr/bin/udhcpc6
usr/bin/umount
usr/bin/uname
usr/bin/uniq
usr/bin/unlink
usr/bin/unshare
usr/bin/unzip
usr/bin/uptime
usr/bin/vi
usr/bin/wc
usr/bin/wget
usr/bin/which
usr/bin/xxd
usr/bin/xz
usr/bin/yes
usr/lib/
usr/lib64
usr/lib/ld-linux-x86-64.so.2
usr/lib/libacl.so.1
usr/lib/libargon2.so.1
usr/lib/libattr.so.1
usr/lib/libblkid.so.1
usr/lib/libcap.so.2
usr/lib/libcom_err.so.2
usr/lib/libcrypto.so.1.1
usr/lib/libcryptsetup.so.12
usr/lib/libcrypt.so.1
usr/lib/libc.so.6
usr/lib/libdevmapper.so.1.02
usr/lib/libdl.so.2
usr/lib/libe2p.so.2
usr/lib/libext2fs.so.2
usr/lib/libgcrypt.so.20
usr/lib/libgpg-error.so.0
usr/lib/libidn2.so.0
usr/lib/libip4tc.so.2
usr/lib/libjson-c.so.4
usr/lib/libkmod.so.2
usr/lib/liblz4.so.1
usr/lib/liblzma.so.5
usr/lib/libmount.so.1
usr/lib/libm.so.6
usr/lib/libpthread.so.0
usr/lib/librt.so.1
usr/lib/libseccomp.so.2
usr/lib/libssl.so.1.1
usr/lib/libudev.so.1
usr/lib/libunistring.so.2
usr/lib/libuuid.so.1
usr/lib/libz.so.1
usr/lib/modprobe.d/
usr/lib/modprobe.d/bluetooth-usb.conf
usr/lib/modprobe.d/nvdimm-security.conf
usr/lib/modprobe.d/systemd.conf
usr/lib/modules/
usr/lib/modules/5.5.8-arch1-1/
usr/lib/modules/5.5.8-arch1-1/kernel/
usr/lib/modules/5.5.8-arch1-1/kernel/ahci.ko
usr/lib/modules/5.5.8-arch1-1/kernel/bcache.ko
usr/lib/modules/5.5.8-arch1-1/kernel/cdrom.ko
usr/lib/modules/5.5.8-arch1-1/kernel/crc16.ko
usr/lib/modules/5.5.8-arch1-1/kernel/crc32c_generic.ko
usr/lib/modules/5.5.8-arch1-1/kernel/crc32c-intel.ko
usr/lib/modules/5.5.8-arch1-1/kernel/crc64.ko
usr/lib/modules/5.5.8-arch1-1/kernel/crc-itu-t.ko
usr/lib/modules/5.5.8-arch1-1/kernel/ehci-hcd.ko
usr/lib/modules/5.5.8-arch1-1/kernel/ehci-pci.ko
usr/lib/modules/5.5.8-arch1-1/kernel/ext4.ko
usr/lib/modules/5.5.8-arch1-1/kernel/firewire-core.ko
usr/lib/modules/5.5.8-arch1-1/kernel/firewire-sbp2.ko
usr/lib/modules/5.5.8-arch1-1/kernel/hid-generic.ko
usr/lib/modules/5.5.8-arch1-1/kernel/hid.ko
usr/lib/modules/5.5.8-arch1-1/kernel/hid-logitech-dj.ko
usr/lib/modules/5.5.8-arch1-1/kernel/hid-logitech-hidpp.ko
usr/lib/modules/5.5.8-arch1-1/kernel/hid-steam.ko
usr/lib/modules/5.5.8-arch1-1/kernel/jbd2.ko
usr/lib/modules/5.5.8-arch1-1/kernel/libahci.ko
usr/lib/modules/5.5.8-arch1-1/kernel/libata.ko
usr/lib/modules/5.5.8-arch1-1/kernel/mbcache.ko
usr/lib/modules/5.5.8-arch1-1/kernel/mmc_block.ko
usr/lib/modules/5.5.8-arch1-1/kernel/mmc_core.ko
usr/lib/modules/5.5.8-arch1-1/kernel/scsi_mod.ko
usr/lib/modules/5.5.8-arch1-1/kernel/sd_mod.ko
usr/lib/modules/5.5.8-arch1-1/kernel/sr_mod.ko
usr/lib/modules/5.5.8-arch1-1/kernel/usbhid.ko
usr/lib/modules/5.5.8-arch1-1/kernel/usb-storage.ko
usr/lib/modules/5.5.8-arch1-1/kernel/virtio_blk.ko
usr/lib/modules/5.5.8-arch1-1/kernel/xhci-hcd.ko
usr/lib/modules/5.5.8-arch1-1/kernel/xhci-pci.ko
usr/lib/modules/5.5.8-arch1-1/modules.alias.bin
usr/lib/modules/5.5.8-arch1-1/modules.builtin.alias.bin
usr/lib/modules/5.5.8-arch1-1/modules.builtin.bin
usr/lib/modules/5.5.8-arch1-1/modules.dep.bin
usr/lib/modules/5.5.8-arch1-1/modules.devname
usr/lib/modules/5.5.8-arch1-1/modules.softdep
usr/lib/modules/5.5.8-arch1-1/modules.symbols.bin
usr/lib/systemd/
usr/lib/systemd/libsystemd-shared-244.so
usr/lib/systemd/systemd-udevd
usr/lib/udev/
usr/lib/udev/ata_id
usr/lib/udev/bcache-register
usr/lib/udev/probe-bcache
usr/lib/udev/rules.d/
usr/lib/udev/rules.d/50-udev-default.rules
usr/lib/udev/rules.d/60-persistent-storage.rules
usr/lib/udev/rules.d/64-btrfs.rules
usr/lib/udev/rules.d/69-bcache.rules
usr/lib/udev/rules.d/80-drivers.rules
usr/lib/udev/scsi_id
usr/local/
usr/local/bin
usr/local/lib
usr/local/sbin
usr/sbin
var/
var/run
VERSION

$ lsinitcpio initramfs-linux-zen.img 
bin
buildconfig
config
dev/
etc/
etc/fstab
etc/initrd-release
etc/ld.so.cache
etc/ld.so.conf
etc/modprobe.d/
etc/modprobe.d/amdgpu.conf
etc/modprobe.d/blacklist.conf
etc/mtab
hooks/
hooks/udev
init
init_functions
lib
lib64
new_root/
proc/
run/
sbin
sys/
tmp/
usr/
usr/bin/
usr/bin/[
usr/bin/arch
usr/bin/ash
usr/bin/awk
usr/bin/base64
usr/bin/basename
usr/bin/bc
usr/bin/blkdiscard
usr/bin/blkid
usr/bin/busybox
usr/bin/bzip2
usr/bin/cat
usr/bin/chgrp
usr/bin/chmod
usr/bin/chown
usr/bin/chroot
usr/bin/clear
usr/bin/cp
usr/bin/cpio
usr/bin/cttyhack
usr/bin/cut
usr/bin/dd
usr/bin/depmod
usr/bin/df
usr/bin/dirname
usr/bin/dmesg
usr/bin/du
usr/bin/echo
usr/bin/env
usr/bin/expr
usr/bin/fallocate
usr/bin/false
usr/bin/fatattr
usr/bin/free
usr/bin/fsck
usr/bin/fsck.ext2
usr/bin/fsck.ext3
usr/bin/fsck.ext4
usr/bin/fsfreeze
usr/bin/fstrim
usr/bin/fsync
usr/bin/getopt
usr/bin/grep
usr/bin/gzip
usr/bin/halt
usr/bin/head
usr/bin/hexdump
usr/bin/hexedit
usr/bin/i2ctransfer
usr/bin/ifconfig
usr/bin/init
usr/bin/insmod
usr/bin/install
usr/bin/ip
usr/bin/ipaddr
usr/bin/iplink
usr/bin/ipneigh
usr/bin/iproute
usr/bin/iprule
usr/bin/iptunnel
usr/bin/kbd_mode
usr/bin/kill
usr/bin/killall
usr/bin/kmod
usr/bin/less
usr/bin/link
usr/bin/ln
usr/bin/loadfont
usr/bin/loadkmap
usr/bin/losetup
usr/bin/ls
usr/bin/lsmod
usr/bin/lsscsi
usr/bin/lzop
usr/bin/md5sum
usr/bin/mkdir
usr/bin/mkfifo
usr/bin/mknod
usr/bin/mkpasswd
usr/bin/mktemp
usr/bin/modinfo
usr/bin/modprobe
usr/bin/mount
usr/bin/mountpoint
usr/bin/mv
usr/bin/nc
usr/bin/netstat
usr/bin/nologin
usr/bin/nproc
usr/bin/nsenter
usr/bin/nslookup
usr/bin/nuke
usr/bin/openvt
usr/bin/partprobe
usr/bin/paste
usr/bin/pgrep
usr/bin/pidof
usr/bin/ping
usr/bin/ping6
usr/bin/poweroff
usr/bin/printf
usr/bin/ps
usr/bin/pwd
usr/bin/readlink
usr/bin/realpath
usr/bin/reboot
usr/bin/resume
usr/bin/rm
usr/bin/rmdir
usr/bin/rmmod
usr/bin/route
usr/bin/run-init
usr/bin/sed
usr/bin/seq
usr/bin/setfattr
usr/bin/setfont
usr/bin/sh
usr/bin/sha1sum
usr/bin/sha256sum
usr/bin/sha512sum
usr/bin/shuf
usr/bin/sleep
usr/bin/sort
usr/bin/stat
usr/bin/strings
usr/bin/switch_root
usr/bin/sync
usr/bin/systemd-tmpfiles
usr/bin/tac
usr/bin/tail
usr/bin/tar
usr/bin/tcpsvd
usr/bin/tee
usr/bin/telnet
usr/bin/test
usr/bin/tftp
usr/bin/touch
usr/bin/true
usr/bin/truncate
usr/bin/ts
usr/bin/udevadm
usr/bin/udhcpc
usr/bin/udhcpc6
usr/bin/umount
usr/bin/uname
usr/bin/uniq
usr/bin/unlink
usr/bin/unshare
usr/bin/unzip
usr/bin/uptime
usr/bin/vi
usr/bin/wc
usr/bin/wget
usr/bin/which
usr/bin/xxd
usr/bin/xz
usr/bin/yes
usr/lib/
usr/lib64
usr/lib/ld-linux-x86-64.so.2
usr/lib/libacl.so.1
usr/lib/libargon2.so.1
usr/lib/libattr.so.1
usr/lib/libblkid.so.1
usr/lib/libcap.so.2
usr/lib/libcom_err.so.2
usr/lib/libcrypto.so.1.1
usr/lib/libcryptsetup.so.12
usr/lib/libcrypt.so.1
usr/lib/libc.so.6
usr/lib/libdevmapper.so.1.02
usr/lib/libdl.so.2
usr/lib/libe2p.so.2
usr/lib/libext2fs.so.2
usr/lib/libgcrypt.so.20
usr/lib/libgpg-error.so.0
usr/lib/libidn2.so.0
usr/lib/libip4tc.so.2
usr/lib/libjson-c.so.4
usr/lib/libkmod.so.2
usr/lib/liblz4.so.1
usr/lib/liblzma.so.5
usr/lib/libmount.so.1
usr/lib/libm.so.6
usr/lib/libpthread.so.0
usr/lib/librt.so.1
usr/lib/libseccomp.so.2
usr/lib/libssl.so.1.1
usr/lib/libudev.so.1
usr/lib/libunistring.so.2
usr/lib/libuuid.so.1
usr/lib/libz.so.1
usr/lib/modprobe.d/
usr/lib/modprobe.d/bluetooth-usb.conf
usr/lib/modprobe.d/nvdimm-security.conf
usr/lib/modprobe.d/systemd.conf
usr/lib/modules/
usr/lib/modules/5.5.8-zen1-1-zen/
usr/lib/modules/5.5.8-zen1-1-zen/kernel/
usr/lib/modules/5.5.8-zen1-1-zen/kernel/ahci.ko
usr/lib/modules/5.5.8-zen1-1-zen/kernel/bcache.ko
usr/lib/modules/5.5.8-zen1-1-zen/kernel/cdrom.ko
usr/lib/modules/5.5.8-zen1-1-zen/kernel/crc16.ko
usr/lib/modules/5.5.8-zen1-1-zen/kernel/crc32c_generic.ko
usr/lib/modules/5.5.8-zen1-1-zen/kernel/crc32c-intel.ko
usr/lib/modules/5.5.8-zen1-1-zen/kernel/crc64.ko
usr/lib/modules/5.5.8-zen1-1-zen/kernel/crc-itu-t.ko
usr/lib/modules/5.5.8-zen1-1-zen/kernel/ehci-hcd.ko
usr/lib/modules/5.5.8-zen1-1-zen/kernel/ehci-pci.ko
usr/lib/modules/5.5.8-zen1-1-zen/kernel/ext4.ko
usr/lib/modules/5.5.8-zen1-1-zen/kernel/firewire-core.ko
usr/lib/modules/5.5.8-zen1-1-zen/kernel/firewire-sbp2.ko
usr/lib/modules/5.5.8-zen1-1-zen/kernel/hid-generic.ko
usr/lib/modules/5.5.8-zen1-1-zen/kernel/hid.ko
usr/lib/modules/5.5.8-zen1-1-zen/kernel/hid-logitech-dj.ko
usr/lib/modules/5.5.8-zen1-1-zen/kernel/hid-logitech-hidpp.ko
usr/lib/modules/5.5.8-zen1-1-zen/kernel/hid-steam.ko
usr/lib/modules/5.5.8-zen1-1-zen/kernel/jbd2.ko
usr/lib/modules/5.5.8-zen1-1-zen/kernel/libahci.ko
usr/lib/modules/5.5.8-zen1-1-zen/kernel/libata.ko
usr/lib/modules/5.5.8-zen1-1-zen/kernel/mbcache.ko
usr/lib/modules/5.5.8-zen1-1-zen/kernel/mmc_block.ko
usr/lib/modules/5.5.8-zen1-1-zen/kernel/mmc_core.ko
usr/lib/modules/5.5.8-zen1-1-zen/kernel/scsi_mod.ko
usr/lib/modules/5.5.8-zen1-1-zen/kernel/sd_mod.ko
usr/lib/modules/5.5.8-zen1-1-zen/kernel/sr_mod.ko
usr/lib/modules/5.5.8-zen1-1-zen/kernel/usbhid.ko
usr/lib/modules/5.5.8-zen1-1-zen/kernel/usb-storage.ko
usr/lib/modules/5.5.8-zen1-1-zen/kernel/virtio_blk.ko
usr/lib/modules/5.5.8-zen1-1-zen/kernel/xhci-hcd.ko
usr/lib/modules/5.5.8-zen1-1-zen/kernel/xhci-pci.ko
usr/lib/modules/5.5.8-zen1-1-zen/modules.alias.bin
usr/lib/modules/5.5.8-zen1-1-zen/modules.builtin.alias.bin
usr/lib/modules/5.5.8-zen1-1-zen/modules.builtin.bin
usr/lib/modules/5.5.8-zen1-1-zen/modules.dep.bin
usr/lib/modules/5.5.8-zen1-1-zen/modules.devname
usr/lib/modules/5.5.8-zen1-1-zen/modules.softdep
usr/lib/modules/5.5.8-zen1-1-zen/modules.symbols.bin
usr/lib/systemd/
usr/lib/systemd/libsystemd-shared-244.so
usr/lib/systemd/systemd-udevd
usr/lib/udev/
usr/lib/udev/ata_id
usr/lib/udev/bcache-register
usr/lib/udev/probe-bcache
usr/lib/udev/rules.d/
usr/lib/udev/rules.d/50-udev-default.rules
usr/lib/udev/rules.d/60-persistent-storage.rules
usr/lib/udev/rules.d/64-btrfs.rules
usr/lib/udev/rules.d/69-bcache.rules
usr/lib/udev/rules.d/80-drivers.rules
usr/lib/udev/scsi_id
usr/local/
usr/local/bin
usr/local/lib
usr/local/sbin
usr/sbin
var/
var/run
VERSION

I suspect something more fundamental is broken with linux-zen and it's handling of the initramfs since there is neither any input possible via my USB keyboards.

Only thing I could think of was examining pacman.log (nothing weird there) and reinstalling linux-zen (in case something failed for whatever reason). Re-installing linux-zen (unsurprisingly) had no effect on the issue.

Any thoughts / ideas? I could make a bug report but I'd like to know what to actually report, and if there are others users with similar issues.

Cheers!

Last edited by Wild Penguin (2020-03-08 10:54:27)

Scimmia · 2020-03-08 00:30:01

That means that your kernel doesn't match your initramfs. Check your bootloader config, make sure you're loading what you think you are.

Wild Penguin · 2020-03-08 00:35:33

Scimmia wrote:

That means that your kernel doesn't match your initramfs. Check your bootloader config, make sure you're loading what you think you are.

AFAICT I'm loading what I'm supposed to be loading:

$ file vmlinuz-linux-zen 
vmlinuz-linux-zen: Linux kernel x86 boot executable bzImage, version 5.5.8-zen1-1-zen (linux-zen@archlinux) #1 ZEN SMP PREEMPT Fri, 06 Mar 2020 00:57:35 +0000, RO-rootFS, swap_dev 0x6, Normal VGA

Initramfs has been listed above, and match zen version.

$ cat /boot/refind_linux.conf
"Boot with standard options"  "root=UUID=37bd1c8a-9bc2-4842-98b7-4da58168da16 acpi_enforce_resources=lax rw resume=UUID=d5861932-0216-435a-ac8c-96ad282eae0e amdgpu.ppfeaturemask=0xfffd7fff amdgpu.dc=1 quiet"
"Boot to single-user mode"    "root=UUID=37bd1c8a-9bc2-4842-98b7-4da58168da16 acpi_enforce_resources=lax rw resume=UUID=d5861932-0216-435a-ac8c-96ad282eae0e amdgpu.ppfeaturemask=0xfffd7fff amdgpu.dc=1 quiet single"
"Boot with minimal options"   "ro root=/dev/bcache2"

Grub config hasn't been touched, and it refers to the kernel image and initramfs (and fallback initramfs if booted with that option), which do not change at upgrades. However, for good measure:

$ cat grub.cfg
#
# DO NOT EDIT THIS FILE
#
# It is automatically generated by grub-mkconfig using templates
# from /etc/grub.d and settings from /etc/default/grub
#

### BEGIN /etc/grub.d/00_header ###
insmod part_gpt
insmod part_msdos
if [ -s $prefix/grubenv ]; then
  load_env
fi
if [ "${next_entry}" ] ; then
   set default="${next_entry}"
   set next_entry=
   save_env next_entry
   set boot_once=true
else
   set default="0"
fi

if [ x"${feature_menuentry_id}" = xy ]; then
  menuentry_id_option="--id"
else
  menuentry_id_option=""
fi

export menuentry_id_option

if [ "${prev_saved_entry}" ]; then
  set saved_entry="${prev_saved_entry}"
  save_env saved_entry
  set prev_saved_entry=
  save_env prev_saved_entry
  set boot_once=true
fi

function savedefault {
  if [ -z "${boot_once}" ]; then
    saved_entry="${chosen}"
    save_env saved_entry
  fi
}

function load_video {
  if [ x$feature_all_video_module = xy ]; then
    insmod all_video
  else
    insmod efi_gop
    insmod efi_uga
    insmod ieee1275_fb
    insmod vbe
    insmod vga
    insmod video_bochs
    insmod video_cirrus
  fi
}

if [ x$feature_default_font_path = xy ] ; then
   font=unicode
else
insmod ext2
if [ x$feature_platform_search_hint = xy ]; then
  search --no-floppy --fs-uuid --set=root  37bd1c8a-9bc2-4842-98b7-4da58168da16
else
  search --no-floppy --fs-uuid --set=root 37bd1c8a-9bc2-4842-98b7-4da58168da16
fi
    font="/usr/share/grub/unicode.pf2"
fi

if loadfont $font ; then
  set gfxmode=auto
  load_video
  insmod gfxterm
  set locale_dir=$prefix/locale
  set lang=fi_FI
  insmod gettext
fi
terminal_input console
terminal_output gfxterm
if [ x$feature_timeout_style = xy ] ; then
  set timeout_style=menu
  set timeout=5
# Fallback normal timeout code in case the timeout_style feature is
# unavailable.
else
  set timeout=5
fi
### END /etc/grub.d/00_header ###

### BEGIN /etc/grub.d/10_linux ###
menuentry 'Arch Linux' --class arch --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-simple-37bd1c8a-9bc2-4842-98b7-4da58168da16' {
        load_video
        set gfxpayload=keep
        insmod gzio
        insmod part_gpt
        insmod fat
        set root='hd2,gpt1'
        if [ x$feature_platform_search_hint = xy ]; then
          search --no-floppy --fs-uuid --set=root --hint-ieee1275='ieee1275//disk@0,gpt1' --hint-bios=hd2,gpt1 --hint-efi=hd2,gpt1 --hint-baremetal=ahci2,gpt1  19C9-466F
        else
          search --no-floppy --fs-uuid --set=root 19C9-466F
        fi
        echo    'Loading Linux linux-zen ...'
        linux   /vmlinuz-linux-zen root=UUID=37bd1c8a-9bc2-4842-98b7-4da58168da16 rw  acpi_enforce_resources=lax resume=UUID=d5861932-0216-435a-ac8c-96ad282eae0e amdgpu.ppfeaturemask=0xfffd7fff amdgpu.dc=1 quiet
        echo    'Loading initial ramdisk ...'
        initrd  /intel-ucode.img /initramfs-linux-zen.img
}
submenu 'Advanced options for Arch Linux' $menuentry_id_option 'gnulinux-advanced-37bd1c8a-9bc2-4842-98b7-4da58168da16' {
        menuentry 'Arch Linux, with Linux linux-zen' --class arch --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-linux-zen-advanced-37bd1c8a-9bc2-4842-98b7-4da58168da16' {
                load_video
                set gfxpayload=keep
                insmod gzio
                insmod part_gpt
                insmod fat
                set root='hd2,gpt1'
                if [ x$feature_platform_search_hint = xy ]; then
                  search --no-floppy --fs-uuid --set=root --hint-ieee1275='ieee1275//disk@0,gpt1' --hint-bios=hd2,gpt1 --hint-efi=hd2,gpt1 --hint-baremetal=ahci2,gpt1  19C9-466F
                else
                  search --no-floppy --fs-uuid --set=root 19C9-466F
                fi
                echo    'Loading Linux linux-zen ...'
                linux   /vmlinuz-linux-zen root=UUID=37bd1c8a-9bc2-4842-98b7-4da58168da16 rw  acpi_enforce_resources=lax resume=UUID=d5861932-0216-435a-ac8c-96ad282eae0e amdgpu.ppfeaturemask=0xfffd7fff amdgpu.dc=1 quiet
                echo    'Loading initial ramdisk ...'
                initrd  /intel-ucode.img /initramfs-linux-zen.img
        }
        menuentry 'Arch Linux, with Linux linux-zen (fallback initramfs)' --class arch --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-linux-zen-fallback-37bd1c8a-9bc2-4842-98b7-4da58168da16' {
                load_video
                set gfxpayload=keep
                insmod gzio
                insmod part_gpt
                insmod fat
                set root='hd2,gpt1'
                if [ x$feature_platform_search_hint = xy ]; then
                  search --no-floppy --fs-uuid --set=root --hint-ieee1275='ieee1275//disk@0,gpt1' --hint-bios=hd2,gpt1 --hint-efi=hd2,gpt1 --hint-baremetal=ahci2,gpt1  19C9-466F
                else
                  search --no-floppy --fs-uuid --set=root 19C9-466F
                fi
                echo    'Loading Linux linux-zen ...'
                linux   /vmlinuz-linux-zen root=UUID=37bd1c8a-9bc2-4842-98b7-4da58168da16 rw  acpi_enforce_resources=lax resume=UUID=d5861932-0216-435a-ac8c-96ad282eae0e amdgpu.ppfeaturemask=0xfffd7fff amdgpu.dc=1 quiet
                echo    'Loading initial ramdisk ...'
                initrd  /initramfs-linux-zen-fallback.img
        }
        menuentry 'Arch Linux, with Linux linux' --class arch --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-linux-advanced-37bd1c8a-9bc2-4842-98b7-4da58168da16' {
                load_video
                set gfxpayload=keep
                insmod gzio
                insmod part_gpt
                insmod fat
                set root='hd2,gpt1'
                if [ x$feature_platform_search_hint = xy ]; then
                  search --no-floppy --fs-uuid --set=root --hint-ieee1275='ieee1275//disk@0,gpt1' --hint-bios=hd2,gpt1 --hint-efi=hd2,gpt1 --hint-baremetal=ahci2,gpt1  19C9-466F
                else
                  search --no-floppy --fs-uuid --set=root 19C9-466F
                fi
                echo    'Loading Linux linux ...'
                linux   /vmlinuz-linux root=UUID=37bd1c8a-9bc2-4842-98b7-4da58168da16 rw  acpi_enforce_resources=lax resume=UUID=d5861932-0216-435a-ac8c-96ad282eae0e amdgpu.ppfeaturemask=0xfffd7fff amdgpu.dc=1 quiet
                echo    'Loading initial ramdisk ...'
                initrd  /intel-ucode.img /initramfs-linux.img
        }
        menuentry 'Arch Linux, with Linux linux (fallback initramfs)' --class arch --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-linux-fallback-37bd1c8a-9bc2-4842-98b7-4da58168da16' {
                load_video
                set gfxpayload=keep
                insmod gzio
                insmod part_gpt
                insmod fat
                set root='hd2,gpt1'
                if [ x$feature_platform_search_hint = xy ]; then
                  search --no-floppy --fs-uuid --set=root --hint-ieee1275='ieee1275//disk@0,gpt1' --hint-bios=hd2,gpt1 --hint-efi=hd2,gpt1 --hint-baremetal=ahci2,gpt1  19C9-466F
                else
                  search --no-floppy --fs-uuid --set=root 19C9-466F
                fi
                echo    'Loading Linux linux ...'
                linux   /vmlinuz-linux root=UUID=37bd1c8a-9bc2-4842-98b7-4da58168da16 rw  acpi_enforce_resources=lax resume=UUID=d5861932-0216-435a-ac8c-96ad282eae0e amdgpu.ppfeaturemask=0xfffd7fff amdgpu.dc=1 quiet
                echo    'Loading initial ramdisk ...'
                initrd  /initramfs-linux-fallback.img
        }
}

### END /etc/grub.d/10_linux ###

### BEGIN /etc/grub.d/20_linux_xen ###
### END /etc/grub.d/20_linux_xen ###

### BEGIN /etc/grub.d/30_os-prober ###
### END /etc/grub.d/30_os-prober ###

### BEGIN /etc/grub.d/40_custom ###
# This file provides an easy way to add custom menu entries.  Simply type the
# menu entries you want to add after this comment.  Be careful not to change
# the 'exec tail' line above.
### END /etc/grub.d/40_custom ###

### BEGIN /etc/grub.d/41_custom ###
if [ -f  ${config_directory}/custom.cfg ]; then
  source ${config_directory}/custom.cfg
elif [ -z "${config_directory}" -a -f  $prefix/custom.cfg ]; then
  source $prefix/custom.cfg;
fi

Any other ideas, what I could check?

Any idea, why zen would break while regular Kernel does not (both wwere upgraded today at the same 'pacman -Suy'; AFAIK the only difference is the name of the Kernel image in /boot, initramfs and initramfs-fallback file names; the same configuration for mkinitcipo, grub and refind is used for both).

Also, broken input seems a quite severe issue. I've been dropped to emergency shell on this computer before (forgot to update UUID of root or similar), but input usually works.

Last edited by Wild Penguin (2020-03-08 00:39:27)

Scimmia · 2020-03-08 00:47:39

If the kernel has no modules at all (which is indicated by the warning), no input isn't uncommon. The initramfs you listed shows the modules.devname that is missing when you boot, so the logical conclusion is that that's not the initramfs that you're loading.

If input worked (do you have another keyboard, maybe?), I would say to go to /lib/modules/ and see what's there.

Last edited by Scimmia (2020-03-08 00:49:09)

Wild Penguin · 2020-03-08 01:10:50

Scimmia: Good to know (about the input).

I'm at a bit of a loss here, where could it be looking for the initramfs. I still got here two kernels which have identical configuration otherwise for their bootloading / initramfs, which worked until the upgrade.

Well, time to call it a day, maybe I will spot something tomorrow (I can of course try a downgrade of Linux-zen; if the old one works but new one doesn't, repeatedly, with exactly same configuration, then something is wrong in the package, for sure?)

Last edited by Wild Penguin (2020-03-08 01:11:06)

loqs · 2020-03-08 01:32:12

Edit the boot entry for refind F2 for grub e check the initrd is listed as initramfs-linux-zen.img
If the bootloader entry is correct then boot linux check the root directory of every filesystem for initramfs-linux-zen.img

Wild Penguin · 2020-03-08 10:55:20

Ok, problem solved. The problem was in Refind configuration.

First: I only though I had booted from Grub, seems like I hadn't. Linux-zen booted just fine from grub. This wrong assumption caused me to look into wrong direction for the problem.

Then I remembered I had been playing around with refind configuration. I had updated a very old /boot/EFI/refind/refind.conf with the new default and didn't do a diff, but put in all the changes I thought I had done previously by hand. Seems I forgot something! The problems was here (comments in the config also give away the explanation):

# Comma-delimited list of strings to treat as if they were numbers for the
# purpose of kernel version number detection. These strings are matched on a
# first-found basis; that is, if you want to treat both "linux-lts" and
# "linux" as version strings, they MUST be specified as "linux-lts,linux",
# since if you specify it the other way, both vmlinuz-linux and
# vmlinuz-linux-lts will return with "linux" as the "version string," which
# is not what you'd want. Also, if the kernel or initrd file includes both a
# specified string and digits, the "version string" includes both. For
# instance, "vmlinuz-linux-4.8" would yield a version string of "linux-4.8".
# This option is intended for Arch and other distributions that don't include
# version numbers in their kernel filenames, but may provide other uniquely
# identifying strings for multiple kernels. If this feature causes problems
# (say, if your kernel filename includes "linux" but the initrd filename
# doesn't), be sure this is set to an empty string
# (extra_kernel_version_strings "") or comment out the option to disable it.
# Default is no extra version strings
#
extra_kernel_version_strings linux-zen,linux-lts,linux

extra_kernel_version_strings was commented:

# extra_kernel_version_strings linux-lts,linux

And as such, while ReFind does find the linux-zen Kernel, it thinks is another "linux", and presumably tries to load "initramfs-linux.img". At least that would make sense according to that comment and the symptoms!

(need to study ReFind; maybe there is a verbose mode somewhere to help spot such errors in the future)

Marking as [SOLVED]!

Thanks, all. I was getting a bit paranoid, in the end it was a stupid error on my part (well, easy to forget these since usually one just sets the bootloader once and forgets...)

EDIT: This is also quite well explained in the wiki, once one knows to look for the right problem...
EDIT And indeed, loqs's suggestion would have worked to check the constructed command line to see which initramfs it is passing to kernel...

Last edited by Wild Penguin (2020-03-08 13:44:28)

Arch Linux

#1 2020-03-08 00:18:58

[SOLVED] linux-zen broke: can not mount boot and not input possible

#2 2020-03-08 00:30:01

Re: [SOLVED] linux-zen broke: can not mount boot and not input possible

#3 2020-03-08 00:35:33

Re: [SOLVED] linux-zen broke: can not mount boot and not input possible

#4 2020-03-08 00:47:39

Re: [SOLVED] linux-zen broke: can not mount boot and not input possible

#5 2020-03-08 01:10:50

Re: [SOLVED] linux-zen broke: can not mount boot and not input possible

#6 2020-03-08 01:32:12

Re: [SOLVED] linux-zen broke: can not mount boot and not input possible

#7 2020-03-08 10:55:20

Re: [SOLVED] linux-zen broke: can not mount boot and not input possible

Board footer