You are not logged in.

#1 2026-03-13 21:27:35

Perdu
Member
Registered: 2020-07-30
Posts: 6

Can no longer boot on OVH VPS sinc systemd259: Loading initial ramdisk

Hello,

I have a VPS at OVH and cannot update it since system 259 was released a few month ago. Boot hangs after grub on "Loading initial ramdisk", providing no indication at what's failing.

I have tried a lot of options and none of them have managed to solve the issue:
- reinstalling kernel, rebuilding mkinitcpio and grub
- installing LTS kernel
- trying to boot on fallback image
- adding virtio to modules in mkinitcpio.conf
- removing microcode from hooks in mkinitcpio.conf (not sure why I had it since I had no *-ucode package installed)
- adding debug instructions to grub command line (still doesn't output anything more)

I'm a bit clueless about what to try now. I can't try reinstalling from scratch, because OVH no longer provide custom images on their VPSes, and I don't want to move to a dedicated server that's 3 times more expensive.

Reverting to working versions in rescue mode worked in November, but I'm not sure it's still possible now (and not a long-time viable option anyway).

Version that worked:
- systemd-258.1-1
- linux-6.17.5

Version that no longer works:
- systemd-259.4-1
- linux-6.19.6.arch1-1
(earlier version already failed, I've had the problem since November)

/etc/mkinitcpio.conf:

MODULES=(virtio virtio_blk virtio_pci virtio_scsi)
BINARIES=()
FILES=()
HOOKS=(base systemd autodetect modconf kms keyboard keymap sd-vconsole block filesystems fsck)

/etc/default/grub:

GRUB_DEFAULT=0
GRUB_TIMEOUT=5
GRUB_DISTRIBUTOR="Arch"
GRUB_CMDLINE_LINUX_DEFAULT="loglevel=7 debug earlyprintk=ttyS0,115200 console=ttyS0,115200 initcall_debug systemd.unified_cgroup_hierarchy=0 break=mount"
GRUB_CMDLINE_LINUX="console=ttyS0 "

# Preload both GPT and MBR modules so that they are not missed
GRUB_PRELOAD_MODULES="part_gpt part_msdos"

# Uncomment to enable booting from LUKS encrypted devices
#GRUB_ENABLE_CRYPTODISK=y

# Set to 'countdown' or 'hidden' to change timeout behavior,
# press ESC key to display menu.
GRUB_TIMEOUT_STYLE=menu

# Uncomment to use basic console
GRUB_TERMINAL_INPUT=console

# Uncomment to disable graphical terminal
#GRUB_TERMINAL_OUTPUT=console

# The resolution used on graphical terminal
# note that you can use only modes which your graphic card supports via VBE
# you can see them in real GRUB with the command `vbeinfo'
GRUB_GFXMODE=auto

# Uncomment to allow the kernel use the same resolution used by grub
GRUB_GFXPAYLOAD_LINUX=keep

# Uncomment if you want GRUB to pass to the Linux kernel the old parameter
# format "root=/dev/xxx" instead of "root=/dev/disk/by-uuid/xxx"
#GRUB_DISABLE_LINUX_UUID=true

# Uncomment to disable generation of recovery mode menu entries
GRUB_DISABLE_RECOVERY=true

# Uncomment and set to the desired menu colors.  Used by normal and wallpaper
# modes only.  Entries specified as foreground/background.
#GRUB_COLOR_NORMAL="light-blue/black"
#GRUB_COLOR_HIGHLIGHT="light-cyan/blue"

# Uncomment one of them for the gfx desired, a image background or a gfxtheme
#GRUB_BACKGROUND="/path/to/wallpaper"
#GRUB_THEME="/path/to/gfxtheme"

# Uncomment to get a beep at GRUB start
#GRUB_INIT_TUNE="480 440 1"

# Uncomment to make GRUB remember the last selection. This requires
# setting 'GRUB_DEFAULT=saved' above.
#GRUB_SAVEDEFAULT="true"

/etc/fstab:

LABEL=rootfs           	/         	ext4      	rw,relatime	0 1

/boot/grub/grub.cfg:

### BEGIN /etc/grub.d/00_header ###
insmod part_gpt
insmod part_msdos
if [ -s $prefix/grubenv ]; then
  load_env
fi

if [ "${env_block}" ] ; then
  set env_block="(${root})${env_block}"
  export env_block
  load_env -f "${env_block}"
fi

if [ "${next_entry}" ] ; then
   set default="${next_entry}"
   set next_entry=
   if [ "${env_block}" ] ; then
     save_env -f "${env_block}" next_entry
   else
     save_env next_entry
   fi
   set boot_once=true
else
   set default="0"
fi

if [ x"${feature_menuentry_id}" = xy ]; then
  menuentry_id_option="--id"
else
  menuentry_id_option=""
fi

export menuentry_id_option

if [ "${prev_saved_entry}" ]; then
  set saved_entry="${prev_saved_entry}"
  save_env saved_entry
  set prev_saved_entry=
  save_env prev_saved_entry
  set boot_once=true
fi

function savedefault {
  if [ -z "${boot_once}" ]; then
    saved_entry="${chosen}"
    if [ "${env_block}" ] ; then
      save_env -f "${env_block}" saved_entry
    else
      save_env saved_entry
    fi

  fi
}

function load_video {
  if [ x$grub_platform = xefi ]; then
    insmod efi_gop
    insmod efi_uga
  elif [ x$feature_all_video_module = xy ]; then
    insmod all_video
  else
    insmod efi_gop
    insmod efi_uga
    insmod ieee1275_fb
    insmod vbe
    insmod vga
    insmod video_bochs
    insmod video_cirrus
  fi
}

if [ x$feature_default_font_path = xy ] ; then
   font=unicode
else
insmod part_msdos
insmod ext2
set root='hd1,msdos1'
if [ x$feature_platform_search_hint = xy ]; then
  search --no-floppy --fs-uuid --set=root --hint-bios=hd1,msdos1 --hint-efi=hd1,msdos1 --hint-baremetal=ahci1,msdos1  6ba6ed91-6eb9-4125-a33a-85c55db5edd5
else
  search --no-floppy --fs-uuid --set=root 6ba6ed91-6eb9-4125-a33a-85c55db5edd5
fi
    font="/usr/share/grub/unicode.pf2"
fi

if loadfont $font ; then
  set gfxmode=auto
  load_video
  insmod gfxterm
  set locale_dir=$prefix/locale
  set lang=en_US
  insmod gettext
fi
terminal_input console
terminal_output gfxterm
if [ x$feature_timeout_style = xy ] ; then
  set timeout_style=menu
  set timeout=5
# Fallback normal timeout code in case the timeout_style feature is
# unavailable.
else
  set timeout=5
fi
### END /etc/grub.d/00_header ###

### BEGIN /etc/grub.d/10_linux ###
menuentry 'Arch Linux' --class arch --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-simple-6ba6ed91-6eb9-4125-a33a-85c55db5edd5' {
	load_video
	set gfxpayload=keep
	insmod gzio
	insmod part_msdos
	insmod ext2
	set root='hd1,msdos1'
	if [ x$feature_platform_search_hint = xy ]; then
	  search --no-floppy --fs-uuid --set=root --hint-bios=hd1,msdos1 --hint-efi=hd1,msdos1 --hint-baremetal=ahci1,msdos1  6ba6ed91-6eb9-4125-a33a-85c55db5edd5
	else
	  search --no-floppy --fs-uuid --set=root 6ba6ed91-6eb9-4125-a33a-85c55db5edd5
	fi
	echo	'Loading Linux linux-lts ...'
	linux	/boot/vmlinuz-linux-lts root=UUID=6ba6ed91-6eb9-4125-a33a-85c55db5edd5 rw console=ttyS0  loglevel=7 debug earlyprintk=ttyS0,115200 console=ttyS0,115200 initcall_debug systemd.unified_cgroup_hierarchy=0 break=mount
	echo	'Loading initial ramdisk ...'
	initrd	/boot/initramfs-linux-lts.img
}
submenu 'Advanced options for Arch Linux' $menuentry_id_option 'gnulinux-advanced-6ba6ed91-6eb9-4125-a33a-85c55db5edd5' {
	menuentry 'Arch Linux, with Linux linux-lts' --class arch --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-linux-lts-advanced-6ba6ed91-6eb9-4125-a33a-85c55db5edd5' {
		load_video
		set gfxpayload=keep
		insmod gzio
		insmod part_msdos
		insmod ext2
		set root='hd1,msdos1'
		if [ x$feature_platform_search_hint = xy ]; then
		  search --no-floppy --fs-uuid --set=root --hint-bios=hd1,msdos1 --hint-efi=hd1,msdos1 --hint-baremetal=ahci1,msdos1  6ba6ed91-6eb9-4125-a33a-85c55db5edd5
		else
		  search --no-floppy --fs-uuid --set=root 6ba6ed91-6eb9-4125-a33a-85c55db5edd5
		fi
		echo	'Loading Linux linux-lts ...'
		linux	/boot/vmlinuz-linux-lts root=UUID=6ba6ed91-6eb9-4125-a33a-85c55db5edd5 rw console=ttyS0  loglevel=7 debug earlyprintk=ttyS0,115200 console=ttyS0,115200 initcall_debug systemd.unified_cgroup_hierarchy=0 break=mount
		echo	'Loading initial ramdisk ...'
		initrd	/boot/initramfs-linux-lts.img
	}
	menuentry 'Arch Linux, with Linux linux' --class arch --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-linux-advanced-6ba6ed91-6eb9-4125-a33a-85c55db5edd5' {
		load_video
		set gfxpayload=keep
		insmod gzio
		insmod part_msdos
		insmod ext2
		set root='hd1,msdos1'
		if [ x$feature_platform_search_hint = xy ]; then
		  search --no-floppy --fs-uuid --set=root --hint-bios=hd1,msdos1 --hint-efi=hd1,msdos1 --hint-baremetal=ahci1,msdos1  6ba6ed91-6eb9-4125-a33a-85c55db5edd5
		else
		  search --no-floppy --fs-uuid --set=root 6ba6ed91-6eb9-4125-a33a-85c55db5edd5
		fi
		echo	'Loading Linux linux ...'
		linux	/boot/vmlinuz-linux root=UUID=6ba6ed91-6eb9-4125-a33a-85c55db5edd5 rw console=ttyS0  loglevel=7 debug earlyprintk=ttyS0,115200 console=ttyS0,115200 initcall_debug systemd.unified_cgroup_hierarchy=0 break=mount
		echo	'Loading initial ramdisk ...'
		initrd	/boot/initramfs-linux.img
	}
	menuentry 'Arch Linux, with Linux linux (fallback initramfs)' --class arch --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-linux-fallback-6ba6ed91-6eb9-4125-a33a-85c55db5edd5' {
		load_video
		set gfxpayload=keep
		insmod gzio
		insmod part_msdos
		insmod ext2
		set root='hd1,msdos1'
		if [ x$feature_platform_search_hint = xy ]; then
		  search --no-floppy --fs-uuid --set=root --hint-bios=hd1,msdos1 --hint-efi=hd1,msdos1 --hint-baremetal=ahci1,msdos1  6ba6ed91-6eb9-4125-a33a-85c55db5edd5
		else
		  search --no-floppy --fs-uuid --set=root 6ba6ed91-6eb9-4125-a33a-85c55db5edd5
		fi
		echo	'Loading Linux linux ...'
		linux	/boot/vmlinuz-linux root=UUID=6ba6ed91-6eb9-4125-a33a-85c55db5edd5 rw console=ttyS0  loglevel=7 debug earlyprintk=ttyS0,115200 console=ttyS0,115200 initcall_debug systemd.unified_cgroup_hierarchy=0 break=mount
		echo	'Loading initial ramdisk ...'
		initrd	/boot/initramfs-linux-fallback.img
	}
}

### END /etc/grub.d/10_linux ###

### BEGIN /etc/grub.d/20_linux_xen ###
### END /etc/grub.d/20_linux_xen ###

### BEGIN /etc/grub.d/25_bli ###
if [ "$grub_platform" = "efi" ]; then
  insmod bli
fi
### END /etc/grub.d/25_bli ###

### BEGIN /etc/grub.d/30_os-prober ###
### END /etc/grub.d/30_os-prober ###

### BEGIN /etc/grub.d/30_uefi-firmware ###
if [ "$grub_platform" = "efi" ]; then
	fwsetup --is-supported
	if [ "$?" = 0 ]; then
		menuentry 'UEFI Firmware Settings' $menuentry_id_option 'uefi-firmware' {
			fwsetup
		}
	fi
fi
### END /etc/grub.d/30_uefi-firmware ###

### BEGIN /etc/grub.d/40_custom ###
# This file provides an easy way to add custom menu entries.  Simply type the
# menu entries you want to add after this comment.  Be careful not to change
# the 'exec tail' line above.
### END /etc/grub.d/40_custom ###

### BEGIN /etc/grub.d/41_custom ###
if [ -f  ${config_directory}/custom.cfg ]; then
  source ${config_directory}/custom.cfg
elif [ -z "${config_directory}" -a -f  $prefix/custom.cfg ]; then
  source $prefix/custom.cfg
fi
### END /etc/grub.d/41_custom ###

Offline

#2 2026-03-14 00:39:30

cryptearth
Member
Registered: 2024-02-03
Posts: 2,037

Re: Can no longer boot on OVH VPS sinc systemd259: Loading initial ramdisk

I'm a ovh customer, too - but a have a physical root instead of a vps - so I'm not familiar with the differences and tools you may have available
you have serial output specified - can you access it via the customer panel? do you have access to kvm?
the actual output would be interesting
can you boot the debian emergency system? don't know if this is even a thing on VPS or if that's only for dedicated machines
have you tried to contact ovh support, yet?

Offline

#3 2026-03-14 09:13:36

Perdu
Member
Registered: 2020-07-30
Posts: 6

Re: Can no longer boot on OVH VPS sinc systemd259: Loading initial ramdisk

cryptearth wrote:

you have serial output specified - can you access it via the customer panel? do you have access to kvm?

Yes, I have access to kvm and can restart the VPS in rescue mode (which allows me to chroot into the file system), which is how I performed the tests I mentioned

the actual output would be interesting

It is really just 3 lines:
Booting `Arch Linux`
Loading Linux linux-lts ...
Loading initial ramdisk ...

have you tried to contact ovh support, yet?

No, I assumed they would tell me they no longer support custom images on VPS. But I'm going to try anyway

Last edited by Perdu (2026-03-14 09:13:56)

Offline

#4 2026-03-16 10:27:09

Perdu
Member
Registered: 2020-07-30
Posts: 6

Re: Can no longer boot on OVH VPS sinc systemd259: Loading initial ramdisk

Well, it turns out the move to systemd-based init breaks for some reason and reverting to the classical init in mkinitcpio.conf makes it work (+ mkinitcpio -P && grub-mkconfig -o /boot/grub/grub.cfg)

# pre-update
HOOKS=(base udev autodetect microcode modconf kms keyboard keymap consolefont block filesystems fsck)
# update
# HOOKS=(base systemd autodetect microcode modconf kms keyboard keymap sd-vconsole block filesystems fsck)

Last edited by Perdu (2026-03-16 10:27:25)

Offline

#5 2026-03-16 12:09:32

cryptearth
Member
Registered: 2024-02-03
Posts: 2,037

Re: Can no longer boot on OVH VPS sinc systemd259: Loading initial ramdisk

so this looks like could be a systemd incompatibility
unfortunate i don't know how to further debug this more in-depth

Offline

Board footer

Powered by FluxBB