You are not logged in.

#1 2015-02-26 23:52:12

myles
Member
Registered: 2011-10-06
Posts: 40

[SOLVED] boot stuck at "Welcome to Arch Linux!"

After "Welcome to Arch Linux!" the system is unresponsive whereas I expected
to get a login prompt on a virtual console.  This is an existing install,
on fairly recent hardware, set up as a fileserver (with NFS) that has
previously been well behaved. Kernel 3.18.6.

LUKS btrfs / is on a USB stick
     ext2  /boot is on the USB stick
LUKS btrfs /home is on a hard drive

The tale of woe: while manipulating something unrelated to the core system via
ansible from another host, I lost the ssh connection and had to hard reboot.
I may have changed something else that was important and forgotten about it
and boot now stops at "Welcome to Arch Linux!" with no ttys accessible.  The last
journalctl entry is:

systemd-logind[406]: Failed to abandon session scope: Connection timed out

Using the Live CD on a USB stick I began fiddling with things incrementally,
ending up using systemd in initrd for early boot process, and updating fully with
pacman -Syu but still it stops at the same place.

HOOKS in mkinitcpio.conf:

HOOKS="systemd block sd-encrypt autodetect modconf filesystems keyboard sd-vconsole"

Using this grub kernel command line:

 linux /vmlinuz-linux root=UUID=33d5ff7b-bla-blahbb8e13f898rw rootflags=subvol=rootvol
rd.luks.uuid=9181c004-blah-blah-e834f53da539 verbose

I put screenshots here http://imgur.com/a/55HHF The first 4 show booting with
the above kernel command line, the remaining photos show when "debug" is
appended.

There are at least two suspicious things:

1)

  [ 36.661066] systemd-journald[65]: Received SIGTERM from PID 1 (systemd)
  [ 36.662115] systemd-journald[65]: systemd-journald stopped as pid 65 

  but later it says:

[ 37.568286 ] systemd-journald.service changed dead -> active

  however nothing has been written when I chroot using arch-chroot and do journalctl.

2)

[37.465557] systemd[1]: Failed to load configuration for
  systemd-cryptesetup@luks\x2d918..blah,blah..da539.service: No such file or directory

  That is the root crypto_LUKS partition.  But then a few lines later there is
   this:

[37.540503] systemd[1]: sysroot.mount changed dead -> mounted

  Cryptsetup asks for the password and appears to accept it so I think root is
  being mounted alright.

The default.target is set to multi-user.target but here it gets a bit
confusing for me, I think it is either stuck trying to provide a service or I
haven't enabled a service.  Any advice please?

Last edited by myles (2015-03-23 20:59:19)

Offline

#2 2015-02-27 19:26:12

Head_on_a_Stick
Member
From: London
Registered: 2014-02-20
Posts: 7,732
Website

Re: [SOLVED] boot stuck at "Welcome to Arch Linux!"

Downgrade to the previous kernel version (or install and use the LTS kernel instead).

Offline

#3 2015-02-28 12:51:21

myles
Member
Registered: 2011-10-06
Posts: 40

Re: [SOLVED] boot stuck at "Welcome to Arch Linux!"

I've tried these kernels but get the same results, the 3.16's worked in the past and 3.18.2 probably did, I upgraded to 3.18.6 to try to fix the current problem:

3.18.6-1  <--- the one from post 1
3.18.2-2
3.16.4-1
3.16.3-1

Last edited by myles (2015-02-28 12:53:06)

Offline

#4 2015-03-02 17:20:24

myles
Member
Registered: 2011-10-06
Posts: 40

Re: [SOLVED] boot stuck at "Welcome to Arch Linux!"

Can anyone point me to the source code that causes the "Welcome to Arch Linux!" message?  What else can I try?

Offline

#5 2015-03-02 17:25:39

Spider.007
Member
Registered: 2004-06-20
Posts: 1,175

Re: [SOLVED] boot stuck at "Welcome to Arch Linux!"

Not sure how far it'll get you, but it comes from systemd

Offline

#6 2015-03-06 13:38:35

myles
Member
Registered: 2011-10-06
Posts: 40

Re: [SOLVED] boot stuck at "Welcome to Arch Linux!"

linux-lts had the same result.

Thanks for the systemd link, that helped with my googling.

I have discovered that I can get a rescue shell.  Using this kernel command line:

systemd.unit=rescue.target systemd.log_level=debug systemd.log_target=kmsg log_buf_len=1M 

It prompts for the luks password, boots, promtps for root password, I enter
the root password, the full output of dmesg  is here http://sprunge.us/IfcX

To make sure there are no jobs hanging, so far:

# systemctl list-jobs
No jobs running.

systemctl --all

  UNIT                                                                                                                                                  LOAD      ACTIVE   SUB       DESCRIPTION
  proc-sys-fs-binfmt_misc.automount                                                                                                                     loaded    active   waiting   Arbitrary Executable File Formats File System Automount Point
  dev-disk-by\x2did-ata\x2dWDC_WD20EFRX\x2d68EUZN0_WD\x2dWCC4M3026104.device                                                                            loaded    active   plugged   WDC_WD20EFRX-68EUZN0
  dev-disk-by\x2did-ata\x2dWDC_WD20EFRX\x2d68EUZN0_WD\x2dWCC4M3026104\x2dpart1.device                                                                   loaded    active   plugged   WDC_WD20EFRX-68EUZN0 1
  dev-disk-by\x2did-ata\x2dWDC_WD20EFRX\x2d68EUZN0_WD\x2dWCC4M3031724.device                                                                            loaded    active   plugged   WDC_WD20EFRX-68EUZN0
  dev-disk-by\x2did-ata\x2dWDC_WD20EFRX\x2d68EUZN0_WD\x2dWCC4M3031724\x2dpart1.device                                                                   loaded    active   plugged   WDC_WD20EFRX-68EUZN0 1
  dev-disk-by\x2did-dm\x2dname\x2dluks\x2d9181c004\x2d6796\x2d4df2\x2d88ad\x2de834f53da539.device                                                       loaded    active   plugged   /dev/disk/by-id/dm-name-luks-9181c004-6796-4df2-88ad-e834f53da539
  dev-disk-by\x2did-dm\x2dname\x2dWD1.device                                                                                                            loaded    active   plugged   /dev/disk/by-id/dm-name-WD1
  dev-disk-by\x2did-dm\x2duuid\x2dCRYPT\x2dLUKS1\x2d9181c00467964df288ade834f53da539\x2dluks\x2d9181c004\x2d6796\x2d4df2\x2d88ad\x2de834f53da539.device loaded    active   plugged   /dev/disk/by-id/dm-uuid-CRYPT-LUKS1-9181c00467964df288ade834f53da539-luks-9181c004-6796-4df2-88ad-e834f53da539
  dev-disk-by\x2did-dm\x2duuid\x2dCRYPT\x2dLUKS1\x2ddafac32497f745d7938c68351d53d17d\x2dWD1.device                                                      loaded    active   plugged   /dev/disk/by-id/dm-uuid-CRYPT-LUKS1-dafac32497f745d7938c68351d53d17d-WD1
  dev-disk-by\x2did-usb\x2dLEXAR_JUMPDRIVE_SPORT_BDED2511050135160905\x2d0:0.device                                                                     loaded    active   plugged   JUMPDRIVE_SPORT
  dev-disk-by\x2did-usb\x2dLEXAR_JUMPDRIVE_SPORT_BDED2511050135160905\x2d0:0\x2dpart1.device                                                            loaded    active   plugged   JUMPDRIVE_SPORT MULTIBOOT
  dev-disk-by\x2did-usb\x2dSanDisk_Cruzer_Fit_4C530102601203119342\x2d0:0.device                                                                        loaded    active   plugged   Cruzer_Fit
  dev-disk-by\x2did-usb\x2dSanDisk_Cruzer_Fit_4C530102601203119342\x2d0:0\x2dpart1.device                                                               loaded    active   plugged   Cruzer_Fit EFI\x20System
  dev-disk-by\x2did-usb\x2dSanDisk_Cruzer_Fit_4C530102601203119342\x2d0:0\x2dpart2.device                                                               loaded    active   plugged   Cruzer_Fit Linux\x20filesystem
  dev-disk-by\x2did-usb\x2dSanDisk_Cruzer_Fit_4C530102601203119342\x2d0:0\x2dpart3.device                                                               loaded    active   plugged   Cruzer_Fit Linux\x20filesystem
  dev-disk-by\x2did-usb\x2dSanDisk_Cruzer_Fit_4C530302661203119322\x2d0:0.device                                                                        loaded    active   plugged   Cruzer_Fit ARCH_201411
  dev-disk-by\x2did-usb\x2dSanDisk_Cruzer_Fit_4C530302661203119322\x2d0:0\x2dpart1.device                                                               loaded    active   plugged   Cruzer_Fit ARCH_201411
  dev-disk-by\x2did-usb\x2dSanDisk_Cruzer_Fit_4C530302661203119322\x2d0:0\x2dpart2.device                                                               loaded    active   plugged   Cruzer_Fit ARCHISO_EFI
  dev-disk-by\x2did-wwn\x2d0x50014ee25f85e8dc.device                                                                                                    loaded    active   plugged   WDC_WD20EFRX-68EUZN0
  dev-disk-by\x2did-wwn\x2d0x50014ee25f85e8dc\x2dpart1.device                                                                                           loaded    active   plugged   WDC_WD20EFRX-68EUZN0 1
  dev-disk-by\x2did-wwn\x2d0x50014ee2b4dbc19d.device                                                                                                    loaded    active   plugged   WDC_WD20EFRX-68EUZN0
  dev-disk-by\x2did-wwn\x2d0x50014ee2b4dbc19d\x2dpart1.device                                                                                           loaded    active   plugged   WDC_WD20EFRX-68EUZN0 1
  dev-disk-by\x2dlabel-ARCH_201411.device                                                                                                               loaded    active   plugged   Cruzer_Fit ARCH_201411
  dev-disk-by\x2dlabel-ARCHISO_EFI.device                                                                                                               loaded    active   plugged   Cruzer_Fit ARCHISO_EFI
  dev-disk-by\x2dlabel-MULTIBOOT.device                                                                                                                 loaded    active   plugged   JUMPDRIVE_SPORT MULTIBOOT
  dev-disk-by\x2dlabel-root.device                                                                                                                      loaded    active   plugged   /dev/disk/by-label/root
  dev-disk-by\x2dpartlabel-EFI\x5cx20System.device                                                                                                      loaded    active   plugged   Cruzer_Fit EFI\x20System
  dev-disk-by\x2dpartlabel-Linux\x5cx20filesystem.device                                                                                                loaded    active   plugged   Cruzer_Fit Linux\x20filesystem
  dev-disk-by\x2dpartuuid-265f691f\x2db264\x2d4585\x2d9e37\x2d665fdeec43cd.device                                                                       loaded    active   plugged   WDC_WD20EFRX-68EUZN0 1
  dev-disk-by\x2dpartuuid-36e45120\x2d4113\x2d4ac5\x2da820\x2d25ea971c05ed.device                                                                       loaded    active   plugged   Cruzer_Fit EFI\x20System
  dev-disk-by\x2dpartuuid-3f3f78f9\x2db4f8\x2d44c6\x2db545\x2df5dba162ca4f.device                                                                       loaded    active   plugged   Cruzer_Fit Linux\x20filesystem
  dev-disk-by\x2dpartuuid-b2384cff\x2d5144\x2d41c4\x2dbb8f\x2dac2fc78c4aa1.device                                                                       loaded    active   plugged   Cruzer_Fit Linux\x20filesystem
  dev-disk-by\x2dpartuuid-e921709a\x2d61f3\x2d4c10\x2db170\x2d81148064f07c.device                                                                       loaded    active   plugged   WDC_WD20EFRX-68EUZN0 1
  dev-disk-by\x2dpath-pci\x2d0000:00:10.0\x2dusb\x2d0:2:1.0\x2dscsi\x2d0:0:0:0.device                                                                   loaded    active   plugged   Cruzer_Fit
  dev-disk-by\x2dpath-pci\x2d0000:00:10.0\x2dusb\x2d0:2:1.0\x2dscsi\x2d0:0:0:0\x2dpart1.device                                                          loaded    active   plugged   Cruzer_Fit EFI\x20System
  dev-disk-by\x2dpath-pci\x2d0000:00:10.0\x2dusb\x2d0:2:1.0\x2dscsi\x2d0:0:0:0\x2dpart2.device                                                          loaded    active   plugged   Cruzer_Fit Linux\x20filesystem
  dev-disk-by\x2dpath-pci\x2d0000:00:10.0\x2dusb\x2d0:2:1.0\x2dscsi\x2d0:0:0:0\x2dpart3.device                                                          loaded    active   plugged   Cruzer_Fit Linux\x20filesystem
  dev-disk-by\x2dpath-pci\x2d0000:00:12.2\x2dusb\x2d0:1:1.0\x2dscsi\x2d0:0:0:0.device                                                                   loaded    active   plugged   Cruzer_Fit ARCH_201411
  dev-disk-by\x2dpath-pci\x2d0000:00:12.2\x2dusb\x2d0:1:1.0\x2dscsi\x2d0:0:0:0\x2dpart1.device                                                          loaded    active   plugged   Cruzer_Fit ARCH_201411
  dev-disk-by\x2dpath-pci\x2d0000:00:12.2\x2dusb\x2d0:1:1.0\x2dscsi\x2d0:0:0:0\x2dpart2.device                                                          loaded    active   plugged   Cruzer_Fit ARCHISO_EFI
  dev-disk-by\x2dpath-pci\x2d0000:00:12.2\x2dusb\x2d0:2:1.0\x2dscsi\x2d0:0:0:0.device                                                                   loaded    active   plugged   JUMPDRIVE_SPORT
  dev-disk-by\x2dpath-pci\x2d0000:00:12.2\x2dusb\x2d0:2:1.0\x2dscsi\x2d0:0:0:0\x2dpart1.device                                                          loaded    active   plugged   JUMPDRIVE_SPORT MULTIBOOT
  dev-disk-by\x2duuid-0157\x2dE8C4.device                                                                                                               loaded    active   plugged   Cruzer_Fit ARCHISO_EFI
  dev-disk-by\x2duuid-1F83\x2d386B.device                                                                                                               loaded    active   plugged   JUMPDRIVE_SPORT MULTIBOOT
  dev-disk-by\x2duuid-2014\x2d11\x2d01\x2d06\x2d40\x2d33\x2d00.device                                                                                   loaded    active   plugged   Cruzer_Fit ARCH_201411
  dev-disk-by\x2duuid-52ee9428\x2d5844\x2d404c\x2d8b12\x2d584b5e10aafb.device                                                                           loaded    active   plugged   Cruzer_Fit Linux\x20filesystem
  dev-disk-by\x2duuid-88d5ff7b\x2ddfba\x2d4659\x2db6ad\x2dbb8e8e13f898.device                                                                           loaded    active   plugged   /dev/disk/by-uuid/88d5ff7b-dfba-4659-b6ad-bb8e8e13f898
  dev-disk-by\x2duuid-9181c004\x2d6796\x2d4df2\x2d88ad\x2de834f53da539.device                                                                           loaded    active   plugged   Cruzer_Fit Linux\x20filesystem
  dev-disk-by\x2duuid-ABF9\x2d1132.device                                                                                                               loaded    active   plugged   Cruzer_Fit EFI\x20System
  dev-disk-by\x2duuid-bb7422a1\x2d0bfd\x2d4279\x2dbe46\x2dfd99f6b14d0b.device                                                                           loaded    active   plugged   WDC_WD20EFRX-68EUZN0 1
  dev-disk-by\x2duuid-d6c97f5d\x2d940a\x2d4ee2\x2d81ba\x2de9b88437cfc4.device                                                                           loaded    active   plugged   /dev/disk/by-uuid/d6c97f5d-940a-4ee2-81ba-e9b88437cfc4
  dev-disk-by\x2duuid-dafac324\x2d97f7\x2d45d7\x2d938c\x2d68351d53d17d.device                                                                           loaded    active   plugged   WDC_WD20EFRX-68EUZN0 1
  dev-dm\x2d0.device                                                                                                                                    loaded    active   plugged   /dev/dm-0
  dev-dm\x2d1.device                                                                                                                                    loaded    active   plugged   /dev/dm-1
  dev-mapper-luks\x2d9181c004\x2d6796\x2d4df2\x2d88ad\x2de834f53da539.device                                                                            loaded    active   plugged   /dev/mapper/luks-9181c004-6796-4df2-88ad-e834f53da539
  dev-mapper-WD1.device                                                                                                                                 loaded    active   plugged   /dev/mapper/WD1
  dev-sda.device                                                                                                                                        loaded    active   plugged   WDC_WD20EFRX-68EUZN0
  dev-sda1.device                                                                                                                                       loaded    active   plugged   WDC_WD20EFRX-68EUZN0 1
  dev-sdb.device                                                                                                                                        loaded    active   plugged   WDC_WD20EFRX-68EUZN0
  dev-sdb1.device                                                                                                                                       loaded    active   plugged   WDC_WD20EFRX-68EUZN0 1
  dev-sdc.device                                                                                                                                        loaded    active   plugged   Cruzer_Fit ARCH_201411
  dev-sdc1.device                                                                                                                                       loaded    active   plugged   Cruzer_Fit ARCH_201411
  dev-sdc2.device                                                                                                                                       loaded    active   plugged   Cruzer_Fit ARCHISO_EFI
  dev-sdd.device                                                                                                                                        loaded    active   plugged   Cruzer_Fit
  dev-sdd1.device                                                                                                                                       loaded    active   plugged   Cruzer_Fit EFI\x20System
  dev-sdd2.device                                                                                                                                       loaded    active   plugged   Cruzer_Fit Linux\x20filesystem
  dev-sdd3.device                                                                                                                                       loaded    active   plugged   Cruzer_Fit Linux\x20filesystem
  dev-sde.device                                                                                                                                        loaded    active   plugged   JUMPDRIVE_SPORT
  dev-sde1.device                                                                                                                                       loaded    active   plugged   JUMPDRIVE_SPORT MULTIBOOT
  dev-ttyS0.device                                                                                                                                      loaded    active   plugged   /dev/ttyS0
  dev-ttyS1.device                                                                                                                                      loaded    active   plugged   /dev/ttyS1
  dev-ttyS2.device                                                                                                                                      loaded    active   plugged   /dev/ttyS2
  dev-ttyS3.device                                                                                                                                      loaded    active   plugged   /dev/ttyS3
  sys-devices-pci0000:00-0000:00:01.1-sound-card0.device                                                                                                loaded    active   plugged   Kabini HDMI/DP Audio
  sys-devices-pci0000:00-0000:00:02.4-0000:01:00.0-net-enp1s0.device                                                                                    loaded    active   plugged   RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller
  sys-devices-pci0000:00-0000:00:10.0-usb5-5\x2d2-5\x2d2:1.0-host3-target3:0:0-3:0:0:0-block-sdd-sdd1.device                                            loaded    active   plugged   Cruzer_Fit EFI\x20System
  sys-devices-pci0000:00-0000:00:10.0-usb5-5\x2d2-5\x2d2:1.0-host3-target3:0:0-3:0:0:0-block-sdd-sdd2.device                                            loaded    active   plugged   Cruzer_Fit Linux\x20filesystem
  sys-devices-pci0000:00-0000:00:10.0-usb5-5\x2d2-5\x2d2:1.0-host3-target3:0:0-3:0:0:0-block-sdd-sdd3.device                                            loaded    active   plugged   Cruzer_Fit Linux\x20filesystem
  sys-devices-pci0000:00-0000:00:10.0-usb5-5\x2d2-5\x2d2:1.0-host3-target3:0:0-3:0:0:0-block-sdd.device                                                 loaded    active   plugged   Cruzer_Fit
  sys-devices-pci0000:00-0000:00:11.0-ata1-host0-target0:0:0-0:0:0:0-block-sda-sda1.device                                                              loaded    active   plugged   WDC_WD20EFRX-68EUZN0 1
  sys-devices-pci0000:00-0000:00:11.0-ata1-host0-target0:0:0-0:0:0:0-block-sda.device                                                                   loaded    active   plugged   WDC_WD20EFRX-68EUZN0
  sys-devices-pci0000:00-0000:00:11.0-ata2-host1-target1:0:0-1:0:0:0-block-sdb-sdb1.device                                                              loaded    active   plugged   WDC_WD20EFRX-68EUZN0 1
  sys-devices-pci0000:00-0000:00:11.0-ata2-host1-target1:0:0-1:0:0:0-block-sdb.device                                                                   loaded    active   plugged   WDC_WD20EFRX-68EUZN0
  sys-devices-pci0000:00-0000:00:12.2-usb1-1\x2d1-1\x2d1:1.0-host2-target2:0:0-2:0:0:0-block-sdc-sdc1.device                                            loaded    active   plugged   Cruzer_Fit ARCH_201411
  sys-devices-pci0000:00-0000:00:12.2-usb1-1\x2d1-1\x2d1:1.0-host2-target2:0:0-2:0:0:0-block-sdc-sdc2.device                                            loaded    active   plugged   Cruzer_Fit ARCHISO_EFI
  sys-devices-pci0000:00-0000:00:12.2-usb1-1\x2d1-1\x2d1:1.0-host2-target2:0:0-2:0:0:0-block-sdc.device                                                 loaded    active   plugged   Cruzer_Fit ARCH_201411
  sys-devices-pci0000:00-0000:00:12.2-usb1-1\x2d2-1\x2d2:1.0-host4-target4:0:0-4:0:0:0-block-sde-sde1.device                                            loaded    active   plugged   JUMPDRIVE_SPORT MULTIBOOT
  sys-devices-pci0000:00-0000:00:12.2-usb1-1\x2d2-1\x2d2:1.0-host4-target4:0:0-4:0:0:0-block-sde.device                                                 loaded    active   plugged   JUMPDRIVE_SPORT
  sys-devices-platform-serial8250-tty-ttyS1.device                                                                                                      loaded    active   plugged   /sys/devices/platform/serial8250/tty/ttyS1
  sys-devices-platform-serial8250-tty-ttyS2.device                                                                                                      loaded    active   plugged   /sys/devices/platform/serial8250/tty/ttyS2
  sys-devices-platform-serial8250-tty-ttyS3.device                                                                                                      loaded    active   plugged   /sys/devices/platform/serial8250/tty/ttyS3
  sys-devices-pnp0-00:04-tty-ttyS0.device                                                                                                               loaded    active   plugged   /sys/devices/pnp0/00:04/tty/ttyS0
  sys-devices-virtual-block-dm\x2d0.device                                                                                                              loaded    active   plugged   /sys/devices/virtual/block/dm-0
  sys-devices-virtual-block-dm\x2d1.device                                                                                                              loaded    active   plugged   /sys/devices/virtual/block/dm-1
  sys-module-configfs.device                                                                                                                            loaded    active   plugged   /sys/module/configfs
  sys-subsystem-net-devices-enp1s0.device                                                                                                               loaded    active   plugged   RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller
  -.mount                                                                                                                                               loaded    active   mounted   /
  boot-efi.mount                                                                                                                                        loaded    active   mounted   /boot/efi
  boot.mount                                                                                                                                            loaded    active   mounted   /boot
  dev-hugepages.mount                                                                                                                                   loaded    active   mounted   Huge Pages File System
  dev-mqueue.mount                                                                                                                                      loaded    active   mounted   POSIX Message Queue File System
  mnt-x.mount                                                                                                                                           loaded    active   mounted   /mnt/x
  proc-sys-fs-binfmt_misc.mount                                                                                                                         loaded    inactive dead      Arbitrary Executable File Formats File System
  sys-fs-fuse-connections.mount                                                                                                                         loaded    inactive dead      FUSE Control File System
  sys-kernel-config.mount                                                                                                                               loaded    active   mounted   Configuration File System
  sys-kernel-debug.mount                                                                                                                                loaded    active   mounted   Debug File System
  tmp.mount                                                                                                                                             loaded    active   mounted   Temporary Directory
  systemd-ask-password-console.path                                                                                                                     loaded    active   waiting   Dispatch Password Requests to Console Directory Watch
● auditd.service                                                                                                                                        not-found inactive dead      auditd.service
  dbus.service                                                                                                                                          loaded    inactive dead      D-Bus System Message Bus
  debug-shell.service                                                                                                                                   loaded    active   running   Early root shell on /dev/tty9 FOR DEBUGGING ONLY
  dm-event.service                                                                                                                                      loaded    inactive dead      Device-mapper event daemon
  emergency.service                                                                                                                                     loaded    inactive dead      Emergency Shell
  kmod-static-nodes.service                                                                                                                             loaded    active   exited    Create list of required static device nodes for the current kernel
  ldconfig.service                                                                                                                                      loaded    inactive dead      Rebuild Dynamic Linker Cache
  lvm2-lvmetad.service                                                                                                                                  loaded    inactive dead      LVM2 metadata daemon
  mkinitcpio-generate-shutdown-ramfs.service                                                                                                            loaded    inactive dead      Generate shutdown-ramfs
● plymouth-start.service                                                                                                                                not-found inactive dead      plymouth-start.service
  rescue.service                                                                                                                                        loaded    active   running   Rescue Shell
● syslog.service                                                                                                                                        not-found inactive dead      syslog.service
  systemd-ask-password-console.service                                                                                                                  loaded    inactive dead      Dispatch Password Requests to Console
  systemd-binfmt.service                                                                                                                                loaded    inactive dead      Set Up Additional Binary Formats
  systemd-cryptsetup@WD1.service                                                                                                                        loaded    active   exited    Cryptography Setup for WD1
  systemd-firstboot.service                                                                                                                             loaded    inactive dead      First Boot Wizard
  systemd-fsck-root.service                                                                                                                             loaded    inactive dead      File System Check on Root Device
  systemd-fsck@dev-disk-by\x2duuid-52ee9428\x2d5844\x2d404c\x2d8b12\x2d584b5e10aafb.service                                                             loaded    active   exited    File System Check on /dev/disk/by-uuid/52ee9428-5844-404c-8b12-584b5e10aafb
  systemd-fsck@dev-disk-by\x2duuid-ABF9\x2d1132.service                                                                                                 loaded    active   exited    File System Check on /dev/disk/by-uuid/ABF9-1132
  systemd-initctl.service                                                                                                                               loaded    inactive dead      /dev/initctl Compatibility Daemon
  systemd-journal-catalog-update.service                                                                                                                loaded    inactive dead      Rebuild Journal Catalog
  systemd-journal-flush.service                                                                                                                         loaded    active   exited    Flush Journal to Persistent Storage
  systemd-journald.service                                                                                                                              loaded    active   running   Journal Service
  systemd-machine-id-commit.service                                                                                                                     loaded    inactive dead      Commit a transient machine-id on disk
  systemd-modules-load.service                                                                                                                          loaded    active   exited    Load Kernel Modules
  systemd-random-seed.service                                                                                                                           loaded    active   exited    Load/Save Random Seed
  systemd-remount-fs.service                                                                                                                            loaded    active   exited    Remount Root and Kernel File Systems
  systemd-shutdownd.service                                                                                                                             loaded    inactive dead      Delayed Shutdown Service
  systemd-sysctl.service                                                                                                                                loaded    active   exited    Apply Kernel Variables
  systemd-sysusers.service                                                                                                                              loaded    inactive dead      Create System Users
  systemd-tmpfiles-clean.service                                                                                                                        loaded    inactive dead      Cleanup of Temporary Directories
  systemd-tmpfiles-setup-dev.service                                                                                                                    loaded    active   exited    Create Static Device Nodes in /dev
  systemd-tmpfiles-setup.service                                                                                                                        loaded    active   exited    Create Volatile Files and Directories
  systemd-udev-hwdb-update.service                                                                                                                      loaded    inactive dead      Rebuild Hardware Database
  systemd-udev-trigger.service                                                                                                                          loaded    active   exited    udev Coldplug all Devices
  systemd-udevd.service                                                                                                                                 loaded    active   running   udev Kernel Device Manager
  systemd-update-done.service                                                                                                                           loaded    inactive dead      Update is Completed
  systemd-update-utmp.service                                                                                                                           loaded    active   exited    Update UTMP about System Boot/Shutdown
  systemd-user-sessions.service                                                                                                                         loaded    inactive dead      Permit User Sessions
  systemd-vconsole-setup.service                                                                                                                        loaded    active   exited    Setup Virtual Console
  -.slice                                                                                                                                               loaded    active   active    Root Slice
  system-systemd\x2dcryptsetup.slice                                                                                                                    loaded    active   active    system-systemd\x2dcryptsetup.slice
  system-systemd\x2dfsck.slice                                                                                                                          loaded    active   active    system-systemd\x2dfsck.slice
  system.slice                                                                                                                                          loaded    active   active    System Slice
  dbus.socket                                                                                                                                           loaded    inactive dead      D-Bus System Message Bus Socket
  dm-event.socket                                                                                                                                       loaded    inactive dead      Device-mapper event daemon FIFOs
  lvm2-lvmetad.socket                                                                                                                                   loaded    active   listening LVM2 metadata daemon socket
  syslog.socket                                                                                                                                         loaded    inactive dead      Syslog Socket
  systemd-initctl.socket                                                                                                                                loaded    inactive dead      /dev/initctl Compatibility Named Pipe
  systemd-journald-audit.socket                                                                                                                         loaded    inactive dead      Journal Audit Socket
  systemd-journald-dev-log.socket                                                                                                                       loaded    active   running   Journal Socket (/dev/log)
  systemd-journald.socket                                                                                                                               loaded    active   running   Journal Socket
  systemd-shutdownd.socket                                                                                                                              loaded    inactive dead      Delayed Shutdown Socket
  systemd-udevd-control.socket                                                                                                                          loaded    active   running   udev Control Socket
  systemd-udevd-kernel.socket                                                                                                                           loaded    active   running   udev Kernel Socket
  basic.target                                                                                                                                          loaded    inactive dead      Basic System
  cryptsetup-pre.target                                                                                                                                 loaded    inactive dead      Encrypted Volumes (Pre)
  cryptsetup.target                                                                                                                                     loaded    active   active    Encrypted Volumes
  emergency.target                                                                                                                                      loaded    inactive dead      Emergency Mode
  local-fs-pre.target                                                                                                                                   loaded    active   active    Local File Systems (Pre)
  local-fs.target                                                                                                                                       loaded    active   active    Local File Systems
  paths.target                                                                                                                                          loaded    inactive dead      Paths
  remote-fs-pre.target                                                                                                                                  loaded    inactive dead      Remote File Systems (Pre)
  remote-fs.target                                                                                                                                      loaded    inactive dead      Remote File Systems
  rescue.target                                                                                                                                         loaded    active   active    Rescue Mode
  shutdown.target                                                                                                                                       loaded    inactive dead      Shutdown
  slices.target                                                                                                                                         loaded    inactive dead      Slices
  sockets.target                                                                                                                                        loaded    inactive dead      Sockets
  sound.target                                                                                                                                          loaded    active   active    Sound Card
  swap.target                                                                                                                                           loaded    active   active    Swap
  sysinit.target                                                                                                                                        loaded    active   active    System Initialization
  time-sync.target                                                                                                                                      loaded    inactive dead      System Time Synchronized
  timers.target                                                                                                                                         loaded    inactive dead      Timers
  umount.target                                                                                                                                         loaded    inactive dead      Unmount All Filesystems
  systemd-tmpfiles-clean.timer                                                                                                                          loaded    inactive dead      Daily Cleanup of Temporary Directories

LOAD   = Reflects whether the unit definition was properly loaded.
ACTIVE = The high-level unit activation state, i.e. generalization of SUB.
SUB    = The low-level unit activation state, values depend on unit type.

183 loaded units listed.
To show all installed unit files use 'systemctl list-unit-files'.

systemctl list-unit-files

UNIT FILE                                  STATE   
proc-sys-fs-binfmt_misc.automount          static  
dev-hugepages.mount                        static  
dev-mqueue.mount                           static  
proc-fs-nfsd.mount                         static  
proc-sys-fs-binfmt_misc.mount              static  
sys-fs-fuse-connections.mount              static  
sys-kernel-config.mount                    static  
sys-kernel-debug.mount                     static  
tmp.mount                                  static  
var-lib-nfs-rpc_pipefs.mount               static  
systemd-ask-password-console.path          static  
systemd-ask-password-wall.path             static  
apcupsd.service                            enabled 
atd.service                                enabled 
auth-rpcgss-module.service                 static  
autovt@.service                            disabled
blk-availability.service                   disabled
console-getty.service                      enabled 
console-shell.service                      enabled 
container-getty@.service                   static  
dbus-org.freedesktop.hostname1.service     static  
dbus-org.freedesktop.locale1.service       static  
dbus-org.freedesktop.login1.service        static  
dbus-org.freedesktop.machine1.service      static  
dbus-org.freedesktop.resolve1.service      disabled
dbus-org.freedesktop.timedate1.service     static  
dbus.service                               static  
debug-shell.service                        enabled 
dhcpcd.service                             disabled
dhcpcd@.service                            disabled
dm-event.service                           disabled
emergency.service                          static  
fstrim.service                             static  
ftpd.service                               disabled
getty@.service                             enabled 
git-daemon@.service                        static  
gssproxy.service                           disabled
initrd-cleanup.service                     static  
initrd-parse-etc.service                   static  
initrd-switch-root.service                 static  
initrd-udevadm-cleanup-db.service          static  
ip6tables.service                          disabled
iptables.service                           disabled
kmod-static-nodes.service                  static  
krb5-kadmind.service                       disabled
krb5-kdc.service                           disabled
krb5-kpropd.service                        disabled
krb5-kpropd@.service                       static  
ldconfig.service                           static  
logrotate.service                          static  
lvm2-lvmetad.service                       disabled
lvm2-monitor.service                       disabled
lvm2-pvscan@.service                       static  
man-db.service                             static  
mdadm-grow-continue@.service               static  
mdadm-last-resort@.service                 static  
mdadm.service                              disabled
mdmon@.service                             static  
mdmonitor.service                          static  
mkinitcpio-generate-shutdown-ramfs.service static  
netctl-auto@.service                       disabled
netctl-ifplugd@.service                    disabled
netctl-sleep.service                       disabled
netctl.service                             disabled
netctl@.service                            static  
netctl@gc\x2dwired.service                 enabled 
nfs-blkmap.service                         static  
nfs-config.service                         static  
nfs-idmapd.service                         static  
nfs-mountd.service                         static  
nfs-server.service                         disabled
nfs-utils.service                          static  
nftables.service                           disabled
nscd.service                               disabled
ntpd.service                               enabled 
ntpdate.service                            disabled
pacserve-ports.service                     disabled
pacserve.service                           enabled 
quotaon.service                            static  
rescue.service                             static  
rlogin@.service                            static  
rpc-gssd.service                           static  
rpc-statd-notify.service                   static  
rpc-statd.service                          static  
rpc-svcgssd.service                        static  
rpcbind.service                            static  
rsh@.service                               static  
rsyncd.service                             disabled
rsyncd@.service                            static  
serial-getty@.service                      disabled
shadow.service                             static  
sshd.service                               enabled 
sshd@.service                              static  
sshdgenkeys.service                        static  
systemd-ask-password-console.service       static  
systemd-ask-password-wall.service          static  
systemd-backlight@.service                 static  
systemd-binfmt.service                     static  
systemd-bootchart.service                  disabled
systemd-firstboot.service                  static  
systemd-fsck-root.service                  static  
systemd-fsck@.service                      static  
systemd-halt.service                       static  
systemd-hibernate-resume@.service          static  
systemd-hibernate.service                  static  
systemd-hostnamed.service                  static  
systemd-hybrid-sleep.service               static  
systemd-initctl.service                    static  
systemd-journal-catalog-update.service     static  
systemd-journal-flush.service              static  
systemd-journal-gatewayd.service           static  
systemd-journal-remote.service             static  
systemd-journal-upload.service             disabled
systemd-journald.service                   static  
systemd-kexec.service                      static  
systemd-localed.service                    static  
systemd-logind.service                     static  
systemd-machine-id-commit.service          static  
systemd-machined.service                   static  
systemd-modules-load.service               static  
systemd-networkd-wait-online.service       disabled
systemd-networkd.service                   disabled
systemd-nspawn@.service                    disabled
systemd-poweroff.service                   static  
systemd-quotacheck.service                 static  
systemd-random-seed.service                static  
systemd-reboot.service                     static  
systemd-remount-fs.service                 static  
systemd-resolved.service                   disabled
systemd-rfkill@.service                    static  
systemd-shutdownd.service                  static  
systemd-suspend.service                    static  
systemd-sysctl.service                     static  
systemd-sysusers.service                   static  
systemd-timedated.service                  static  
systemd-timesyncd.service                  disabled
systemd-tmpfiles-clean.service             static  
systemd-tmpfiles-setup-dev.service         static  
systemd-tmpfiles-setup.service             static  
systemd-udev-hwdb-update.service           static  
systemd-udev-settle.service                static  
systemd-udev-trigger.service               static  
systemd-udevd.service                      static  
systemd-update-done.service                static  
systemd-update-utmp-runlevel.service       static  
systemd-update-utmp.service                static  
systemd-user-sessions.service              static  
systemd-vconsole-setup.service             static  
talk.service                               static  
telnet@.service                            static  
user@.service                              static  
uuidd.service                              static  
-.slice                                    static  
machine.slice                              static  
system.slice                               static  
user.slice                                 static  
dbus.socket                                static  
dm-event.socket                            static  
git-daemon.socket                          disabled
krb5-kpropd.socket                         disabled
lvm2-lvmetad.socket                        static  
rlogin.socket                              disabled
rpcbind.socket                             disabled
rsh.socket                                 disabled
rsyncd.socket                              disabled
sshd.socket                                disabled
syslog.socket                              static  
systemd-initctl.socket                     static  
systemd-journal-gatewayd.socket            disabled
systemd-journal-remote.socket              disabled
systemd-journald-audit.socket              static  
systemd-journald-dev-log.socket            static  
systemd-journald.socket                    static  
systemd-shutdownd.socket                   static  
systemd-udevd-control.socket               static  
systemd-udevd-kernel.socket                static  
talk.socket                                disabled
telnet.socket                              disabled
uuidd.socket                               disabled
basic.target                               static  
bluetooth.target                           static  
cryptsetup-pre.target                      static  
cryptsetup.target                          static  
ctrl-alt-del.target                        disabled
default.target                             enabled 
emergency.target                           static  
final.target                               static  
getty.target                               static  
graphical.target                           static  
halt.target                                disabled
hibernate.target                           static  
hybrid-sleep.target                        static  
initrd-fs.target                           static  
initrd-root-fs.target                      static  
initrd-switch-root.target                  static  
initrd.target                              static  
kexec.target                               disabled
local-fs-pre.target                        static  
local-fs.target                            static  
multi-user.target                          enabled 
network-online.target                      static  
network-pre.target                         static  
network.target                             static  
nfs-blkmap.target                          disabled
nfs-client.target                          disabled
nss-lookup.target                          static  
nss-user-lookup.target                     static  
paths.target                               static  
poweroff.target                            disabled
printer.target                             static  
reboot.target                              disabled
remote-fs-pre.target                       static  
remote-fs.target                           enabled 
rescue.target                              disabled
rpcbind.target                             static  
shutdown.target                            static  
sigpwr.target                              static  
sleep.target                               static  
slices.target                              static  
smartcard.target                           static  
sockets.target                             static  
sound.target                               static  
suspend.target                             static  
swap.target                                static  
sysinit.target                             static  
system-update.target                       static  
time-sync.target                           static  
timers.target                              static  
umount.target                              static  
fstrim.timer                               disabled
logrotate.timer                            static  
man-db.timer                               static  
mdadm-last-resort@.timer                   static  
shadow.timer                               static  
systemd-tmpfiles-clean.timer               static  

235 unit files listed.

If I then do
# systemctl isolate multi-user.target
I get something like Failed to start multi-user.target:  Connection timed out

similarly, if I boot the rescue.target, as above, then press Ctl-D to continue:

Failed to start default.target:  Connection timed out

Any ideas on what I can try now?

Last edited by myles (2015-03-06 14:12:42)

Offline

#7 2015-03-09 10:28:02

myles
Member
Registered: 2011-10-06
Posts: 40

Re: [SOLVED] boot stuck at "Welcome to Arch Linux!"

I've asked on stackoverflow here.  I am wondering if this problem would attract more help in the Newbie Forum?  Otherwise the only thing left is to do is re-install hmm

Offline

#8 2015-03-09 18:13:12

Spider.007
Member
Registered: 2004-06-20
Posts: 1,175

Re: [SOLVED] boot stuck at "Welcome to Arch Linux!"

My guess is the Connection is refering to DBus, I'd also have a look at https://fedoraproject.org/wiki/How_to_d … d_problems and have a look at some of the debug options

Offline

#9 2015-03-23 20:58:47

myles
Member
Registered: 2011-10-06
Posts: 40

Re: [SOLVED] boot stuck at "Welcome to Arch Linux!"

I had more than on issue.  A service I had set to start at boot time but didn't work, and also a misconfiguration in users and groups to do with logging, hence no logs picking up the first issue.
After doing this:

ls -l /etc/systemd/system/multi-user.target.wants > multi-user.target.wants.BAK
rm -rf /etc/systemd/system/multi-user.target.wants

it boots!

After an update, I had failed to merge properly at least one .pacnew file leading to errors in at least one of these files:

/etc/passwd
/etc/shadow
/etc/group

The misconfiguration was detected by running these tools:

# pwck
# grpck

and then I deleted the lines it complained about (anything to do with systemd-journal-remote and systemd-journal-upload), and regenerated the entries in those files by running

# systemd-sysusers

Fixed!  Pheew, that was close, I was oggling other distros and wondering what they would be like to shack up with.
Thanks for the replies Spider.007 and Head_on_a_Stick.

Offline

#10 2015-03-24 19:57:36

Spider.007
Member
Registered: 2004-06-20
Posts: 1,175

Re: [SOLVED] boot stuck at "Welcome to Arch Linux!"

Wow, sounds like you learned a lot! Thanks for the update smile

Offline

Board footer

Powered by FluxBB