You are not logged in.

#1 2017-11-15 20:09:14

felixtheratruns
Member
Registered: 2016-12-04
Posts: 21

[SOLVED] EFI GRUB with LVM on RAID1: cannot find rootfs works at first

So I'm having trouble getting my arch installation to work consistently (it's been consistently NOT booting recently). I'm using lvm2 and raid1. I have two disks (/dev/sda /dev/sdb) with two partitions on each one (/dev/sda1 /dev/sda2 /dev/sdb1 /dev/sdb2)

sda1 and sdb1 are the FAT32 UEFI boot partition. sda1 and sdb1 have the same UUID, and sda2 sdb2 have the same UUID. This I believe is because I created the sdb partitions by copying from the sda partitions with with gparted. sda2 and sdb2 are what I have as a raid1 array on which is an lvm2 logical volume group:

[###@archiso ~]$ sudo blkid
/dev/sdb1: LABEL="L EFI" UUID="F9F1-D1FB" TYPE="vfat" PARTUUID="1f9079ef-f492-4600-8fb0-1d4c7e5288c9"
/dev/sdb2: UUID="4ab63dc1-0d23-2eac-f102-708c37c001d4" UUID_SUB="1ec0b43a-896c-e5b3-589a-1141556218e6" LABEL="MOO:0" TYPE="linux_raid_member" PARTLABEL="OS" PARTUUID="eae30d09-a702-4ac9-9baf-a943ed58b972"
/dev/sda1: LABEL="L EFI" UUID="F9F1-D1FB" TYPE="vfat" PARTLABEL="EFI" PARTUUID="96adcf1c-179e-4258-8bb6-0856686f6f0f"
/dev/sda2: UUID="4ab63dc1-0d23-2eac-f102-708c37c001d4" UUID_SUB="e6fd8988-1e91-872c-de2b-3be9d5cd6628" LABEL="MOO:0" TYPE="linux_raid_member" PARTLABEL="OS" PARTUUID="bc89ac80-e5e1-4a45-8c2b-04af6a994ebd"
/dev/sdc1: UUID="2017-11-01-08-25-48-00" LABEL="ARCH_201711" TYPE="iso9660" PTUUID="5329baec" PTTYPE="dos" PARTUUID="5329baec-01"
/dev/sdc2: SEC_TYPE="msdos" LABEL="ARCHISO_EFI" UUID="4EB1-42C2" TYPE="vfat" PARTUUID="5329baec-02"
/dev/loop0: TYPE="squashfs"
/dev/md127: UUID="VYpnc2-4eyO-sedo-SvTw-zBX6-1lFA-qTbBg9" TYPE="LVM2_member"
/dev/mapper/VolumeGroupArray-lvroot: UUID="0e3a0ea6-255d-42e3-814b-0e00dcf79820" TYPE="ext4"
/dev/mapper/VolumeGroupArray-lvvar: UUID="d8be01a9-3f8a-4ad6-9bb3-0852edd70b0d" TYPE="ext4"
/dev/mapper/VolumeGroupArray-lvswap: UUID="f9ee0e3c-26bf-4ea3-a4a8-e3dcb6dbc53b" TYPE="swap"
/dev/mapper/VolumeGroupArray-lvhome: UUID="3a92ca90-2f21-44ee-859e-0a9ae3996016" TYPE="ext4"
/dev/mapper/VolumeGroupArray-lvdata: UUID="c7035009-a3a5-4ebc-95e6-ab6bb63ab2ef" TYPE="ext4"

/etc/mdadm.conf

ARRAY /dev/md/MOO:0 metadata=1.2 name=MOO:0 UUID=4ab63dc1:0d232eac:f102708c:37c001d4

I was originally trying to mount sda1 to /esps/sda1 and sdb1 to /esps/sdb1 and then bind mount both to boot with

mount --bind /esps/sda1 /boot
mount --bind /esps/sdb1 /boot

Since genfstab (using "genfstab -U -p /mnt > /mnt/etc/fstab") doesn't seem to understand the difference between a bind mount and a regular mount I would get a very weird fstab:

# 
# /etc/fstab: static file system information
#
# <file system> <dir>   <type>  <options>       <dump>  <pass>
# /dev/mapper/VolumeGroupArray-lvroot
UUID=0e3a0ea6-255d-42e3-814b-0e00dcf79820       /               ext4            rw,relatime,data=ordered        0 1

# /dev/sda1 LABEL=L\134x20EFI
UUID=F9F1-D1FB          /esps/sda1      vfat            rw,relatime,fmask=0022,dmask=0022,codepage=437,iocharset=iso8859-1,shortname=mixed,errors=remount-ro    0 2

# /dev/sdb1 LABEL=L\134x20EFI
UUID=F9F1-D1FB          /esps/sda1      vfat            rw,relatime,fmask=0022,dmask=0022,codepage=437,iocharset=iso8859-1,shortname=mixed,errors=remount-ro    0 2

# /dev/sda1 LABEL=L\134x20EFI
UUID=F9F1-D1FB          /boot           vfat            rw,relatime,fmask=0022,dmask=0022,codepage=437,iocharset=iso8859-1,shortname=mixed,errors=remount-ro    0 2

# /dev/sda1 LABEL=L\134x20EFI
UUID=F9F1-D1FB          /boot           vfat            rw,relatime,fmask=0022,dmask=0022,codepage=437,iocharset=iso8859-1,shortname=mixed,errors=remount-ro    0 2

# /dev/sdb1 LABEL=L\134x20EFI
UUID=F9F1-D1FB          /boot           vfat            rw,relatime,fmask=0022,dmask=0022,codepage=437,iocharset=iso8859-1,shortname=mixed,errors=remount-ro    0 2

# /dev/sdb1 LABEL=L\134x20EFI
UUID=F9F1-D1FB          /esps/sdb1      vfat            rw,relatime,fmask=0022,dmask=0022,codepage=437,iocharset=iso8859-1,shortname=mixed,errors=remount-ro    0 2

# /dev/mapper/VolumeGroupArray-lvvar
UUID=d8be01a9-3f8a-4ad6-9bb3-0852edd70b0d       /var            ext4            rw,relatime,data=ordered        0 2

# /dev/mapper/VolumeGroupArray-lvhome
UUID=3a92ca90-2f21-44ee-859e-0a9ae3996016       /home           ext4            rw,relatime,data=ordered        0 2

# /dev/mapper/VolumeGroupArray-lvdata
UUID=c7035009-a3a5-4ebc-95e6-ab6bb63ab2ef       /data           ext4            rw,relatime,data=ordered        0 2

# /dev/mapper/VolumeGroupArray-lvswap
UUID=4d42f74d-b7e9-4cc0-a852-8f9f89fa00f9       none            swap            defaults        0 0

This failed to boot on the first couple tries then it worked once or twice for booting. (and I wasn't going to fix what aint broke smile ) However it has stopped working now. I have tried a few other things, most recently just mounting sda1 directly to boot. (as shown below) This is my fstab currently:

[root@archiso ###]# cat /etc/fstab
# /dev/mapper/VolumeGroupArray-lvroot
UUID=0e3a0ea6-255d-42e3-814b-0e00dcf79820       /               ext4            rw,relatime,data=ordered        0 1

# /dev/sda1 LABEL=L\134x20EFI
/dev/sda1                                       /boot           vfat            rw,relatime,fmask=0022,dmask=0022,codepage=437,iocharset=iso8859-1,shortname=mixed,errors=remount-ro    0 2

# /dev/mapper/VolumeGroupArray-lvvar
UUID=d8be01a9-3f8a-4ad6-9bb3-0852edd70b0d       /var            ext4            rw,relatime,data=ordered        0 2

# /dev/mapper/VolumeGroupArray-lvdata
UUID=c7035009-a3a5-4ebc-95e6-ab6bb63ab2ef       /data           ext4            rw,relatime,data=ordered        0 2

# /dev/mapper/VolumeGroupArray-lvhome
UUID=3a92ca90-2f21-44ee-859e-0a9ae3996016       /home           ext4            rw,relatime,data=ordered        0 2

# /dev/mapper/VolumeGroupArray-lvswap
UUID=f9ee0e3c-26bf-4ea3-a4a8-e3dcb6dbc53b       none            swap            defaults        0 0

I am currently running on a chroot "chroot /mnt /bin/bash" mounted with these scripts:
(this is after I mount root with "mount /dev/mapper/VolumeGroupArray-lvroot /mnt"

[###@archiso ~]$ cat /mount.sh 
#!/bin/bash
cd "$(dirname "$0")"
mount /dev/sda1 /mnt/boot

mount /dev/mapper/VolumeGroupArray-lvvar /mnt/var
mount /dev/mapper/VolumeGroupArray-lvdata /mnt/data
mount /dev/mapper/VolumeGroupArray-lvhome /mnt/home
swapon /dev/mapper/VolumeGroupArray-lvswap
[###@archiso ~]$ cat /chroot.sh 
#!/bin/bash

cd "$(dirname "$0")"
mount -t proc proc proc/
mount --rbind /sys sys/
mount --rbind /dev dev/
mount --rbind /run run/

Not many programs work while in the chroot but I can actually send myself emails with lynx so I can copy the info from the configuration files that are on my computer and the post to these forms with my tablet smile


I have added the following hooks and modules to /etc/mkinitcpio.conf

MODULES=(dm_mod raid1 ext4)
HOOKS=(base udev autodetect block modconf mdadm_udev lvm2 filesystems keyboard fsck)

I installed grub for uefi with this command will in the arch chroot (arch-chroot /mnt /bin/bash)

grub-install --target=x86_64-efi --efi-directory=/boot --bootloader-id=grub

I have tried adding rootdelay=20 to /etc/default/grub to make sure the file system I had time to boot. I've also installed microcode updates "pacman -S intel-ucode"  "grub-mkconfig -o /boot/grub/grub.cfg" yet I still get this error:

ERROR: device '/dev/mapper/VolumeGroupArray-lvroot' not found. Skipping fsck.
mount: /new_root: special device /dev/mapper/VolumeGroupArray-lvroot does not exist.
You are now being dropped into an emergency shell.
sh: can't access tty; job control turned off

The next thing I was going to try was renaming sdb1 so it didn't have the same UUID as sda1, and then the same for sdb2 with respect to sda2. However, I'm afraid this will screw up my raid1 array and I have some stuff stored on that I'm a little worried about loosing since I currently have two external backup hard drives that seem to be failing sad I seem to have had bad luck recently. (waiting for new hard drives to arrive) Please let me know what you think is wrong. Thanks.

Last edited by felixtheratruns (2017-12-08 06:19:34)

Offline

#2 2017-11-17 05:53:53

felixtheratruns
Member
Registered: 2016-12-04
Posts: 21

Re: [SOLVED] EFI GRUB with LVM on RAID1: cannot find rootfs works at first

Well I got it working. I do have a question though. If the /dev/sda1 boot partition fails (or the disk it is on fails) I would like to have it boot from one of the other boot partitions: /dev/sdb1 or /dev/sdc1 Ideally I would like to have it still boot from one if the other two fail. How would I best accomplish this? Could I use bind mounts to do this? I would like to keep this in this thread but if I'm yelled out enough or no one answers here I'll start a new thread. Thanks.

I think what might have been the problem with the setup in my previous post was that I didn't preload lvm in grub. Then because I had tried to bind mount both partitions to /boot it probably overwrote /boot with an older version of /boot (since I had tried installing a couple times) that didn't have lvm preloaded. Also I had "dm-mod" as "dm_mod" in the kernel modules section in my last post. (still not sure which one is right lol)  I really don't know what all was wrong.

So here's all that I remember of what I did:
I actually installed another harddrive (an old one I had because I got another power cable adapter for it) first I zeroed out the harddrives using commands in three terminals one for each (just to make sure I got rid of any RAID1 metadata or other nonsense that was causing problems) here's the command for the first hd:

dd if=/dev/zero | pv | dd of=/dev/sda

I then used a live usb of gparted to make a gpt partition table on all three HDs. This time I did not copy over the partitions to each one because I wanted to have different UUIDs for each partition.
I made 513Mib UEFI boot partitions on each HD setting the flags "boot" and "esp" on them: /dev/sda1 /dev/sdb1 /dev/sdc1
I made the rest of the HDs unformated partitions: /dev/sda2 /dev/sdb2 /dev/sdc2

I think booted with a live arch linux usb key and ran the following commands. I wish I had the forsight to save my history in a file on /mnt before I entered into the chroot. This very loosely follows: https://wiki.archlinux.org/index.php/So … ID_and_LVM

I made sure everything needed was loaded and updated:

modprobe raid1
modprobe dm-mod
pacman-db-upgrade
pacman -Syy

I created the raid1 array:

mdadm --create /dev/md0 --level=1 --raid-devices=3 /dev/sda2 /dev/sdb2 /dev/sdc2
pvcreate /dev/md0
vgcreate LVGA /dev/md0 #LVGA stands for logical volume group array

I created and formatted the logical volumes and setup swap:

lvcreate -L 20G LVGA -n lv_root
lvcreate -L 15G LVGA -n lv_var
lvcreate -L 20G LVGA -n lv_home
lvcreate -C y -L 16G LVGA -n lv_swap
lvcreate -l +100%FREE LVGA -n lv_data
mkfs.ext4 /dev/mapper/LVGA-lv_root
mkfs.ext4 /dev/mapper/LVGA-lv_var
mkfs.ext4 /dev/mapper/LVGA-lv_home
mkfs.ext4 /dev/mapper/LVGA-lv_data
mkswap /dev/mapper/LVGA-lv_swap
swapon /dev/mapper/LVGA-lv_swap

I mounted the root filesystem with:

mount /dev/mapper/LVGA-lv_root /mnt

then mounted the rest using this script:

#!/bin/bash
mkdir -p /mnt/esps/sda1
mkdir -p /mnt/esps/sdb1
mkdir -p /mnt/esps/sdc1

mount /dev/sda1 /mnt/esps/sda1
mount /dev/sdb1 /mnt/esps/sdb1
mount /dev/sdc1 /mnt/esps/sdc1

mkdir -p /mnt/boot
mount --bind /mnt/esps/sda1 /mnt/boot

mkdir -p /mnt/data
mkdir -p /mnt/home
mkdir -p /mnt/var

mount /dev/mapper/LVGA-lv_data /mnt/data
mount /dev/mapper/LVGA-lv_home /mnt/home
mount /dev/mapper/LVGA-lv_var /mnt/var

I generated fstab, and replaced the mount with a bind mount:
# /dev/sda1 LABEL=LBOOTA
/esps/sda1              /boot           none            defaults,bind                                           0 0

genfstab -U -p /mnt >> /mnt/etc/fstab
vi /mnt/etc/fstab

I  chrooted:

arch-chroot /mnt

Now my history starts smile  I won't post all the mistakes and unnecessary commands. I did some of the normal installation stuff set locales and keyboard layouts (editing files not shown if you care smile )

ln -sf /usr/share/zoneinfo/EST /etc/localtime 
 hwclock --systohc
vi /etc/locale.gen
locale-gen
vi /etc/vconsole.conf
vi /etc/hostname

setup the raid array config file:

mdadm --detail -scan > /etc/mdadm.conf

modified mkinitcpio.conf
added the following to modules:
dm-mod raid1 ext4

added the following hooks:
mdadm_udev lvm2

vi /etc/mkinitcpio.conf 
mkinitcpio -p linux

setup grub, added "lvm" to GRUB_PRELOAD_MODULES, installed microcode updates, etc
dealt with this error or warning (can't remember if it also had an error) https://unix.stackexchange.com/question … ub-problem
when I ran grub-mkconfig it said something like:
"WARNING: Failed to connect to lvmetad. Falling back to device scanning."
So I set use_lvmetad=0 in /etc/lvm/lvm.conf

pacman-db-upgrade 
pacman -Syy
pacman -S grub
pacman -S efibootmgr mtools 
grub-install --target=x86_64-efi --efi-directory=/boot --bootloader-id=hd_grub_efi
pacman -S intel-ucode
grub-mkconfig -o /boot/grub/grub.cfg
vi /etc/lvm/lvm.conf 
grub-mkconfig -o /boot/grub/grub.cfg
vi /etc/default/grub 
grub-mkconfig -o /boot/grub/grub.cfg
exit

So that's bassically it. Here's some data on my setup you might find useful:
Logical volumes look like this:
lvdisplay

  --- Logical volume ---
  LV Path                /dev/LVGA/lv_root
  LV Name                lv_root
  VG Name                LVGA
  LV UUID                623DBu-ytc4-pIbE-Wdkf-m2cy-23yh-0lHjuG
  LV Write Access        read/write
  LV Creation host, time archiso, 2017-11-16 21:30:09 -0500
  LV Status              available
  # open                 1
  LV Size                20.00 GiB
  Current LE             5120
  Segments               1
  Allocation             inherit
  Read ahead sectors     auto
  - currently set to     256
  Block device           254:0
   
  --- Logical volume ---
  LV Path                /dev/LVGA/lv_var
  LV Name                lv_var
  VG Name                LVGA
  LV UUID                16uKD1-fuGm-m09N-3ssT-MwmW-8UVX-mMRm8e
  LV Write Access        read/write
  LV Creation host, time archiso, 2017-11-16 21:30:59 -0500
  LV Status              available
  # open                 1
  LV Size                15.00 GiB
  Current LE             3840
  Segments               1
  Allocation             inherit
  Read ahead sectors     auto
  - currently set to     256
  Block device           254:1
   
  --- Logical volume ---
  LV Path                /dev/LVGA/lv_swap
  LV Name                lv_swap
  VG Name                LVGA
  LV UUID                AKOcgx-oKfe-uB5s-Asxk-RKds-IAgH-j3JQiW
  LV Write Access        read/write
  LV Creation host, time archiso, 2017-11-16 21:33:21 -0500
  LV Status              available
  # open                 2
  LV Size                16.00 GiB
  Current LE             4096
  Segments               1
  Allocation             contiguous
  Read ahead sectors     auto
  - currently set to     256
  Block device           254:2
   
  --- Logical volume ---
  LV Path                /dev/LVGA/lv_home
  LV Name                lv_home
  VG Name                LVGA
  LV UUID                8K1kxC-5DYd-9v30-RvJ8-NQxz-thDX-Bro0HH
  LV Write Access        read/write
  LV Creation host, time archiso, 2017-11-16 21:35:26 -0500
  LV Status              available
  # open                 1
  LV Size                15.00 GiB
  Current LE             3840
  Segments               1
  Allocation             inherit
  Read ahead sectors     auto
  - currently set to     256
  Block device           254:3
   
  --- Logical volume ---
  LV Path                /dev/LVGA/lv_data
  LV Name                lv_data
  VG Name                LVGA
  LV UUID                WjUeMF-D0xE-WE3o-BHXa-y1Jh-dlwg-IxuQ5y
  LV Write Access        read/write
  LV Creation host, time archiso, 2017-11-16 21:35:48 -0500
  LV Status              available
  # open                 1
  LV Size                399.13 GiB
  Current LE             102178
  Segments               1
  Allocation             inherit
  Read ahead sectors     auto
  - currently set to     256
  Block device           254:4

pvdisplay

  --- Physical volume ---
  PV Name               /dev/md0
  VG Name               LVGA
  PV Size               465.13 GiB / not usable 2.00 MiB
  Allocatable           yes (but full)
  PE Size               4.00 MiB
  Total PE              119074
  Free PE               0
  Allocated PE          119074
  PV UUID               YfEcn5-PL9n-zHNe-2Z00-TKx3-a63s-XHIpvl

vgdisplay

  --- Volume group ---
  VG Name               LVGA
  System ID             
  Format                lvm2
  Metadata Areas        1
  Metadata Sequence No  6
  VG Access             read/write
  VG Status             resizable
  MAX LV                0
  Cur LV                5
  Open LV               5
  Max PV                0
  Cur PV                1
  Act PV                1
  VG Size               465.13 GiB
  PE Size               4.00 MiB
  Total PE              119074
  Alloc PE / Size       119074 / 465.13 GiB
  Free  PE / Size       0 / 0   
  VG UUID               ibiwA1-Hcaa-jVNS-8yA9-fS5P-1Y9Z-tAlM5i

blkid

[###@MOO ~]$ sudo blkid
/dev/sda1: LABEL="LBOOTA" UUID="8BFD-FE2C" TYPE="vfat" PARTLABEL="BOOTA" PARTUUID="6d936fd8-cd01-4da9-a5c7-95ec30876a7a"
/dev/sda2: UUID="4f5f044b-773b-ecdd-211d-2b33fa24fe82" UUID_SUB="816ea8e4-1f1a-c95d-7ff4-d847a84a6291" LABEL="archiso:0" TYPE="linux_raid_member" PARTLABEL="RAIDA" PARTUUID="0aa77853-3e20-4aba-9b2c-e4849211da32"
/dev/sdb1: LABEL="LBOOTB" UUID="8C03-3099" TYPE="vfat" PARTLABEL="BOOTB" PARTUUID="b6e5527f-ba6c-4c54-bda4-140348e73392"
/dev/sdb2: UUID="4f5f044b-773b-ecdd-211d-2b33fa24fe82" UUID_SUB="d386b31e-e852-1573-e9cd-c90aa095be44" LABEL="archiso:0" TYPE="linux_raid_member" PARTLABEL="RAIDB" PARTUUID="652d9aa4-bd3e-462e-8c18-53504f0fe56f"
/dev/sdc1: LABEL="LBOOTC" UUID="8C07-B4A0" TYPE="vfat" PARTLABEL="BOOTC" PARTUUID="105fe05a-589a-4d3f-9deb-2c83ca064205"
/dev/sdc2: UUID="4f5f044b-773b-ecdd-211d-2b33fa24fe82" UUID_SUB="df3bc763-7d1b-68c4-9eb7-85af44d28308" LABEL="archiso:0" TYPE="linux_raid_member" PARTLABEL="RAIDC" PARTUUID="57eacfc0-2676-42be-bd81-1150392fd1bb"
/dev/md0: UUID="YfEcn5-PL9n-zHNe-2Z00-TKx3-a63s-XHIpvl" TYPE="LVM2_member"
/dev/mapper/LVGA-lv_root: UUID="ce78aa9e-8fba-4da7-8a7e-0f9bc877c6c8" TYPE="ext4"
/dev/mapper/LVGA-lv_var: UUID="76cbe1cf-6cce-499e-a5f6-6ed783a9c500" TYPE="ext4"
/dev/mapper/LVGA-lv_swap: UUID="afe777f0-a03e-4938-a9aa-183a4a390e73" TYPE="swap"
/dev/mapper/LVGA-lv_home: UUID="c9ecef6e-3c9e-4682-a8d3-f2042100203f" TYPE="ext4"
/dev/mapper/LVGA-lv_data: UUID="2d246ca4-a733-4408-a551-7cd48e7b4b26" TYPE="ext4"
/dev/sdd1: UUID="59dd7d2800000000" LABEL="GParted-live" TYPE="udf" PTUUID="2d876634" PTTYPE="dos" PARTUUID="2d876634-01"
/dev/sdd2: SEC_TYPE="msdos" LABEL="GParted-EFI" UUID="D28B-1E18" TYPE="vfat" PARTUUID="2d876634-02"
/dev/sde: LABEL="elements" UUID="5ea41b3b-7866-4d68-8312-222e9e3477cd" TYPE="ext4"
/dev/sdf1: UUID="2017-11-01-08-25-48-00" LABEL="ARCH_201711" TYPE="iso9660" PTUUID="5329baec" PTTYPE="dos" PARTUUID="5329baec-01"
/dev/sdf2: SEC_TYPE="msdos" LABEL="ARCHISO_EFI" UUID="4EB1-42C2" TYPE="vfat" PARTUUID="5329baec-02"

mdadm

[###@MOO ~]$ sudo mdadm --detail -scan
ARRAY /dev/md0 metadata=1.2 name=archiso:0 UUID=4f5f044b:773becdd:211d2b33:fa24fe82


/etc/mkinitcpio.conf

# vim:set ft=sh
# MODULES
# The following modules are loaded before any boot hooks are
# run.  Advanced users may wish to specify all system modules
# in this array.  For instance:
#     MODULES=(piix ide_disk reiserfs)
MODULES=(dm-mod raid1 ext4)

# BINARIES
# This setting includes any additional binaries a given user may
# wish into the CPIO image.  This is run last, so it may be used to
# override the actual binaries included by a given hook
# BINARIES are dependency parsed, so you may safely ignore libraries
BINARIES=()

# FILES
# This setting is similar to BINARIES above, however, files are added
# as-is and are not parsed in any way.  This is useful for config files.
FILES=()

# HOOKS
# This is the most important setting in this file.  The HOOKS control the
# modules and scripts added to the image, and what happens at boot time.
# Order is important, and it is recommended that you do not change the
# order in which HOOKS are added.  Run 'mkinitcpio -H <hook name>' for
# help on a given hook.
# 'base' is _required_ unless you know precisely what you are doing.
# 'udev' is _required_ in order to automatically load modules
# 'filesystems' is _required_ unless you specify your fs modules in MODULES
# Examples:
##   This setup specifies all modules in the MODULES setting above.
##   No raid, lvm2, or encrypted root is needed.
#    HOOKS=(base)
#
##   This setup will autodetect all modules for your system and should
##   work as a sane default
#    HOOKS=(base udev autodetect block filesystems)
#
##   This setup will generate a 'full' image which supports most systems.
##   No autodetection is done.
#    HOOKS=(base udev block filesystems)
#
##   This setup assembles a pata mdadm array with an encrypted root FS.
##   Note: See 'mkinitcpio -H mdadm' for more information on raid devices.
#    HOOKS=(base udev block mdadm encrypt filesystems)
#
##   This setup loads an lvm2 volume group on a usb device.
#    HOOKS=(base udev block lvm2 filesystems)
#
##   NOTE: If you have /usr on a separate partition, you MUST include the
#    usr, fsck and shutdown hooks.
HOOKS=(base udev autodetect modconf block mdadm_udev lvm2 filesystems keyboard fsck)

# COMPRESSION
# Use this to compress the initramfs image. By default, gzip compression
# is used. Use 'cat' to create an uncompressed image.
#COMPRESSION="gzip"
#COMPRESSION="bzip2"
#COMPRESSION="lzma"
#COMPRESSION="xz"
#COMPRESSION="lzop"
#COMPRESSION="lz4"

# COMPRESSION_OPTIONS
# Additional options for the compressor
#COMPRESSION_OPTIONS=()

grub with lvm preloaded (all I did was add "lvm" after "part_msdos")
/etc/default/grub

# GRUB boot loader configuration

GRUB_DEFAULT=0
GRUB_TIMEOUT=5
GRUB_DISTRIBUTOR="Arch"
GRUB_CMDLINE_LINUX_DEFAULT="quiet"
GRUB_CMDLINE_LINUX=""

# Preload both GPT and MBR modules so that they are not missed
GRUB_PRELOAD_MODULES="part_gpt part_msdos lvm"

# Uncomment to enable booting from LUKS encrypted devices
#GRUB_ENABLE_CRYPTODISK=y

# Uncomment to enable Hidden Menu, and optionally hide the timeout count
#GRUB_HIDDEN_TIMEOUT=5
#GRUB_HIDDEN_TIMEOUT_QUIET=true

# Uncomment to use basic console
GRUB_TERMINAL_INPUT=console

# Uncomment to disable graphical terminal
#GRUB_TERMINAL_OUTPUT=console

# The resolution used on graphical terminal
# note that you can use only modes which your graphic card supports via VBE
# you can see them in real GRUB with the command `vbeinfo'
GRUB_GFXMODE=auto

# Uncomment to allow the kernel use the same resolution used by grub
GRUB_GFXPAYLOAD_LINUX=keep

# Uncomment if you want GRUB to pass to the Linux kernel the old parameter
# format "root=/dev/xxx" instead of "root=/dev/disk/by-uuid/xxx"
#GRUB_DISABLE_LINUX_UUID=true

# Uncomment to disable generation of recovery mode menu entries
GRUB_DISABLE_RECOVERY=true

# Uncomment and set to the desired menu colors.  Used by normal and wallpaper
# modes only.  Entries specified as foreground/background.
#GRUB_COLOR_NORMAL="light-blue/black"
#GRUB_COLOR_HIGHLIGHT="light-cyan/blue"

# Uncomment one of them for the gfx desired, a image background or a gfxtheme
#GRUB_BACKGROUND="/path/to/wallpaper"
#GRUB_THEME="/path/to/gfxtheme"

# Uncomment to get a beep at GRUB start
#GRUB_INIT_TUNE="480 440 1"

# Uncomment to make GRUB remember the last selection. This requires to
# set 'GRUB_DEFAULT=saved' above.
#GRUB_SAVEDEFAULT="true"

/etc/fstab:

# 
# /etc/fstab: static file system information
#
# <file system> <dir>   <type>  <options>       <dump>  <pass>
# /dev/mapper/LVGA-lv_root
UUID=ce78aa9e-8fba-4da7-8a7e-0f9bc877c6c8       /               ext4            rw,relatime,data=ordered        0 1

# /dev/sda1 LABEL=LBOOTA
UUID=8BFD-FE2C          /esps/sda1      vfat            rw,relatime,fmask=0022,dmask=0022,codepage=437,iocharset=iso8859-1,shortname=mixed,errors=remount-ro        0 2

# /dev/sdb1 LABEL=LBOOTB
UUID=8C03-3099          /esps/sdb1      vfat            rw,relatime,fmask=0022,dmask=0022,codepage=437,iocharset=iso8859-1,shortname=mixed,errors=remount-ro        0 2

# /dev/sdc1 LABEL=LBOOTC
UUID=8C07-B4A0          /esps/sdc1      vfat            rw,relatime,fmask=0022,dmask=0022,codepage=437,iocharset=iso8859-1,shortname=mixed,errors=remount-ro        0 2

# /dev/sda1 LABEL=LBOOTA
/esps/sda1              /boot           none            defaults,bind                                           0 0

# /dev/mapper/LVGA-lv_data
UUID=2d246ca4-a733-4408-a551-7cd48e7b4b26       /data           ext4            rw,relatime,data=ordered        0 2

# /dev/mapper/LVGA-lv_home
UUID=c9ecef6e-3c9e-4682-a8d3-f2042100203f       /home           ext4            rw,relatime,data=ordered        0 2

# /dev/mapper/LVGA-lv_var
UUID=76cbe1cf-6cce-499e-a5f6-6ed783a9c500       /var            ext4            rw,relatime,data=ordered        0 2

# /dev/mapper/LVGA-lv_swap
UUID=afe777f0-a03e-4938-a9aa-183a4a390e73       none            swap            defaults        0 0

Last edited by felixtheratruns (2017-12-08 06:18:55)

Offline

#3 2017-11-17 05:59:35

jasonwryan
Anarchist
From: .nz
Registered: 2009-05-09
Posts: 30,424
Website

Re: [SOLVED] EFI GRUB with LVM on RAID1: cannot find rootfs works at first

I didn't read most of your post, but one of the key benefits of RAID is installing your bootloader/manager to all of the drives, so that when one fails you can still boot.


Arch + dwm   •   Mercurial repos  •   Surfraw

Registered Linux User #482438

Offline

#4 2017-11-17 06:19:41

felixtheratruns
Member
Registered: 2016-12-04
Posts: 21

Re: [SOLVED] EFI GRUB with LVM on RAID1: cannot find rootfs works at first

@jasonwryan I guess I could put the boot partitions: /dev/sda1 /dev/sdb1 /dev/sdc1 in another RAID1 array using metadata 1.0 and systemd-boot. (since I wanted to try out UEFI) However, there are some additional steps and risks to this: https://wiki.archlinux.org/index.php/EF … SP_on_RAID so I was hoping there was another more simple way to do this, maybe with bind mounts or GRUB settings, so that if the boot partition failed it would select another boot partition. Feel free to tell me if I'm not thinking straight here. The closest thing I can think of to working is setting up a cron job that copied everything from the active boot partition to the other boot partitions after you booted, so if it failed, you could just select anouther boot partition after you pressed the appropriate key to get into the bios/uefi boot-order menu at startup. However it seems to me you would also have to modify the fstab, so there would still be two steps needed.

Last edited by felixtheratruns (2017-11-17 06:23:23)

Offline

#5 2017-11-17 14:25:37

felixtheratruns
Member
Registered: 2016-12-04
Posts: 21

Re: [SOLVED] EFI GRUB with LVM on RAID1: cannot find rootfs works at first

Well scratch all that sad It stopped working the second time I booted it up. It gets the same error:

ERROR: device '/dev/mapper/LVGA-lv_root' not found. Skipping fsck.
mount: /new_root: special device /dev/mapper/LVGA-lv_root does not exist.
You are being dropped into an emergency shell.
sh: can't access tty; job control turned off
[rootfs ]#

I can't think of anything that I did that would have changed the booting (except maybe a package I installed recompiled the kernel)
I'm wondering if it is a problem with uefi booting on my computer. I had a usb key that I made bootable and persistent with arch and grub and I had a similar problem (it would randomly stop working)

I also tried booting again and tried to select the fallback initramfs. However my keyboard sometimes doesn't work on startup, so grub selected the default boot option again and I had to reboot again to select the fallback (not sure if that makes a difference) Anyways it got the same error (show in code block above)

Last edited by felixtheratruns (2017-11-17 14:32:26)

Offline

#6 2017-11-17 14:46:08

frostschutz
Member
Registered: 2013-11-15
Posts: 1,409

Re: [SOLVED] EFI GRUB with LVM on RAID1: cannot find rootfs works at first

felixtheratruns wrote:

@jasonwryan I guess I could put the boot partitions: /dev/sda1 /dev/sdb1 /dev/sdc1 in another RAID1 array using metadata 1.0

This is a very common approach (EDIT: sorry, for /boot outside of EFI, I guess). You'll probably find guides doing this with 0.90 metadata, but 1.0 works just as well, they are both located at the end, so to the non-raid-aware bootloader it will look like a regular filesystem. As long as the bootloaders use it read-only there is no issue.

Do you have a `dmesg` and `cat /proc/mdstat` of when you end up in initramfs like that? Sorry if I missed it.

Last edited by frostschutz (2017-11-17 14:50:51)

Offline

#7 2017-11-17 15:30:15

felixtheratruns
Member
Registered: 2016-12-04
Posts: 21

Re: [SOLVED] EFI GRUB with LVM on RAID1: cannot find rootfs works at first

@frostschutz after the "ERROR: device '/dev/mapper/LVGA-lv_root' not found. Skipping fsck. . ." ?

Here's the output of cat /proc/mdstat:

md0 : active raid1 sdc2[2] sda2[2] sdb2[1]
           487729152 blocks super 1.2 [3/3] [UUU]
           bitmap: 0/4 pages [0KB], 65536KB chunk

unused devices: <none>

second time I copied mdstat it looks slightly different:

Personalities : [raid1]
md0 : active raid1 sdb2[1] sdc2[2] sda2[0]
      487729152 blocks super 1.2 [3/3] [UUU]
      bitmap: 0/4 pages [0KB], 65536KB chunk

unused devices: <none>

EDIT: here  is dmesg, as you can see I have several usb devices plugged in and I mounted an external harddrive (sde) at the end to save this file:

[    0.000000] microcode: microcode updated early to revision 0x22, date = 2017-01-27
[    0.000000] random: get_random_bytes called from start_kernel+0x42/0x4b7 with crng_init=0
[    0.000000] Linux version 4.13.12-1-ARCH (builduser@tobias) (gcc version 7.2.0 (GCC)) #1 SMP PREEMPT Wed Nov 8 11:54:06 CET 2017
[    0.000000] Command line: BOOT_IMAGE=/vmlinuz-linux root=/dev/mapper/LVGA-lv_root rw quiet rootdelay=15
[    0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[    0.000000] x86/fpu: xstate_offset[2]:  576, xstate_sizes[2]:  256
[    0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format.
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x0000000000057fff] usable
[    0.000000] BIOS-e820: [mem 0x0000000000058000-0x0000000000058fff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000059000-0x000000000009efff] usable
[    0.000000] BIOS-e820: [mem 0x000000000009f000-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000ac65dfff] usable
[    0.000000] BIOS-e820: [mem 0x00000000ac65e000-0x00000000ac664fff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000ac665000-0x00000000ad2f9fff] usable
[    0.000000] BIOS-e820: [mem 0x00000000ad2fa000-0x00000000ad7befff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ad7bf000-0x00000000bdad3fff] usable
[    0.000000] BIOS-e820: [mem 0x00000000bdad4000-0x00000000bdb3afff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000bdb3b000-0x00000000bdb80fff] usable
[    0.000000] BIOS-e820: [mem 0x00000000bdb81000-0x00000000bdcb8fff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bdcb9000-0x00000000bdf7bfff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000bdf7c000-0x00000000bdffefff] type 20
[    0.000000] BIOS-e820: [mem 0x00000000bdfff000-0x00000000bdffffff] usable
[    0.000000] BIOS-e820: [mem 0x00000000bf000000-0x00000000cf1fffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000f0000000-0x00000000f7ffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed00000-0x00000000fed03fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000042edfffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] efi: EFI v2.31 by American Megatrends
[    0.000000] efi:  ACPI=0xbdc85000  ACPI 2.0=0xbdc85000  SMBIOS=0xf04d0  MPS=0xfce90 
[    0.000000] random: fast init done
[    0.000000] SMBIOS 2.8 present.
[    0.000000] DMI: To Be Filled By O.E.M. To Be Filled By O.E.M./H97M Pro4, BIOS P2.10 06/13/2016
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.000000] e820: last_pfn = 0x42ee00 max_arch_pfn = 0x400000000
[    0.000000] MTRR default type: uncachable
[    0.000000] MTRR fixed ranges enabled:
[    0.000000]   00000-9FFFF write-back
[    0.000000]   A0000-BFFFF uncachable
[    0.000000]   C0000-CFFFF write-protect
[    0.000000]   D0000-DFFFF uncachable
[    0.000000]   E0000-FFFFF write-protect
[    0.000000] MTRR variable ranges enabled:
[    0.000000]   0 base 0000000000 mask 7C00000000 write-back
[    0.000000]   1 base 0400000000 mask 7FE0000000 write-back
[    0.000000]   2 base 0420000000 mask 7FF0000000 write-back
[    0.000000]   3 base 00C0000000 mask 7FC0000000 uncachable
[    0.000000]   4 base 00BF000000 mask 7FFF000000 uncachable
[    0.000000]   5 base 042F000000 mask 7FFF000000 uncachable
[    0.000000]   6 base 042EE00000 mask 7FFFE00000 uncachable
[    0.000000]   7 disabled
[    0.000000]   8 disabled
[    0.000000]   9 disabled
[    0.000000] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WC  UC- WT  
[    0.000000] e820: update [mem 0xbf000000-0xffffffff] usable ==> reserved
[    0.000000] e820: last_pfn = 0xbe000 max_arch_pfn = 0x400000000
[    0.000000] found SMP MP-table at [mem 0x000fd1a0-0x000fd1af] mapped at [ffff9895400fd1a0]
[    0.000000] Scanning 1 areas for low memory corruption
[    0.000000] Base memory trampoline at [ffff989540097000] 97000 size 24576
[    0.000000] Using GB pages for direct mapping
[    0.000000] BRK [0x387d64000, 0x387d64fff] PGTABLE
[    0.000000] BRK [0x387d65000, 0x387d65fff] PGTABLE
[    0.000000] BRK [0x387d66000, 0x387d66fff] PGTABLE
[    0.000000] BRK [0x387d67000, 0x387d67fff] PGTABLE
[    0.000000] BRK [0x387d68000, 0x387d68fff] PGTABLE
[    0.000000] BRK [0x387d69000, 0x387d69fff] PGTABLE
[    0.000000] BRK [0x387d6a000, 0x387d6afff] PGTABLE
[    0.000000] BRK [0x387d6b000, 0x387d6bfff] PGTABLE
[    0.000000] BRK [0x387d6c000, 0x387d6cfff] PGTABLE
[    0.000000] BRK [0x387d6d000, 0x387d6dfff] PGTABLE
[    0.000000] BRK [0x387d6e000, 0x387d6efff] PGTABLE
[    0.000000] Secure boot could not be determined
[    0.000000] RAMDISK: [mem 0x364a7000-0x3724afff]
[    0.000000] ACPI: Early table checksum verification disabled
[    0.000000] ACPI: RSDP 0x00000000BDC85000 000024 (v02 ALASKA)
[    0.000000] ACPI: XSDT 0x00000000BDC85088 000094 (v01 ALASKA A M I    01072009 AMI  00010013)
[    0.000000] ACPI: FACP 0x00000000BDC96340 00010C (v05 ALASKA A M I    01072009 AMI  00010013)
[    0.000000] ACPI: DSDT 0x00000000BDC851B8 011187 (v02 ALASKA A M I    00000210 INTL 20120711)
[    0.000000] ACPI: FACS 0x00000000BDCB8F80 000040
[    0.000000] ACPI: APIC 0x00000000BDC96450 000072 (v03 ALASKA A M I    01072009 AMI  00010013)
[    0.000000] ACPI: FPDT 0x00000000BDC964C8 000044 (v01 ALASKA A M I    01072009 AMI  00010013)
[    0.000000] ACPI: SSDT 0x00000000BDC96510 000539 (v01 PmRef  Cpu0Ist  00003000 INTL 20051117)
[    0.000000] ACPI: SSDT 0x00000000BDC96A50 000B74 (v01 CpuRef CpuSsdt  00003000 INTL 20051117)
[    0.000000] ACPI: MCFG 0x00000000BDC975C8 00003C (v01 ALASKA A M I    01072009 MSFT 00000097)
[    0.000000] ACPI: HPET 0x00000000BDC97608 000038 (v01 ALASKA A M I    01072009 AMI. 00000005)
[    0.000000] ACPI: SSDT 0x00000000BDC97640 00036D (v01 SataRe SataTabl 00001000 INTL 20120711)
[    0.000000] ACPI: SSDT 0x00000000BDC979B0 005B5E (v01 SaSsdt SaSsdt   00003000 INTL 20120711)
[    0.000000] ACPI: ASF! 0x00000000BDC9D510 0000A5 (v32 INTEL   HCG     00000001 TFSM 000F4240)
[    0.000000] ACPI: AAFT 0x00000000BDC9D5B8 0004AF (v01 ALASKA OEMAAFT  01072009 MSFT 00000097)
[    0.000000] ACPI: UEFI 0x00000000BDC9DA68 000042 (v01 ALASKA A M I    01072009      00000000)
[    0.000000] ACPI: BGRT 0x00000000BDC9DAB0 000038 (v00 ALASKA A M I    01072009 AMI  00010013)
[    0.000000] ACPI: SSDT 0x00000000BDC9DAE8 000579 (v01 Intel_ IsctTabl 00001000 INTL 20120711)
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] No NUMA configuration found
[    0.000000] Faking a node at [mem 0x0000000000000000-0x000000042edfffff]
[    0.000000] NODE_DATA(0) allocated [mem 0x42edfb000-0x42edfffff]
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[    0.000000]   DMA32    [mem 0x0000000001000000-0x00000000ffffffff]
[    0.000000]   Normal   [mem 0x0000000100000000-0x000000042edfffff]
[    0.000000]   Device   empty
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000001000-0x0000000000057fff]
[    0.000000]   node   0: [mem 0x0000000000059000-0x000000000009efff]
[    0.000000]   node   0: [mem 0x0000000000100000-0x00000000ac65dfff]
[    0.000000]   node   0: [mem 0x00000000ac665000-0x00000000ad2f9fff]
[    0.000000]   node   0: [mem 0x00000000ad7bf000-0x00000000bdad3fff]
[    0.000000]   node   0: [mem 0x00000000bdb3b000-0x00000000bdb80fff]
[    0.000000]   node   0: [mem 0x00000000bdfff000-0x00000000bdffffff]
[    0.000000]   node   0: [mem 0x0000000100000000-0x000000042edfffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000042edfffff]
[    0.000000] On node 0 totalpages: 4113388
[    0.000000]   DMA zone: 64 pages used for memmap
[    0.000000]   DMA zone: 25 pages reserved
[    0.000000]   DMA zone: 3997 pages, LIFO batch:0
[    0.000000]   DMA32 zone: 12058 pages used for memmap
[    0.000000]   DMA32 zone: 771663 pages, LIFO batch:31
[    0.000000]   Normal zone: 52152 pages used for memmap
[    0.000000]   Normal zone: 3337728 pages, LIFO batch:31
[    0.000000] Reserving Intel graphics memory at 0x00000000bf200000-0x00000000cf1fffff
[    0.000000] ACPI: PM-Timer IO Port: 0x1808
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1])
[    0.000000] IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] ACPI: IRQ0 used by override.
[    0.000000] ACPI: IRQ9 used by override.
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[    0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs
[    0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
[    0.000000] PM: Registered nosave memory: [mem 0x00058000-0x00058fff]
[    0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000fffff]
[    0.000000] PM: Registered nosave memory: [mem 0xac65e000-0xac664fff]
[    0.000000] PM: Registered nosave memory: [mem 0xad2fa000-0xad7befff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdad4000-0xbdb3afff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdb81000-0xbdcb8fff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdcb9000-0xbdf7bfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdf7c000-0xbdffefff]
[    0.000000] PM: Registered nosave memory: [mem 0xbe000000-0xbeffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xbf000000-0xcf1fffff]
[    0.000000] PM: Registered nosave memory: [mem 0xcf200000-0xefffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xf0000000-0xf7ffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xf8000000-0xfebfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec00000-0xfec00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec01000-0xfecfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed00000-0xfed03fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed04000-0xfed1bfff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed20000-0xfedfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee00000-0xfee00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee01000-0xfeffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xff000000-0xffffffff]
[    0.000000] e820: [mem 0xcf200000-0xefffffff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on bare hardware
[    0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 6370452778343963 ns
[    0.000000] setup_percpu: NR_CPUS:128 nr_cpumask_bits:128 nr_cpu_ids:4 nr_node_ids:1
[    0.000000] percpu: Embedded 36 pages/cpu @ffff98996ea00000 s106520 r8192 d32744 u524288
[    0.000000] pcpu-alloc: s106520 r8192 d32744 u524288 alloc=1*2097152
[    0.000000] pcpu-alloc: [0] 0 1 2 3 
[    0.000000] Built 1 zonelists in Node order, mobility grouping on.  Total pages: 4049089
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: BOOT_IMAGE=/vmlinuz-linux root=/dev/mapper/LVGA-lv_root rw quiet rootdelay=15
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] Calgary: detecting Calgary via BIOS EBDA area
[    0.000000] Calgary: Unable to locate Rio Grande table in EBDA - bailing!
[    0.000000] Memory: 15877028K/16453552K available (6644K kernel code, 1134K rwdata, 2048K rodata, 1336K init, 908K bss, 576524K reserved, 0K cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
[    0.000000] ftrace: allocating 28354 entries in 111 pages
[    0.000000] Preemptible hierarchical RCU implementation.
[    0.000000] 	RCU restricting CPUs from NR_CPUS=128 to nr_cpu_ids=4.
[    0.000000] 	Tasks RCU enabled.
[    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
[    0.000000] NR_IRQS: 8448, nr_irqs: 456, preallocated irqs: 16
[    0.000000] Console: colour dummy device 80x25
[    0.000000] console [tty0] enabled
[    0.000000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns
[    0.000000] hpet clockevent registered
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.003333] spurious 8259A interrupt: IRQ7.
[    0.003333] tsc: Detected 3498.947 MHz processor
[    0.003333] Calibrating delay loop (skipped), value calculated using timer frequency.. 7000.47 BogoMIPS (lpj=11663156)
[    0.003333] pid_max: default: 32768 minimum: 301
[    0.003333] ACPI: Core revision 20170531
[    0.014748] ACPI: 6 ACPI AML tables successfully acquired and loaded
[    0.015196] Security Framework initialized
[    0.015197] Yama: becoming mindful.
[    0.017315] Dentry cache hash table entries: 2097152 (order: 12, 16777216 bytes)
[    0.018373] Inode-cache hash table entries: 1048576 (order: 11, 8388608 bytes)
[    0.018418] Mount-cache hash table entries: 32768 (order: 6, 262144 bytes)
[    0.018452] Mountpoint-cache hash table entries: 32768 (order: 6, 262144 bytes)
[    0.018583] CPU: Physical Processor ID: 0
[    0.018584] CPU: Processor Core ID: 0
[    0.018589] mce: CPU supports 9 MCE banks
[    0.018596] CPU0: Thermal monitoring enabled (TM1)
[    0.018606] process: using mwait in idle threads
[    0.018608] Last level iTLB entries: 4KB 1024, 2MB 1024, 4MB 1024
[    0.018608] Last level dTLB entries: 4KB 1024, 2MB 1024, 4MB 1024, 1GB 4
[    0.018744] Freeing SMP alternatives memory: 24K
[    0.022829] smpboot: Max logical packages: 1
[    0.022896] x2apic: IRQ remapping doesn't support X2APIC mode
[    0.023243] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=0 pin2=0
[    0.056255] TSC deadline timer enabled
[    0.056257] smpboot: CPU0: Intel(R) Core(TM) i5-4690K CPU @ 3.50GHz (family: 0x6, model: 0x3c, stepping: 0x3)
[    0.066683] Performance Events: PEBS fmt2+, Haswell events, 16-deep LBR, full-width counters, Intel PMU driver.
[    0.066707] ... version:                3
[    0.066707] ... bit width:              48
[    0.066708] ... generic registers:      8
[    0.066708] ... value mask:             0000ffffffffffff
[    0.066708] ... max period:             00007fffffffffff
[    0.066709] ... fixed-purpose events:   3
[    0.066709] ... event mask:             00000007000000ff
[    0.073348] Hierarchical SRCU implementation.
[    0.086729] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
[    0.093347] smp: Bringing up secondary CPUs ...
[    0.120020] x86: Booting SMP configuration:
[    0.120021] .... node  #0, CPUs:      #1 #2 #3
[    0.423349] smp: Brought up 1 node, 4 CPUs
[    0.423349] smpboot: Total of 4 processors activated (28006.01 BogoMIPS)
[    0.425856] devtmpfs: initialized
[    0.425856] x86/mm: Memory block size: 128MB
[    0.426690] PM: Registering ACPI NVS region [mem 0xac65e000-0xac664fff] (28672 bytes)
[    0.426690] PM: Registering ACPI NVS region [mem 0xbdb81000-0xbdcb8fff] (1277952 bytes)
[    0.426720] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 6370867519511994 ns
[    0.426726] futex hash table entries: 1024 (order: 4, 65536 bytes)
[    0.426758] pinctrl core: initialized pinctrl subsystem
[    0.426786] RTC time: 16:14:34, date: 11/17/17
[    0.426833] NET: Registered protocol family 16
[    0.430004] cpuidle: using governor ladder
[    0.430006] cpuidle: using governor menu
[    0.430006] PCCT header not found.
[    0.430030] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    0.430031] ACPI: bus type PCI registered
[    0.430032] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    0.430077] PCI: MMCONFIG for domain 0000 [bus 00-7f] at [mem 0xf0000000-0xf7ffffff] (base 0xf0000000)
[    0.430079] PCI: MMCONFIG at [mem 0xf0000000-0xf7ffffff] reserved in E820
[    0.430082] pmd_set_huge: Cannot satisfy [mem 0xf0000000-0xf0200000] with a huge-page mapping due to MTRR override.
[    0.430169] PCI: Using configuration type 1 for base access
[    0.430182] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
[    0.430182] core: PMU erratum BJ122, BV98, HSD29 workaround disabled, HT off
[    0.430506] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages
[    0.430506] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[    0.430506] ACPI: Added _OSI(Module Device)
[    0.430506] ACPI: Added _OSI(Processor Device)
[    0.430506] ACPI: Added _OSI(3.0 _SCP Extensions)
[    0.430506] ACPI: Added _OSI(Processor Aggregator Device)
[    0.430506] ACPI: Executed 15 blocks of module-level executable AML code
[    0.435478] ACPI: Dynamic OEM Table Load:
[    0.435482] ACPI: SSDT 0xFFFF98995C54CC00 0003D3 (v01 PmRef  Cpu0Cst  00003001 INTL 20051117)
[    0.435705] ACPI: Dynamic OEM Table Load:
[    0.435707] ACPI: SSDT 0xFFFF98995C555000 0005AA (v01 PmRef  ApIst    00003000 INTL 20051117)
[    0.435954] ACPI: Dynamic OEM Table Load:
[    0.435956] ACPI: SSDT 0xFFFF98995C558000 000119 (v01 PmRef  ApCst    00003000 INTL 20051117)
[    0.437205] ACPI: Interpreter enabled
[    0.437230] ACPI: (supports S0 S3 S4 S5)
[    0.437230] ACPI: Using IOAPIC for interrupt routing
[    0.437272] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    0.438150] ACPI: Power Resource [PG00] (on)
[    0.438398] ACPI: Power Resource [PG01] (on)
[    0.438641] ACPI: Power Resource [PG02] (on)
[    0.448263] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
[    0.448267] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    0.448424] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug PME]
[    0.448524] acpi PNP0A08:00: _OSC: OS now controls [AER PCIeCapability]
[    0.448525] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    0.448805] PCI host bridge to bus 0000:00
[    0.448807] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7 window]
[    0.448808] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff window]
[    0.448808] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    0.448809] pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000d3fff window]
[    0.448810] pci_bus 0000:00: root bus resource [mem 0x000d4000-0x000d7fff window]
[    0.448811] pci_bus 0000:00: root bus resource [mem 0x000d8000-0x000dbfff window]
[    0.448811] pci_bus 0000:00: root bus resource [mem 0x000dc000-0x000dffff window]
[    0.448812] pci_bus 0000:00: root bus resource [mem 0xcf200000-0xfeafffff window]
[    0.448813] pci_bus 0000:00: root bus resource [bus 00-7e]
[    0.448818] pci 0000:00:00.0: [8086:0c00] type 00 class 0x060000
[    0.448881] pci 0000:00:02.0: [8086:0412] type 00 class 0x030000
[    0.448888] pci 0000:00:02.0: reg 0x10: [mem 0xef800000-0xefbfffff 64bit]
[    0.448892] pci 0000:00:02.0: reg 0x18: [mem 0xd0000000-0xdfffffff 64bit pref]
[    0.448895] pci 0000:00:02.0: reg 0x20: [io  0xf000-0xf03f]
[    0.448951] pci 0000:00:03.0: [8086:0c0c] type 00 class 0x040300
[    0.448957] pci 0000:00:03.0: reg 0x10: [mem 0xeff34000-0xeff37fff 64bit]
[    0.449029] pci 0000:00:14.0: [8086:8cb1] type 00 class 0x0c0330
[    0.449046] pci 0000:00:14.0: reg 0x10: [mem 0xeff20000-0xeff2ffff 64bit]
[    0.449094] pci 0000:00:14.0: PME# supported from D3hot D3cold
[    0.449145] pci 0000:00:16.0: [8086:8cba] type 00 class 0x078000
[    0.449162] pci 0000:00:16.0: reg 0x10: [mem 0xeff3f000-0xeff3f00f 64bit]
[    0.449214] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold
[    0.449278] pci 0000:00:19.0: [8086:15a1] type 00 class 0x020000
[    0.449293] pci 0000:00:19.0: reg 0x10: [mem 0xeff00000-0xeff1ffff]
[    0.449299] pci 0000:00:19.0: reg 0x14: [mem 0xeff3c000-0xeff3cfff]
[    0.449305] pci 0000:00:19.0: reg 0x18: [io  0xf080-0xf09f]
[    0.449352] pci 0000:00:19.0: PME# supported from D0 D3hot D3cold
[    0.449405] pci 0000:00:1a.0: [8086:8cad] type 00 class 0x0c0320
[    0.449422] pci 0000:00:1a.0: reg 0x10: [mem 0xeff3b000-0xeff3b3ff]
[    0.449491] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold
[    0.449545] pci 0000:00:1b.0: [8086:8ca0] type 00 class 0x040300
[    0.449559] pci 0000:00:1b.0: reg 0x10: [mem 0xeff30000-0xeff33fff 64bit]
[    0.449609] pci 0000:00:1b.0: PME# supported from D0 D3hot D3cold
[    0.449661] pci 0000:00:1c.0: [8086:8c90] type 01 class 0x060400
[    0.449718] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
[    0.449797] pci 0000:00:1c.3: [8086:244e] type 01 class 0x060401
[    0.449854] pci 0000:00:1c.3: PME# supported from D0 D3hot D3cold
[    0.449930] pci 0000:00:1c.4: [8086:8c98] type 01 class 0x060400
[    0.449986] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold
[    0.450067] pci 0000:00:1d.0: [8086:8ca6] type 00 class 0x0c0320
[    0.450085] pci 0000:00:1d.0: reg 0x10: [mem 0xeff3a000-0xeff3a3ff]
[    0.450155] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold
[    0.450209] pci 0000:00:1f.0: [8086:8cc6] type 00 class 0x060100
[    0.450348] pci 0000:00:1f.2: [8086:8c82] type 00 class 0x010601
[    0.450360] pci 0000:00:1f.2: reg 0x10: [io  0xf0d0-0xf0d7]
[    0.450366] pci 0000:00:1f.2: reg 0x14: [io  0xf0c0-0xf0c3]
[    0.450371] pci 0000:00:1f.2: reg 0x18: [io  0xf0b0-0xf0b7]
[    0.450376] pci 0000:00:1f.2: reg 0x1c: [io  0xf0a0-0xf0a3]
[    0.450381] pci 0000:00:1f.2: reg 0x20: [io  0xf060-0xf07f]
[    0.450387] pci 0000:00:1f.2: reg 0x24: [mem 0xeff39000-0xeff397ff]
[    0.450415] pci 0000:00:1f.2: PME# supported from D3hot
[    0.450462] pci 0000:00:1f.3: [8086:8ca2] type 00 class 0x0c0500
[    0.450476] pci 0000:00:1f.3: reg 0x10: [mem 0xeff38000-0xeff380ff 64bit]
[    0.450492] pci 0000:00:1f.3: reg 0x20: [io  0xf040-0xf05f]
[    0.450604] acpiphp: Slot [1] registered
[    0.450607] pci 0000:00:1c.0: PCI bridge to [bus 01]
[    0.450675] pci 0000:02:00.0: [1b21:1080] type 01 class 0x060401
[    0.450801] pci 0000:00:1c.3: PCI bridge to [bus 02-03] (subtractive decode)
[    0.450808] pci 0000:00:1c.3:   bridge window [io  0x0000-0x0cf7 window] (subtractive decode)
[    0.450809] pci 0000:00:1c.3:   bridge window [io  0x0d00-0xffff window] (subtractive decode)
[    0.450810] pci 0000:00:1c.3:   bridge window [mem 0x000a0000-0x000bffff window] (subtractive decode)
[    0.450810] pci 0000:00:1c.3:   bridge window [mem 0x000d0000-0x000d3fff window] (subtractive decode)
[    0.450811] pci 0000:00:1c.3:   bridge window [mem 0x000d4000-0x000d7fff window] (subtractive decode)
[    0.450812] pci 0000:00:1c.3:   bridge window [mem 0x000d8000-0x000dbfff window] (subtractive decode)
[    0.450813] pci 0000:00:1c.3:   bridge window [mem 0x000dc000-0x000dffff window] (subtractive decode)
[    0.450814] pci 0000:00:1c.3:   bridge window [mem 0xcf200000-0xfeafffff window] (subtractive decode)
[    0.450899] pci 0000:02:00.0: PCI bridge to [bus 03] (subtractive decode)
[    0.450915] pci 0000:02:00.0:   bridge window [io  0x0000-0x0cf7 window] (subtractive decode)
[    0.450916] pci 0000:02:00.0:   bridge window [io  0x0d00-0xffff window] (subtractive decode)
[    0.450916] pci 0000:02:00.0:   bridge window [mem 0x000a0000-0x000bffff window] (subtractive decode)
[    0.450917] pci 0000:02:00.0:   bridge window [mem 0x000d0000-0x000d3fff window] (subtractive decode)
[    0.450918] pci 0000:02:00.0:   bridge window [mem 0x000d4000-0x000d7fff window] (subtractive decode)
[    0.450919] pci 0000:02:00.0:   bridge window [mem 0x000d8000-0x000dbfff window] (subtractive decode)
[    0.450919] pci 0000:02:00.0:   bridge window [mem 0x000dc000-0x000dffff window] (subtractive decode)
[    0.450920] pci 0000:02:00.0:   bridge window [mem 0xcf200000-0xfeafffff window] (subtractive decode)
[    0.450992] pci 0000:04:00.0: [14e4:43a0] type 00 class 0x028000
[    0.451023] pci 0000:04:00.0: reg 0x10: [mem 0xefe00000-0xefe07fff 64bit]
[    0.451036] pci 0000:04:00.0: reg 0x18: [mem 0xefc00000-0xefdfffff 64bit]
[    0.451136] pci 0000:04:00.0: supports D1 D2
[    0.451136] pci 0000:04:00.0: PME# supported from D0 D1 D2 D3hot D3cold
[    0.460018] pci 0000:00:1c.4: PCI bridge to [bus 04]
[    0.460022] pci 0000:00:1c.4:   bridge window [mem 0xefc00000-0xefefffff]
[    0.460624] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15)
[    0.460655] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 10 11 12 14 15) *0, disabled.
[    0.460685] ACPI: PCI Interrupt Link [LNKC] (IRQs *3 4 5 6 10 11 12 14 15)
[    0.460714] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 *10 11 12 14 15)
[    0.460744] ACPI: PCI Interrupt Link [LNKE] (IRQs *3 4 5 6 10 11 12 14 15)
[    0.460774] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 11 12 14 15) *0, disabled.
[    0.460803] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 10 *11 12 14 15)
[    0.460833] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *10 11 12 14 15)
[    0.460949] ACPI: Enabled 5 GPEs in block 00 to 3F
[    0.460990] pci 0000:00:02.0: vgaarb: setting as boot VGA device
[    0.460990] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[    0.460990] pci 0000:00:02.0: vgaarb: bridge control possible
[    0.460990] vgaarb: loaded
[    0.460990] EDAC MC: Ver: 3.0.0
[    0.460990] Registered efivars operations
[    0.465382] PCI: Using ACPI for IRQ routing
[    0.467845] PCI: pci_cache_line_size set to 64 bytes
[    0.467877] e820: reserve RAM buffer [mem 0x00058000-0x0005ffff]
[    0.467878] e820: reserve RAM buffer [mem 0x0009f000-0x0009ffff]
[    0.467879] e820: reserve RAM buffer [mem 0xac65e000-0xafffffff]
[    0.467879] e820: reserve RAM buffer [mem 0xad2fa000-0xafffffff]
[    0.467880] e820: reserve RAM buffer [mem 0xbdad4000-0xbfffffff]
[    0.467881] e820: reserve RAM buffer [mem 0xbdb81000-0xbfffffff]
[    0.467881] e820: reserve RAM buffer [mem 0xbe000000-0xbfffffff]
[    0.467882] e820: reserve RAM buffer [mem 0x42ee00000-0x42fffffff]
[    0.467932] NetLabel: Initializing
[    0.467932] NetLabel:  domain hash size = 128
[    0.467933] NetLabel:  protocols = UNLABELED CIPSOv4 CALIPSO
[    0.467942] NetLabel:  unlabeled traffic allowed by default
[    0.467956] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[    0.467956] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[    0.470010] clocksource: Switched to clocksource hpet
[    0.475523] VFS: Disk quotas dquot_6.6.0
[    0.475535] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    0.475588] pnp: PnP ACPI init
[    0.475689] system 00:00: [mem 0xfed40000-0xfed44fff] has been reserved
[    0.475691] system 00:00: Plug and Play ACPI device, IDs PNP0c01 (active)
[    0.475762] system 00:01: [io  0x0800-0x087f] has been reserved
[    0.475763] system 00:01: Plug and Play ACPI device, IDs PNP0c02 (active)
[    0.475776] pnp 00:02: Plug and Play ACPI device, IDs PNP0b00 (active)
[    0.475796] system 00:03: [io  0x1854-0x1857] has been reserved
[    0.475798] system 00:03: Plug and Play ACPI device, IDs INT3f0d PNP0c02 (active)
[    0.475849] system 00:04: [io  0x0290-0x029f] has been reserved
[    0.475850] system 00:04: Plug and Play ACPI device, IDs PNP0c02 (active)
[    0.476026] pnp 00:05: [dma 3]
[    0.476083] pnp 00:05: Plug and Play ACPI device, IDs PNP0401 (active)
[    0.476149] system 00:06: [io  0x04d0-0x04d1] has been reserved
[    0.476150] system 00:06: Plug and Play ACPI device, IDs PNP0c02 (active)
[    0.476241] pnp 00:07: [dma 0 disabled]
[    0.476264] pnp 00:07: Plug and Play ACPI device, IDs PNP0501 (active)
[    0.476565] system 00:08: [mem 0xfed1c000-0xfed1ffff] has been reserved
[    0.476566] system 00:08: [mem 0xfed10000-0xfed17fff] has been reserved
[    0.476567] system 00:08: [mem 0xfed18000-0xfed18fff] has been reserved
[    0.476568] system 00:08: [mem 0xfed19000-0xfed19fff] has been reserved
[    0.476569] system 00:08: [mem 0xf0000000-0xf7ffffff] has been reserved
[    0.476569] system 00:08: [mem 0xfed20000-0xfed3ffff] has been reserved
[    0.476570] system 00:08: [mem 0xfed90000-0xfed93fff] has been reserved
[    0.476571] system 00:08: [mem 0xfed45000-0xfed8ffff] has been reserved
[    0.476572] system 00:08: [mem 0xff000000-0xffffffff] has been reserved
[    0.476573] system 00:08: [mem 0xfee00000-0xfeefffff] could not be reserved
[    0.476574] system 00:08: [mem 0xeffe0000-0xeffeffff] has been reserved
[    0.476575] system 00:08: Plug and Play ACPI device, IDs PNP0c02 (active)
[    0.476692] pnp: PnP ACPI: found 9 devices
[    0.482211] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[    0.482240] pci 0000:00:1c.0: PCI bridge to [bus 01]
[    0.482248] pci 0000:02:00.0: PCI bridge to [bus 03]
[    0.482263] pci 0000:00:1c.3: PCI bridge to [bus 02-03]
[    0.482270] pci 0000:00:1c.4: PCI bridge to [bus 04]
[    0.482273] pci 0000:00:1c.4:   bridge window [mem 0xefc00000-0xefefffff]
[    0.482279] pci_bus 0000:00: resource 4 [io  0x0000-0x0cf7 window]
[    0.482280] pci_bus 0000:00: resource 5 [io  0x0d00-0xffff window]
[    0.482280] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]
[    0.482281] pci_bus 0000:00: resource 7 [mem 0x000d0000-0x000d3fff window]
[    0.482282] pci_bus 0000:00: resource 8 [mem 0x000d4000-0x000d7fff window]
[    0.482282] pci_bus 0000:00: resource 9 [mem 0x000d8000-0x000dbfff window]
[    0.482283] pci_bus 0000:00: resource 10 [mem 0x000dc000-0x000dffff window]
[    0.482284] pci_bus 0000:00: resource 11 [mem 0xcf200000-0xfeafffff window]
[    0.482285] pci_bus 0000:02: resource 4 [io  0x0000-0x0cf7 window]
[    0.482285] pci_bus 0000:02: resource 5 [io  0x0d00-0xffff window]
[    0.482286] pci_bus 0000:02: resource 6 [mem 0x000a0000-0x000bffff window]
[    0.482287] pci_bus 0000:02: resource 7 [mem 0x000d0000-0x000d3fff window]
[    0.482287] pci_bus 0000:02: resource 8 [mem 0x000d4000-0x000d7fff window]
[    0.482288] pci_bus 0000:02: resource 9 [mem 0x000d8000-0x000dbfff window]
[    0.482289] pci_bus 0000:02: resource 10 [mem 0x000dc000-0x000dffff window]
[    0.482290] pci_bus 0000:02: resource 11 [mem 0xcf200000-0xfeafffff window]
[    0.482290] pci_bus 0000:03: resource 4 [io  0x0000-0x0cf7 window]
[    0.482291] pci_bus 0000:03: resource 5 [io  0x0d00-0xffff window]
[    0.482292] pci_bus 0000:03: resource 6 [mem 0x000a0000-0x000bffff window]
[    0.482292] pci_bus 0000:03: resource 7 [mem 0x000d0000-0x000d3fff window]
[    0.482293] pci_bus 0000:03: resource 8 [mem 0x000d4000-0x000d7fff window]
[    0.482293] pci_bus 0000:03: resource 9 [mem 0x000d8000-0x000dbfff window]
[    0.482294] pci_bus 0000:03: resource 10 [mem 0x000dc000-0x000dffff window]
[    0.482295] pci_bus 0000:03: resource 11 [mem 0xcf200000-0xfeafffff window]
[    0.482296] pci_bus 0000:04: resource 1 [mem 0xefc00000-0xefefffff]
[    0.482381] NET: Registered protocol family 2
[    0.482478] TCP established hash table entries: 131072 (order: 8, 1048576 bytes)
[    0.482608] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    0.482720] TCP: Hash tables configured (established 131072 bind 65536)
[    0.482739] UDP hash table entries: 8192 (order: 6, 262144 bytes)
[    0.482772] UDP-Lite hash table entries: 8192 (order: 6, 262144 bytes)
[    0.482820] NET: Registered protocol family 1
[    0.482828] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[    0.503407] PCI: CLS mismatch (64 != 128), using 64 bytes
[    0.520117] Unpacking initramfs...
[    0.659519] Freeing initrd memory: 13968K
[    0.659525] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    0.659527] software IO TLB [mem 0xa865e000-0xac65e000] (64MB) mapped at [ffff9895e865e000-ffff9895ec65dfff]
[    0.659684] Scanning for low memory corruption every 60 seconds
[    0.660039] Initialise system trusted keyrings
[    0.660046] Key type blacklist registered
[    0.660077] workingset: timestamp_bits=40 max_order=22 bucket_order=0
[    0.660673] zbud: loaded
[    0.661437] Key type asymmetric registered
[    0.661454] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 249)
[    0.661475] io scheduler noop registered
[    0.661476] io scheduler deadline registered
[    0.661490] io scheduler cfq registered (default)
[    0.661490] io scheduler mq-deadline registered
[    0.661491] io scheduler kyber registered
[    0.661503] io scheduler bfq registered
[    0.661769] efifb: probing for efifb
[    0.661777] efifb: framebuffer at 0xd0000000, using 3072k, total 3072k
[    0.661777] efifb: mode is 1024x768x32, linelength=4096, pages=1
[    0.661778] efifb: scrolling: redraw
[    0.661778] efifb: Truecolor: size=8:8:8:8, shift=24:16:8:0
[    0.662822] Console: switching to colour frame buffer device 128x48
[    0.663822] fb0: EFI VGA frame buffer device
[    0.663826] intel_idle: MWAIT substates: 0x42120
[    0.663827] intel_idle: v0.4.1 model 0x3C
[    0.663912] intel_idle: lapic_timer_reliable_states 0xffffffff
[    0.663991] GHES: HEST is not enabled!
[    0.664034] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    0.684559] 00:07: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[    0.685135] rtc_cmos 00:02: RTC can wake from S4
[    0.685244] rtc_cmos 00:02: rtc core: registered rtc_cmos as rtc0
[    0.685265] rtc_cmos 00:02: alarms up to one month, y3k, 242 bytes nvram, hpet irqs
[    0.685272] intel_pstate: Intel P-state driver initializing
[    0.685514] ledtrig-cpu: registered to indicate activity on CPUs
[    0.685577] vlv2_plat_clk vlv2_plat_clk: vlv2_plat_clk initialized
[    0.686049] NET: Registered protocol family 10
[    0.693671] Segment Routing with IPv6
[    0.693721] NET: Registered protocol family 17
[    0.694324] RAS: Correctable Errors collector initialized.
[    0.694408] microcode: sig=0x306c3, pf=0x2, revision=0x22
[    0.694584] microcode: Microcode Update Driver: v2.2.
[    0.694608] sched_clock: Marking stable (694566525, 0)->(693281150, 1285375)
[    0.695151] registered taskstats version 1
[    0.695174] Loading compiled-in X.509 certificates
[    0.695205] zswap: loaded using pool lzo/zbud
[    0.698348] Key type big_key registered
[    0.698669]   Magic number: 9:174:237
[    0.698710] acpi NTN0530:00: hash matches
[    0.698722] memory memory115: hash matches
[    0.698766] rtc_cmos 00:02: setting system clock to 2017-11-17 16:14:34 UTC (1510935274)
[    0.699302] PM: Hibernation image not present or could not be loaded.
[    0.700394] Freeing unused kernel memory: 1336K
[    0.700395] Write protecting the kernel read-only data: 10240k
[    0.700741] Freeing unused kernel memory: 1536K
[    0.720802] device-mapper: uevent: version 1.0.3
[    0.720850] device-mapper: ioctl: 4.37.0-ioctl (2017-09-20) initialised: dm-devel@redhat.com
[    0.750849] sdhci: Secure Digital Host Controller Interface driver
[    0.750850] sdhci: Copyright(c) Pierre Ossman
[    0.753842] i8042: PNP: No PS/2 controller found.
[    0.756257] ACPI: bus type USB registered
[    0.756267] usbcore: registered new interface driver usbfs
[    0.756271] usbcore: registered new interface driver hub
[    0.756286] usbcore: registered new device driver usb
[    0.756914] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    0.757002] ehci-pci: EHCI PCI platform driver
[    0.757059] xhci_hcd 0000:00:14.0: xHCI Host Controller
[    0.757063] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 1
[    0.758076] SCSI subsystem initialized
[    0.758132] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x00009810
[    0.758135] xhci_hcd 0000:00:14.0: cache line size of 64 is not supported
[    0.758271] hub 1-0:1.0: USB hub found
[    0.758285] hub 1-0:1.0: 14 ports detected
[    0.758868] libata version 3.00 loaded.
[    0.759919] xhci_hcd 0000:00:14.0: xHCI Host Controller
[    0.759921] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2
[    0.759997] hub 2-0:1.0: USB hub found
[    0.760019] hub 2-0:1.0: 6 ports detected
[    0.761072] ehci-pci 0000:00:1a.0: EHCI Host Controller
[    0.761075] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 3
[    0.761084] ehci-pci 0000:00:1a.0: debug port 2
[    0.764970] ehci-pci 0000:00:1a.0: cache line size of 64 is not supported
[    0.764976] ehci-pci 0000:00:1a.0: irq 16, io mem 0xeff3b000
[    0.776735] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[    0.776934] hub 3-0:1.0: USB hub found
[    0.776939] hub 3-0:1.0: 2 ports detected
[    0.777119] ehci-pci 0000:00:1d.0: EHCI Host Controller
[    0.777122] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 4
[    0.777131] ehci-pci 0000:00:1d.0: debug port 2
[    0.781023] ehci-pci 0000:00:1d.0: cache line size of 64 is not supported
[    0.781030] ehci-pci 0000:00:1d.0: irq 23, io mem 0xeff3a000
[    0.796720] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[    0.796919] hub 4-0:1.0: USB hub found
[    0.796925] hub 4-0:1.0: 2 ports detected
[    0.797083] ahci 0000:00:1f.2: version 3.0
[    0.797299] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x7 impl SATA mode
[    0.797301] ahci 0000:00:1f.2: flags: 64bit ncq led clo pio slum part ems apst 
[    0.817886] scsi host0: ahci
[    0.818096] scsi host1: ahci
[    0.818324] scsi host2: ahci
[    0.818560] scsi host3: ahci
[    0.818716] scsi host4: ahci
[    0.818915] scsi host5: ahci
[    0.818996] ata1: SATA max UDMA/133 abar m2048@0xeff39000 port 0xeff39100 irq 25
[    0.818998] ata2: SATA max UDMA/133 abar m2048@0xeff39000 port 0xeff39180 irq 25
[    0.819000] ata3: SATA max UDMA/133 abar m2048@0xeff39000 port 0xeff39200 irq 25
[    0.819001] ata4: DUMMY
[    0.819002] ata5: DUMMY
[    0.819003] ata6: DUMMY
[    1.076740] usb 1-1: new high-speed USB device number 2 using xhci_hcd
[    1.096740] usb 3-1: new high-speed USB device number 2 using ehci-pci
[    1.116736] usb 4-1: new high-speed USB device number 2 using ehci-pci
[    1.133997] ata2: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[    1.134049] ata3: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[    1.134076] ata1: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[    1.136160] ata2.00: supports DRM functions and may not be fully accessible
[    1.136173] ata3.00: supports DRM functions and may not be fully accessible
[    1.136201] ata1.00: supports DRM functions and may not be fully accessible
[    1.136634] ata3.00: NCQ Send/Recv Log not supported
[    1.136639] ata3.00: ATA-9: Samsung SSD 850 EVO 500GB, EMT01B6Q, max UDMA/133
[    1.136642] ata3.00: 976773168 sectors, multi 1: LBA48 NCQ (depth 31/32), AA
[    1.136874] ata1.00: disabling queued TRIM support
[    1.136878] ata1.00: ATA-9: Samsung SSD 850 EVO 500GB, EMT03B6Q, max UDMA/133
[    1.136882] ata1.00: 976773168 sectors, multi 1: LBA48 NCQ (depth 31/32), AA
[    1.136894] ata2.00: disabling queued TRIM support
[    1.136898] ata2.00: ATA-9: Samsung SSD 850 EVO 500GB, EMT02B6Q, max UDMA/133
[    1.136902] ata2.00: 976773168 sectors, multi 1: LBA48 NCQ (depth 31/32), AA
[    1.138259] ata3.00: supports DRM functions and may not be fully accessible
[    1.138681] ata3.00: NCQ Send/Recv Log not supported
[    1.139159] ata2.00: supports DRM functions and may not be fully accessible
[    1.139182] ata1.00: supports DRM functions and may not be fully accessible
[    1.139745] ata1.00: disabling queued TRIM support
[    1.139758] ata2.00: disabling queued TRIM support
[    1.139891] ata3.00: configured for UDMA/133
[    1.141345] ata1.00: configured for UDMA/133
[    1.141369] ata2.00: configured for UDMA/133
[    1.141669] scsi 0:0:0:0: Direct-Access     ATA      Samsung SSD 850  3B6Q PQ: 0 ANSI: 5
[    1.177341] scsi 1:0:0:0: Direct-Access     ATA      Samsung SSD 850  2B6Q PQ: 0 ANSI: 5
[    1.217369] scsi 2:0:0:0: Direct-Access     ATA      Samsung SSD 850  1B6Q PQ: 0 ANSI: 5
[    1.237565] hub 3-1:1.0: USB hub found
[    1.237719] hub 3-1:1.0: 6 ports detected
[    1.254280] hub 4-1:1.0: USB hub found
[    1.254414] hub 4-1:1.0: 8 ports detected
[    1.264775] sd 1:0:0:0: [sdb] 976773168 512-byte logical blocks: (500 GB/466 GiB)
[    1.264788] sd 1:0:0:0: [sdb] Write Protect is off
[    1.264790] sd 1:0:0:0: [sdb] Mode Sense: 00 3a 00 00
[    1.264795] sd 0:0:0:0: [sda] 976773168 512-byte logical blocks: (500 GB/466 GiB)
[    1.264807] sd 0:0:0:0: [sda] Write Protect is off
[    1.264809] sd 1:0:0:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    1.264810] sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
[    1.264827] sd 2:0:0:0: [sdc] 976773168 512-byte logical blocks: (500 GB/466 GiB)
[    1.264828] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    1.264839] sd 2:0:0:0: [sdc] Write Protect is off
[    1.264841] sd 2:0:0:0: [sdc] Mode Sense: 00 3a 00 00
[    1.264859] sd 2:0:0:0: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    1.267516]  sdb: sdb1 sdb2
[    1.267629]  sdc: sdc1 sdc2
[    1.267712]  sda: sda1 sda2
[    1.268101] sd 1:0:0:0: [sdb] supports TCG Opal
[    1.268103] sd 1:0:0:0: [sdb] Attached SCSI disk
[    1.268233] sd 2:0:0:0: [sdc] supports TCG Opal
[    1.268235] sd 2:0:0:0: [sdc] Attached SCSI disk
[    1.268369] sd 0:0:0:0: [sda] supports TCG Opal
[    1.268371] sd 0:0:0:0: [sda] Attached SCSI disk
[    1.288389] md/raid1:md0: active with 3 out of 3 mirrors
[    1.289354] md0: detected capacity change from 0 to 499434651648
[    1.453406] usb 1-2: new high-speed USB device number 3 using xhci_hcd
[    1.589292] usb-storage 1-2:1.0: USB Mass Storage device detected
[    1.589667] scsi host6: usb-storage 1-2:1.0
[    1.589786] usbcore: registered new interface driver usb-storage
[    1.590343] usbcore: registered new interface driver uas
[    1.676734] tsc: Refined TSC clocksource calibration: 3498.984 MHz
[    1.676741] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x326f9112de0, max_idle_ns: 440795205848 ns
[    1.753400] usb 1-3: new low-speed USB device number 4 using xhci_hcd
[    1.889353] hidraw: raw HID events driver (C) Jiri Kosina
[    1.891238] usbcore: registered new interface driver usbhid
[    1.891240] usbhid: USB HID core driver
[    1.892150] input: Genius USB Optical Mouse as /devices/pci0000:00/0000:00:14.0/usb1/1-3/1-3:1.0/0003:0458:003A.0001/input/input0
[    1.892245] hid-generic 0003:0458:003A.0001: input,hidraw0: USB HID v1.11 Mouse [Genius USB Optical Mouse] on usb-0000:00:14.0-3/input0
[    2.000079] usb 1-4: new low-speed USB device number 5 using xhci_hcd
[    2.148496] input: Microsoft Wired Keyboard 600 as /devices/pci0000:00/0000:00:14.0/usb1/1-4/1-4:1.0/0003:045E:0750.0002/input/input1
[    2.203567] microsoft 0003:045E:0750.0002: input,hidraw1: USB HID v1.11 Keyboard [Microsoft Wired Keyboard 600] on usb-0000:00:14.0-4/input0
[    2.204135] input: Microsoft Wired Keyboard 600 as /devices/pci0000:00/0000:00:14.0/usb1/1-4/1-4:1.1/0003:045E:0750.0003/input/input2
[    2.260258] microsoft 0003:045E:0750.0003: input,hidraw2: USB HID v1.11 Device [Microsoft Wired Keyboard 600] on usb-0000:00:14.0-4/input1
[    2.313409] usb 1-11: new high-speed USB device number 6 using xhci_hcd
[    2.445133] usb-storage 1-11:1.0: USB Mass Storage device detected
[    2.445394] scsi host7: usb-storage 1-11:1.0
[    2.613378] usb 1-12: new high-speed USB device number 7 using xhci_hcd
[    2.690240] clocksource: Switched to clocksource tsc
[    2.746032] usb-storage 1-12:1.0: USB Mass Storage device detected
[    2.749683] scsi host8: usb-storage 1-12:1.0
[    2.861729] scsi 6:0:0:0: Direct-Access     PNY      USB 2.0 FD       1100 PQ: 0 ANSI: 4
[    2.862663] sd 6:0:0:0: [sdd] 15950592 512-byte logical blocks: (8.17 GB/7.61 GiB)
[    2.863156] sd 6:0:0:0: [sdd] Write Protect is off
[    2.863161] sd 6:0:0:0: [sdd] Mode Sense: 43 00 00 00
[    2.863698] sd 6:0:0:0: [sdd] No Caching mode page found
[    2.863763] sd 6:0:0:0: [sdd] Assuming drive cache: write through
[    2.867787]  sdd: sdd1 sdd2
[    2.869291] sd 6:0:0:0: [sdd] Attached SCSI removable disk
[    3.464493] scsi 7:0:0:0: Direct-Access     WD       Ext HDD 1021     2002 PQ: 0 ANSI: 4
[    3.465366] sd 7:0:0:0: [sde] 1953519616 512-byte logical blocks: (1.00 TB/932 GiB)
[    3.465876] sd 7:0:0:0: [sde] Test WP failed, assume Write Enabled
[    3.466362] sd 7:0:0:0: [sde] Asking for cache data failed
[    3.466428] sd 7:0:0:0: [sde] Assuming drive cache: write through
[    3.469679] sd 7:0:0:0: [sde] Attached SCSI disk
[    4.005579] scsi 8:0:0:0: Direct-Access     PNY      USB 2.0 FD       1100 PQ: 0 ANSI: 4
[    4.006491] sd 8:0:0:0: [sdf] 15950592 512-byte logical blocks: (8.17 GB/7.61 GiB)
[    4.007017] sd 8:0:0:0: [sdf] Write Protect is off
[    4.007023] sd 8:0:0:0: [sdf] Mode Sense: 43 00 00 00
[    4.007538] sd 8:0:0:0: [sdf] No Caching mode page found
[    4.007603] sd 8:0:0:0: [sdf] Assuming drive cache: write through
[    4.010928]  sdf: sdf1 sdf2
[    4.012589] sd 8:0:0:0: [sdf] Attached SCSI removable disk
[   50.107610] random: crng init done
[   61.891636] usb 1-3: USB disconnect, device number 4
[   63.403414] usb 1-3: new low-speed USB device number 8 using xhci_hcd
[   63.539425] input: Genius USB Optical Mouse as /devices/pci0000:00/0000:00:14.0/usb1/1-3/1-3:1.0/0003:0458:003A.0004/input/input3
[   63.539578] hid-generic 0003:0458:003A.0004: input,hidraw0: USB HID v1.11 Mouse [Genius USB Optical Mouse] on usb-0000:00:14.0-3/input0
[   72.208022] EXT4-fs (sde): mounted filesystem with ordered data mode. Opts: (null)

EDIT: Also I installed grub two more times with these commands:

grub-install --target=x86_64-efi --efi-directory=/boot --bootloader-id=grub
grub-mkconfig -o /boot/grub/grub.cfg

using different bootloader-id's each time. Now all three of those bootlooader ids show up in the boot-order menu in UEFI at startup ?!

Last edited by felixtheratruns (2017-11-17 16:37:45)

Offline

#8 2017-11-19 18:16:45

felixtheratruns
Member
Registered: 2016-12-04
Posts: 21

Re: [SOLVED] EFI GRUB with LVM on RAID1: cannot find rootfs works at first

Ok im going to have to use my computer to edit my resume. I'll just remove one of the drives from the array and setup something quick like ubuntu on the removed one. If you think this Arch setup is lost cause let me know, otherwise I'm still waiting for suggestions whether solutions or just troubleshooting ideas.

Offline

#9 2017-11-19 19:55:55

frostschutz
Member
Registered: 2013-11-15
Posts: 1,409

Re: [SOLVED] EFI GRUB with LVM on RAID1: cannot find rootfs works at first

Missed your previous reply.

Seems like RAID was assembled correctly... is /dev/mapper/ (LVM) then empty? In that case, do the LVM commands report anything?

pvs
vgs
lvs
vgchange -a y
vgscan --mknodes

If those aliases don't exist in the initramfs (I'm not sure) then prepend everything with "lvm ...".

Also have a blink in /proc/cmdline if it's the parameters you expect.

Offline

#10 2017-11-19 22:45:27

cfr
Member
From: Cymru
Registered: 2011-11-27
Posts: 7,130

Re: [SOLVED] EFI GRUB with LVM on RAID1: cannot find rootfs works at first

You shouldn't have multiple EFI partitions. I don't know anything about RAID, so maybe that can make 3 disk partitions into 1 EFI partition or something. But if your 3 boot partitions are marked as your ESP, that's going to cause trouble. More specifically, it might work, but, if so, that's by luck rather than design. It isn't supposed to work and it wouldn't be at all weird for it to break or work inconsistently.

Pardon my ignorance, by what's the advantage of using a bind mount for the ESP? The wiki suggests this allows organising your ESP as you wish, but that does not seem to be your purpose as you aren't mounting a sub-directory this way.


CLI Paste | How To Ask Questions

Arch Linux | x86_64 | GPT | EFI boot | refind | stub loader | systemd | LVM2 on LUKS
Lenovo x270 | Intel(R) Core(TM) i5-7200U CPU @ 2.50GHz | Intel Wireless 8265/8275 | US keyboard w/ Euro | 512G NVMe INTEL SSDPEKKF512G7L

Offline

#11 2017-11-19 23:47:08

felixtheratruns
Member
Registered: 2016-12-04
Posts: 21

Re: [SOLVED] EFI GRUB with LVM on RAID1: cannot find rootfs works at first

@cfr wow, didn't even think about the possible problem(s) with multiple ESPs (one is that might try to boot from the wrong one) I do think it is finding the right one because it is getting to  the grub bootloader but maybe you are right, I will try removing the flags on the other two.

I have a bind mount as a relic of an idea I had when setting this up. I read the wiki that said there were some risks to using RAID1 for the ESP so I thought there might be a way to use bind mounts to mirror files across all of the boot partitions without using RAID1, so I tried to bind mount all to boot. I was thinking that if one of them failed the other would work. However, when this stopped working I removed all but one of the bind mounts.

Last edited by felixtheratruns (2017-11-20 00:00:10)

Offline

#12 2017-11-20 01:01:58

felixtheratruns
Member
Registered: 2016-12-04
Posts: 21

Re: [SOLVED] EFI GRUB with LVM on RAID1: cannot find rootfs works at first

@frostschutz /dev/mapper is empty at boot except for "control"

However after I ran the following commands I looked and it had all my lvs in it:

pvs
vgs
lvs
vgchange -a y
vgscan --mknodes

So I think I fixed it not finding the root fs. I did several things so I'm not sure which worked or if the combination did.
1 I deleted the other two ESPs

sgdisk -Z /dev/sdb1
sgdisk -Z /dev/sdc1

and I changed /etc/fstab to simply mount the remaining one to boot (no bind mounting)

2 I noticed there was a bunch of warnings about use_lvmetad = 0, when I ran those five commands at the beginning from frostsschutz, it also said run "pvscan --cache" to avoid corruption (which I did later) so I  changed it to "use_lvmetad = 1" in /etc/lvm/lvm.conf

3 I ran pvscan --cache (I think I also might have done this before step 2 as well)

4 I rebuilt the kernel and reinstalled grub and ignored all the grub warnings about lvmetad

mkinitcpio -p linux
grub-install --target=x86_64-efi --efi-directory=/boot --bootloader-id=grub
grub-mkconfig -o /boot/grub/grub.cfg

5 I rebooted and logged in several times.to make sure this worked

I will try and diagnose things more later to see what actually went wrong, but for now I have to edit my resume and I might be able to put "got LVM2 working on RAID1 with uefi" on it:)

Thanks so much to all of you for your suggestions. EDIT: I do have one question in the meantime. How do I get rid of the multiple bootloader ids that show up in my EFI boot order menu? (I changed the id everytime I installed grub and the old ones never went away)

Last edited by felixtheratruns (2017-11-20 01:26:33)

Offline

#13 2017-11-20 01:11:26

frostschutz
Member
Registered: 2013-11-15
Posts: 1,409

Re: [SOLVED] EFI GRUB with LVM on RAID1: cannot find rootfs works at first

I can't really comment on ESP because - I don't use that. It should be possible because even in the UEFI world, servers with more than one hard drive, should still be able to boot even after any one of the drives is awol.

However as long as the kernel and initramfs loads, ESP (anything bootloader related) should not really be your issue anymore. If the kernel then doesn't manage to mount the root partition, it's a problem with the initramfs and configuration.

Glad you could make it work somehow, even though it's not entirely clear to me where exactly the problem was.

Offline

#14 2017-11-20 04:36:08

cfr
Member
From: Cymru
Registered: 2011-11-27
Posts: 7,130

Re: [SOLVED] EFI GRUB with LVM on RAID1: cannot find rootfs works at first

How do I get rid of the multiple bootloader ids that show up in my EFI boot order menu?

Use efibootmgr.

frostschutz wrote:

However as long as the kernel and initramfs loads, ESP (anything bootloader related) should not really be your issue anymore. If the kernel then doesn't manage to mount the root partition, it's a problem with the initramfs and configuration.

Come again? Whether the kernel and initramfs load is precisely an issue of getting the ESP right. I realise that the issue here was with the root partition, but the issue of multiple ESPs would precisely affect the kernel/initramfs loading. Probably I misunderstood you, though, as I'm rather tired.


CLI Paste | How To Ask Questions

Arch Linux | x86_64 | GPT | EFI boot | refind | stub loader | systemd | LVM2 on LUKS
Lenovo x270 | Intel(R) Core(TM) i5-7200U CPU @ 2.50GHz | Intel Wireless 8265/8275 | US keyboard w/ Euro | 512G NVMe INTEL SSDPEKKF512G7L

Offline

#15 2017-12-08 06:15:40

felixtheratruns
Member
Registered: 2016-12-04
Posts: 21

Re: [SOLVED] EFI GRUB with LVM on RAID1: cannot find rootfs works at first

So I decided not to try and see what went wrong. I was going to try and setup grub on raid1 boot partition but then I realized that may not be possible, so I ended up setting up systemd-boot on raid1. I think what caused the problem originally (maybe in the first post as well) was "use_lvmetad = 0" in /etc/lvm/lvm.conf which takes care of grub's warnings at install but it causes other warnings when running lvm commands after you are dropped to the emergency shell. In the first post it might have also been because I had the boot partitions bind mounted to the same place.

Anyway's here is my current boot setup /dev/md1 is mounted to my boot partition:
/etc/mdadm.conf

ARRAY /dev/md1 metadata=1.0 name=archiso:1 UUID=45c8036c:53489fa1:f9237e37:0f20dae8
ARRAY /dev/md0 metadata=1.2 name=archiso:0 UUID=4f5f044b:773becdd:211d2b33:fa24fe82

/etc/fstab

# /dev/mapper/LVGA-lv_root
UUID=ce78aa9e-8fba-4da7-8a7e-0f9bc877c6c8       /               ext4            rw,relatime,data=ordered        0 1

# /dev/mapper/LVGA-lv_data
UUID=2d246ca4-a733-4408-a551-7cd48e7b4b26       /data           ext4            rw,relatime,data=ordered        0 2

# /dev/mapper/LVGA-lv_home
UUID=c9ecef6e-3c9e-4682-a8d3-f2042100203f       /home           ext4            rw,relatime,data=ordered        0 2

# /dev/mapper/LVGA-lv_var
UUID=76cbe1cf-6cce-499e-a5f6-6ed783a9c500       /var            ext4            rw,relatime,data=ordered        0 2

# /dev/md1
UUID=6384-973C          /boot           vfat            rw,relatime,fmask=0022,dmask=0022,codepage=437,iocharset=iso8859-1,shortname=mixed,errors=remount-ro        0 2

# /dev/mapper/LVGA-lv_swap
UUID=afe777f0-a03e-4938-a9aa-183a4a390e73       none            swap            defaults        0 0

Here's what I did to setup raid1:

mdadm --create /dev/md1 --metadata 1.0 --raid-devices=3 --level=1 /dev/sda1 /dev/sdb1 /dev/sdc1

Here's what I did to setup systemd-boot, roughly following this post (linked to the specific part of the thread): https://bbs.archlinux.org/viewtopic.php … 1#p1390741

cp systemd/boot/efi/systemd-bootx64.efi /boot/EFI/systemd/
cp systemd/boot/efi/systemd-bootx64.efi /boot/EFI/bootx64.efi #I think I should have copied it to /boot/EFI/Boot/bootx64.efi so it could be a backup or something
efibootmgr -c -d /dev/sda -p 1 -L ArchLinux1_EFI -l \\EFI\\systemd\\systemd-bootx64.efi
efibootmgr -c -d /dev/sdb -p 1 -L ArchLinux2_EFI -l \\EFI\\systemd\\systemd-bootx64.efi
efibootmgr -c -d /dev/sdc -p 1 -L ArchLinux3_EFI -l \\EFI\\systemd\\systemd-bootx64.efi

I then created the following in: /boot/loader/entries/arch1.conf  (had to create the directory and the file)

title   Arch Linux
linux   /vmlinuz-linux
initrd  /initramfs-linux.img
options root=UUID="ce78aa9e-8fba-4da7-8a7e-0f9bc877c6c8" rw

All the hooks and modules stayed in /etc/mkinitcpio.conf from my last post so I won't repeat it here. So I get ArchLinux1_EFI ArchLinux2_EFI ArchLinux3_EFI as boot option in UEFI setup so hopefully if one drive fails it will show me which one (by not having that option) or if not I could figure it out in raid1. Thanks for all your help guys. I have finally got to where I wanted to go. LVM2 on RAID1 booted by systemd-boot on RAID1 on UEFI. Hope this helps someone out smile Marking as solved.

Last edited by felixtheratruns (2017-12-08 06:21:23)

Offline

Board footer

Powered by FluxBB