[SOLVED] IOMMU causing Arch not to start

CraigAB69 · 2022-07-31 02:58:51

Hi,

When intel_iommu=on is on the grub command line the system will not start, it will pass the Grub menu and then hang at Arch 251...
If I edit the line in grub and continue to boot, it works fine.

Any help would be appreciated.
Regards,
Craig

log from the failed boot.

(It does show the cmdline in the log, but I edit it out for it to boot.)

[    23.607] (--) Log file renamed from "/var/log/Xorg.pid-625.log" to "/var/log/Xorg.0.log"
[    23.608] 
X.Org X Server 1.21.1.4
X Protocol Version 11, Revision 0
[    23.608] Current Operating System: Linux lxdefiant 5.18.14-arch1-1 #1 SMP PREEMPT_DYNAMIC Sat, 23 Jul 2022 11:46:17 +0000 x86_64
[    23.608] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-linux root=UUID=e9ef27fb-41bc-4f4b-95e8-f020dabecf13 rw quiet loglevel=3 intel_iommu=on iommu=fullflush
[    23.608]  
[    23.608] Current version of pixman: 0.40.0
[    23.608] 	Before reporting problems, check http://wiki.x.org
	to make sure that you have the latest version.
[    23.608] Markers: (--) probed, (**) from config file, (==) default setting,
	(++) from command line, (!!) notice, (II) informational,
	(WW) warning, (EE) error, (NI) not implemented, (??) unknown.
[    23.608] (==) Log file: "/var/log/Xorg.0.log", Time: Sun Jul 31 11:44:26 2022
[    23.608] (==) Using system config directory "/usr/share/X11/xorg.conf.d"
[    23.608] (==) No Layout section.  Using the first Screen section.
[    23.608] (==) No screen section available. Using defaults.
[    23.608] (**) |-->Screen "Default Screen Section" (0)
[    23.608] (**) |   |-->Monitor "<default monitor>"
[    23.608] (==) No monitor specified for screen "Default Screen Section".
	Using a default monitor configuration.
[    23.608] (==) Automatically adding devices
[    23.608] (==) Automatically enabling devices
[    23.608] (==) Automatically adding GPU devices
[    23.608] (==) Automatically binding GPU devices
[    23.608] (==) Max clients allowed: 256, resource mask: 0x1fffff
[    23.608] (WW) The directory "/usr/share/fonts/misc" does not exist.
[    23.608] 	Entry deleted from font path.
[    23.608] (WW) The directory "/usr/share/fonts/OTF" does not exist.
[    23.608] 	Entry deleted from font path.
[    23.608] (WW) The directory "/usr/share/fonts/Type1" does not exist.
[    23.608] 	Entry deleted from font path.
[    23.608] (==) FontPath set to:
	/usr/share/fonts/TTF,
	/usr/share/fonts/100dpi,
	/usr/share/fonts/75dpi
[    23.608] (==) ModulePath set to "/usr/lib/xorg/modules"
[    23.608] (II) The server relies on udev to provide the list of input devices.
	If no devices become available, reconfigure udev or disable AutoAddDevices.
[    23.608] (II) Module ABI versions:
[    23.608] 	X.Org ANSI C Emulation: 0.4
[    23.608] 	X.Org Video Driver: 25.2
[    23.608] 	X.Org XInput driver : 24.4
[    23.608] 	X.Org Server Extension : 10.0
[    23.609] (++) using VT number 1

[    23.610] (II) systemd-logind: took control of session /org/freedesktop/login1/session/_37
[    23.612] (--) PCI:*(0@0:2:0) 8086:0412:1458:d000 rev 6, Mem @ 0xf7800000/4194304, 0xe0000000/268435456, I/O @ 0x0000f000/64, BIOS @ 0x????????/131072
[    23.612] (WW) Open ACPI failed (/var/run/acpid.socket) (No such file or directory)
[    23.612] (II) LoadModule: "glx"
[    23.612] (II) Loading /usr/lib/xorg/modules/extensions/libglx.so
[    23.613] (II) Module glx: vendor="X.Org Foundation"
[    23.613] 	compiled for 1.21.1.4, module version = 1.0.0
[    23.613] 	ABI class: X.Org Server Extension, version 10.0
[    23.613] (==) Matched intel as autoconfigured driver 0
[    23.613] (==) Matched modesetting as autoconfigured driver 1
[    23.613] (==) Matched fbdev as autoconfigured driver 2
[    23.613] (==) Matched vesa as autoconfigured driver 3
[    23.613] (==) Assigned the driver to the xf86ConfigLayout
[    23.613] (II) LoadModule: "intel"
[    23.613] (II) Loading /usr/lib/xorg/modules/drivers/intel_drv.so
[    23.614] (II) Module intel: vendor="X.Org Foundation"
[    23.614] 	compiled for 1.21.1.1, module version = 2.99.917
[    23.614] 	Module class: X.Org Video Driver
[    23.614] 	ABI class: X.Org Video Driver, version 25.2
[    23.614] (II) LoadModule: "modesetting"
[    23.614] (II) Loading /usr/lib/xorg/modules/drivers/modesetting_drv.so
[    23.614] (II) Module modesetting: vendor="X.Org Foundation"
[    23.614] 	compiled for 1.21.1.4, module version = 1.21.1
[    23.614] 	Module class: X.Org Video Driver
[    23.614] 	ABI class: X.Org Video Driver, version 25.2
[    23.614] (II) LoadModule: "fbdev"
[    23.614] (WW) Warning, couldn't open module fbdev
[    23.614] (EE) Failed to load module "fbdev" (module does not exist, 0)
[    23.614] (II) LoadModule: "vesa"
[    23.614] (II) Loading /usr/lib/xorg/modules/drivers/vesa_drv.so
[    23.614] (II) Module vesa: vendor="X.Org Foundation"
[    23.614] 	compiled for 1.21.1.3, module version = 2.5.0
[    23.614] 	Module class: X.Org Video Driver
[    23.614] 	ABI class: X.Org Video Driver, version 25.2
[    23.614] (II) intel: Driver for Intel(R) Integrated Graphics Chipsets:
	i810, i810-dc100, i810e, i815, i830M, 845G, 854, 852GM/855GM, 865G,
	915G, E7221 (i915), 915GM, 945G, 945GM, 945GME, Pineview GM,
	Pineview G, 965G, G35, 965Q, 946GZ, 965GM, 965GME/GLE, G33, Q35, Q33,
	GM45, 4 Series, G45/G43, Q45/Q43, G41, B43
[    23.615] (II) intel: Driver for Intel(R) HD Graphics
[    23.615] (II) intel: Driver for Intel(R) Iris(TM) Graphics
[    23.615] (II) intel: Driver for Intel(R) Iris(TM) Pro Graphics
[    23.615] (II) modesetting: Driver for Modesetting Kernel Drivers: kms
[    23.615] (II) VESA: driver for VESA chipsets: vesa
[    25.624] intel: waited 2020 ms for i915.ko driver to load
[    25.626] (EE) open /dev/dri/card0: No such file or directory
[    25.626] (WW) Falling back to old probe method for modesetting
[    25.626] (EE) open /dev/dri/card0: No such file or directory
[    25.626] vesa: Refusing to run, Framebuffer or dri device present
[    25.626] (EE) Screen 0 deleted because of no matching config section.
[    25.626] (II) UnloadModule: "modesetting"
[    25.626] (EE) Device(s) detected, but none match those in the config file.
[    25.626] (EE) 
Fatal server error:
[    25.626] (EE) no screens found(EE) 
[    25.626] (EE) 
Please consult the The X.Org Foundation support 
	 at http://wiki.x.org
 for help. 
[    25.626] (EE) Please also check the log file at "/var/log/Xorg.0.log" for additional information.
[    25.626] (EE) 
[    25.630] (EE) Server terminated with error (1). Closing log file.

Last edited by CraigAB69 (2022-07-31 20:52:03)

loqs · 2022-07-31 05:17:36

Please post the full system journal for a boot with the issue.

CraigAB69 · 2022-07-31 06:10:03

What is posted is from the log.
I have to hard reset the box, which creates a new log. And only succeeds when I remove those iommu settings.

seth · 2022-07-31 06:17:22

sudo journalctl -b -1 |  curl -F 'file=@-' 0x0.st

for the system journal of the previous boot.

Last edited by seth (2022-07-31 06:18:13)

CraigAB69 · 2022-07-31 06:55:47

seth wrote:

sudo journalctl -b -1 |  curl -F 'file=@-' 0x0.st
for the system journal of the previous boot.

Done.

I was just looking at Xorg.0.log.old

seth · 2022-07-31 06:58:47

Done … where?
You should have received a URL for that which you need to post for anyone to be able to see anything.

CraigAB69 · 2022-07-31 07:42:20

seth wrote:

Done … where?
You should have received a URL for that which you need to post for anyone to be able to see anything.

Sorry.

http://0x0.st/oeXs.txt

seth · 2022-07-31 07:54:37

Here's the bad

Jul 31 12:39:50 lxdefiant /usr/lib/gdm-x-session[592]: intel: waited 2020 ms for i915.ko driver to load
Jul 31 12:39:50 lxdefiant /usr/lib/gdm-x-session[592]: (EE) open /dev/dri/card0: No such file or directory
Jul 31 12:39:50 lxdefiant /usr/lib/gdm-x-session[592]: (WW) Falling back to old probe method for modesetting
Jul 31 12:39:50 lxdefiant /usr/lib/gdm-x-session[592]: (EE) open /dev/dri/card0: No such file or directory
Jul 31 12:39:50 lxdefiant /usr/lib/gdm-x-session[592]: (II) Loading sub module "fbdevhw"
Jul 31 12:39:50 lxdefiant /usr/lib/gdm-x-session[592]: (II) LoadModule: "fbdevhw"
Jul 31 12:39:50 lxdefiant /usr/lib/gdm-x-session[592]: (II) Loading /usr/lib/xorg/modules/libfbdevhw.so
Jul 31 12:39:50 lxdefiant /usr/lib/gdm-x-session[592]: (II) Module fbdevhw: vendor="X.Org Foundation"
Jul 31 12:39:50 lxdefiant /usr/lib/gdm-x-session[592]:         compiled for 1.21.1.4, module version = 0.0.2
Jul 31 12:39:50 lxdefiant /usr/lib/gdm-x-session[592]:         ABI class: X.Org Video Driver, version 25.2
Jul 31 12:39:50 lxdefiant /usr/lib/gdm-x-session[592]: (EE) Unable to find a valid framebuffer device
Jul 31 12:39:50 lxdefiant /usr/lib/gdm-x-session[592]: (WW) Falling back to old probe method for fbdev
Jul 31 12:39:50 lxdefiant /usr/lib/gdm-x-session[592]: (II) Loading sub module "fbdevhw"
Jul 31 12:39:50 lxdefiant /usr/lib/gdm-x-session[592]: (II) LoadModule: "fbdevhw"
Jul 31 12:39:50 lxdefiant /usr/lib/gdm-x-session[592]: (II) Loading /usr/lib/xorg/modules/libfbdevhw.so

And it looks like you're trying to pass the VGA device through?

Jul 31 12:39:37 lxdefiant kernel: VFIO - User Level meta-driver version: 0.3
Jul 31 12:39:37 lxdefiant kernel: vfio_pci: unknown parameter '0886:0c0c,' ignored
Jul 31 12:39:37 lxdefiant kernel: vfio_pci: unknown parameter '1013:00b8' ignored
Jul 31 12:39:37 lxdefiant kernel: vfio-pci 0000:00:02.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=io+mem:owns=io+mem
Jul 31 12:39:37 lxdefiant kernel: vfio_pci: add [8086:0412[ffffffff:ffffffff]] class 0x000000/00000000

There's certainly some bogus parameters set for the module, no idea whether you intended to pass on something and accidentally catch the VGA device.
0886:0c0c is audio, 1013:00b8 is some dead old cirrus logic "GPU" (well, it could make pixels colored…)

CraigAB69 · 2022-07-31 08:23:48

Thank you Seth for looking at the log.

The idea was to pass-thru an old Cirrus card for Win NT 3.51 KVM and maybe an old SMC ethernet card.

Is that allowed to use old hardware in that way?

EDIT:
So when the system is booting with IOMMU support it is catching the Cirrus card in the PCI slot first? Even though in the BIOS I set it to the on-board video?

Last edited by CraigAB69 (2022-07-31 08:27:12)

seth · 2022-07-31 08:50:59

No IOMMU => no VFIO => No problem
Try to properly isolate the devices you want to pass though, https://wiki.archlinux.org/title/PCI_pa … _device_ID
8086:0412 is the IGP and you don't to add that (I guess)

CraigAB69 · 2022-07-31 10:09:07

Mate,

Thanks for the link.
Yep, I screwed up. No surprise there.
Usually, the Arch docs are pretty good, it's more about finding the correct docs and RTFM.

I cleared out the modules() in /etc/mkinitcpio.conf and options in /etc/modprobe.d/vfio.conf. sudo mkinitcpio -p linux And it boots again.
So it is about stepping through the docs and not just blindly following a "How to".

Thanks again mate, I appreciate the help.

Last edited by CraigAB69 (2022-07-31 10:26:51)

seth · 2022-07-31 13:00:16

Please always remember to mark resolved threads by editing your initial posts subject - so others will know that there's no task left, but maybe a solution to find.
Thanks.

Arch Linux

#1 2022-07-31 02:58:51

[SOLVED] IOMMU causing Arch not to start

#2 2022-07-31 05:17:36

Re: [SOLVED] IOMMU causing Arch not to start

#3 2022-07-31 06:10:03

Re: [SOLVED] IOMMU causing Arch not to start

#4 2022-07-31 06:17:22

Re: [SOLVED] IOMMU causing Arch not to start

#5 2022-07-31 06:55:47

Re: [SOLVED] IOMMU causing Arch not to start

#6 2022-07-31 06:58:47

Re: [SOLVED] IOMMU causing Arch not to start

#7 2022-07-31 07:42:20

Re: [SOLVED] IOMMU causing Arch not to start

#8 2022-07-31 07:54:37

Re: [SOLVED] IOMMU causing Arch not to start

#9 2022-07-31 08:23:48

Re: [SOLVED] IOMMU causing Arch not to start

#10 2022-07-31 08:50:59

Re: [SOLVED] IOMMU causing Arch not to start

#11 2022-07-31 10:09:07

Re: [SOLVED] IOMMU causing Arch not to start

#12 2022-07-31 13:00:16

Re: [SOLVED] IOMMU causing Arch not to start

Board footer