[SOLVED]Arch doesn't boot after passing through GPU.

heldiho53 · 2015-12-18 03:25:41

I used the guide on the ArchWiki for PCI/VGA/GPU throughpassing and after I set

/etc/modprobe.d/vfio.conf

options vfio-pci ids=myidshere

/etc/mkinitcpio.conf

MODULES="vfio vfio_iommu_type1 vfio_pci vfio_virqfd"

rebuild initramfs and rebooted and wanted to check if it works, my system freezes when trying to boot. It shows starting version 228 and then it simply freezes. I tried both linux-lts and linux-vfio-lts as suggested in the wiki but nothing helps (I tested blacklisting radeon too). I'm on one monitor only if that helps. Is the gpu you pass through supposed to freeze?
My specs: Cpu: Amd Fx 6300 GPU I'm trying to pass through: AMD Radeon HD7850. Mobo: Asus M5a99FX Pro R2.0. Also if I unplug the Radeon and use another card I haven't passed through I'm able to boot into the system. I've tried switching the monitor output to my NVIDIA Geforce GT435M which I want to use for the host also I tried to connect a second monitor, but I don't get any signal if my Radeon also is plugged in I hope it's not a PSU issue (Corsair Cx600) (bad PSU). Also what should I look for in dmesg?

Last edited by heldiho53 (2015-12-20 19:41:32)

Lone_Wolf · 2015-12-18 11:26:01

Use bios/uefi firmware to make sure your motherboard uses the NOT passed-throughcard as primary card.

heldiho53 · 2015-12-18 14:47:22

Hi thanks for the reply, I don't actually know how I do this in my uefi/bios. There is a function called "Initiate Graphic Adapter" but the only choices are PCI/PEG and PEG/PCI. And I don't think this changed anything.

Lone_Wolf · 2015-12-18 16:13:58

Ok, check the manual for your motherboard [1] .

around page 1-35 ( ATX Power connectors ) it says that for 2 high end graphics you should have 1000 W power.

Both videocards are pci express with extra power connectors ?

[1] http://dlcdnet.asus.com/pub/ASUS/mb/Soc … V3_WEB.pdf

Last edited by Lone_Wolf (2015-12-18 16:14:27)

heldiho53 · 2015-12-19 03:41:25

Lone_Wolf wrote:

Both videocards are pci express with extra power connectors ?

Nope the GT435M is not. It is a low profile card, so it doesn't even have power connectors.

tom.ty89 · 2015-12-19 06:40:33

Try not to use the initramfs to load the vfio modules (but KEEP the /etc/modprobe.d/vfio.conf you have). Instead, EITHER:
1) Have "vfio-pci" in /etc/modules-load.d/vfio-pci.conf and "softdep radeon pre: vfio-pci" in /etc/modprobe.d/radeon.conf (create the confs; content should be unquoted)
2) Run the following commands as root manually after boot: modprobe vfio-pci; echo 0000:xx:xx.x > /sys/bus/pci/drivers/radeon/unbind; echo 0000:xx:xx.x > /sys/bus/pci/drivers/vfio-pci/bind , where xx:xx.x is the bus id of the pcie card from lspci

Btw what exactly have you entered for "myidshere"? Can you also paste your `lspci -nn` output?

Last edited by tom.ty89 (2015-12-19 06:42:37)

heldiho53 · 2015-12-20 10:32:17

tom.ty89 wrote:

Try not to use the initramfs to load the vfio modules (but KEEP the /etc/modprobe.d/vfio.conf you have). Instead, EITHER:
1) Have "vfio-pci" in /etc/modules-load.d/vfio-pci.conf and "softdep radeon pre: vfio-pci" in /etc/modprobe.d/radeon.conf (create the confs; content should be unquoted)
2) Run the following commands as root manually after boot: modprobe vfio-pci; echo 0000:xx:xx.x > /sys/bus/pci/drivers/radeon/unbind; echo 0000:xx:xx.x > /sys/bus/pci/drivers/vfio-pci/bind , where xx:xx.x is the bus id of the pcie card from lspci
Btw what exactly have you entered for "myidshere"? Can you also paste your `lspci -nn` output?

Actually I switched the places of the cards and my gpu that isn't assigned works, strangely I can't log in to Gnome with Xorg, but Wayland works so I used it. After I installed Win7 in Virt-manager and passed my gpu through it it still doesn't work though. Also I don't think it's a PSU issue as both outputs on my monitor work (in Ubuntu).

Here are my ids I used:

lspci -nn|grep -iP "NVIDIA|Radeon"
01:00.0 VGA compatible controller [0300]: NVIDIA Corporation GF108M [GeForce GT 435M] [10de:0df2] (rev a1)
01:00.1 Audio device [0403]: NVIDIA Corporation GF108 High Definition Audio Controller [10de:0bea] (rev a1)
03:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Pitcairn PRO [Radeon HD 7850 / R7 265 / R9 270 1024SP] [1002:6819] <---- This one
03:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Cape Verde/Pitcairn HDMI Audio [Radeon HD 7700/7800 Series] [1002:aab0]   <---- This one 

lscpi -nn 

00:00.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI to PCI bridge (external gfx0 port B) [1002:5a14] (rev 02)
00:00.2 IOMMU [0806]: Advanced Micro Devices, Inc. [AMD/ATI] RD990 I/O Memory Management Unit (IOMMU) [1002:5a23]
00:02.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI to PCI bridge (PCI express gpp port B) [1002:5a16]
00:04.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI to PCI bridge (PCI express gpp port D) [1002:5a18]
00:0b.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI to PCI bridge (NB-SB link) [1002:5a1f]
00:0d.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI to PCI bridge (external gfx1 port B) [1002:5a1e]
00:11.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 SATA Controller [IDE mode] [1002:4390] (rev 40)
00:12.0 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB OHCI0 Controller [1002:4397]
00:12.2 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB EHCI Controller [1002:4396]
00:13.0 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB OHCI0 Controller [1002:4397]
00:13.2 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB EHCI Controller [1002:4396]
00:14.0 SMBus [0c05]: Advanced Micro Devices, Inc. [AMD/ATI] SBx00 SMBus Controller [1002:4385] (rev 42)
00:14.1 IDE interface [0101]: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 IDE Controller [1002:439c] (rev 40)
00:14.2 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] SBx00 Azalia (Intel HDA) [1002:4383] (rev 40)
00:14.3 ISA bridge [0601]: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 LPC host controller [1002:439d] (rev 40)
00:14.4 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD/ATI] SBx00 PCI to PCI Bridge [1002:4384] (rev 40)
00:14.5 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB OHCI2 Controller [1002:4399]
00:15.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD/ATI] SB700/SB800/SB900 PCI to PCI bridge (PCIE port 0) [1002:43a0]
00:15.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD/ATI] SB700/SB800/SB900 PCI to PCI bridge (PCIE port 1) [1002:43a1]
00:15.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD/ATI] SB900 PCI to PCI bridge (PCIE port 2) [1002:43a2]
00:15.3 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD/ATI] SB900 PCI to PCI bridge (PCIE port 3) [1002:43a3]
00:16.0 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB OHCI0 Controller [1002:4397]
00:16.2 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB EHCI Controller [1002:4396]
00:18.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 15h Processor Function 0 [1022:1600]
00:18.1 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 15h Processor Function 1 [1022:1601]
00:18.2 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 15h Processor Function 2 [1022:1602]
00:18.3 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 15h Processor Function 3 [1022:1603]
00:18.4 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 15h Processor Function 4 [1022:1604]
00:18.5 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 15h Processor Function 5 [1022:1605]
01:00.0 VGA compatible controller [0300]: NVIDIA Corporation GF108M [GeForce GT 435M] [10de:0df2] (rev a1)
01:00.1 Audio device [0403]: NVIDIA Corporation GF108 High Definition Audio Controller [10de:0bea] (rev a1)
03:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Pitcairn PRO [Radeon HD 7850 / R7 265 / R9 270 1024SP] [1002:6819]
03:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Cape Verde/Pitcairn HDMI Audio [Radeon HD 7700/7800 Series] [1002:aab0]
06:00.0 SATA controller [0106]: ASMedia Technology Inc. ASM1062 Serial ATA Controller [1b21:0612] (rev 01)
07:00.0 USB controller [0c03]: ASMedia Technology Inc. ASM1042 SuperSpeed USB Host Controller [1b21:1042]
08:00.0 USB controller [0c03]: ASMedia Technology Inc. ASM1042 SuperSpeed USB Host Controller [1b21:1042]
09:00.0 Ethernet controller [0200]: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller [10ec:8168] (rev 09)

Edit: Virt-manager says when I start the VM: Graphical console not configured for guest.

Last edited by heldiho53 (2015-12-20 11:16:23)

tom.ty89 · 2015-12-20 12:51:24

heldiho53 wrote:

Actually I switched the places of the cards and my gpu that isn't assigned works, strangely I can't log in to Gnome with Xorg, but Wayland works so I used it.

I don't understand what you're talking about here. And this switch fix the freezing issue on the host system? And when you talk about Xorg/Wayland are you talking about the host or the guest?

If you passthrough the audio as well, you need to apply the softdep / the unbind/bind action to snd-hda-intel too when you try my methods.

Last edited by tom.ty89 (2015-12-20 13:20:03)

heldiho53 · 2015-12-20 15:36:47

tom.ty89 wrote:

heldiho53 wrote:
Actually I switched the places of the cards and my gpu that isn't assigned works, strangely I can't log in to Gnome with Xorg, but Wayland works so I used it.
I don't understand what you're talking about here. And this switch fix the freezing issue on the host system? And when you talk about Xorg/Wayland are you talking about the host or the guest?
If you passthrough the audio as well, you need to apply the softdep / the unbind/bind action to snd-hda-intel too when you try my methods.

Sorry that was a bit unclear. Before I switched places of the cards (I switched pci slots) my motherboard seemed to use the gpu I wanted to use as the guest as my primary graphics card. That's why it froze I guess. Xorg login doesn't work on the host so I used Gnome under Wayland. A second monitor is now connected to the guest card but there is no signal.

tom.ty89 · 2015-12-20 16:03:00

Will need to check journal to see the Xorg log to know why it doesn't work. Btw if your mobo has UEFI instead of BIOS then try to disable CSM (https://en.wikipedia.org/wiki/Unified_E … ort_Module), in my experience it can prevent multiple cards from working.

heldiho53 · 2015-12-20 17:30:17

Turned off CSM and my BIOS says that my card isn't supported. Now we know the problem. I checked with aw's rom parser before though.:/

heldiho53 · 2015-12-20 19:41:10

Thank you very much Lone_Wolf and tom.ty89 you pointed me in the right direction. The card needed to start with the bios function in Virt-manager.

Arch Linux

#1 2015-12-18 03:25:41

[SOLVED]Arch doesn't boot after passing through GPU.

#2 2015-12-18 11:26:01

Re: [SOLVED]Arch doesn't boot after passing through GPU.

#3 2015-12-18 14:47:22

Re: [SOLVED]Arch doesn't boot after passing through GPU.

#4 2015-12-18 16:13:58

Re: [SOLVED]Arch doesn't boot after passing through GPU.

#5 2015-12-19 03:41:25

Re: [SOLVED]Arch doesn't boot after passing through GPU.

#6 2015-12-19 06:40:33

Re: [SOLVED]Arch doesn't boot after passing through GPU.

#7 2015-12-20 10:32:17

Re: [SOLVED]Arch doesn't boot after passing through GPU.

#8 2015-12-20 12:51:24

Re: [SOLVED]Arch doesn't boot after passing through GPU.

#9 2015-12-20 15:36:47

Re: [SOLVED]Arch doesn't boot after passing through GPU.

#10 2015-12-20 16:03:00

Re: [SOLVED]Arch doesn't boot after passing through GPU.

#11 2015-12-20 17:30:17

Re: [SOLVED]Arch doesn't boot after passing through GPU.

#12 2015-12-20 19:41:10

Re: [SOLVED]Arch doesn't boot after passing through GPU.

Board footer