Arch Linux

Keyemail

Member

Registered: 2023-07-05

Posts: 8

[SOLVED] VFIO PCI Graphics Card freezing system up

Hello! I've decided to use the PCI Passthrough with a second GPU again, I've used this on my system before and it went fine. However, when attempting again aperentally when plugging in anything into the GPU (including HDMI, and DisplayPort) it freezes my system up and I have to do a hard reboot when this happends. I even tried to boot up the system with something plugged into the graphics card but the system will just refuse to boot in general and I yet again have to a hard reset. Does anyone have any ideas why this is happending?

I did a journalctl | grep -i nvidia command and this is what I got:

7月 05 08:46:34 powerhouse3000x kernel: RIP: 0010:nv_audio_dynamic_power+0xc7/0x130 [nvidia]
 7月 05 08:46:34 powerhouse3000x kernel:  ? nv_audio_dynamic_power+0xc7/0x130 [nvidia 233321e971d767f188c1b97ef7f3f5977f8ad809]
 7月 05 08:46:34 powerhouse3000x kernel:  _nv046624rm+0x27/0x30 [nvidia 233321e971d767f188c1b97ef7f3f5977f8ad809]
 7月 05 08:46:34 powerhouse3000x kernel:  _nv042963rm+0x1a6/0x1b0 [nvidia 233321e971d767f188c1b97ef7f3f5977f8ad809]
 7月 05 08:46:34 powerhouse3000x kernel:  _nv044912rm+0x1ee/0x300 [nvidia 233321e971d767f188c1b97ef7f3f5977f8ad809]
 7月 05 08:46:34 powerhouse3000x kernel:  _nv013130rm+0x335/0x630 [nvidia 233321e971d767f188c1b97ef7f3f5977f8ad809]
 7月 05 08:46:34 powerhouse3000x kernel:  _nv043107rm+0x69/0xd0 [nvidia 233321e971d767f188c1b97ef7f3f5977f8ad809]
 7月 05 08:46:34 powerhouse3000x kernel:  _nv011651rm+0x83/0xa0 [nvidia 233321e971d767f188c1b97ef7f3f5977f8ad809]
 7月 05 08:46:34 powerhouse3000x kernel:  _nv000577rm+0x5e/0x70 [nvidia 233321e971d767f188c1b97ef7f3f5977f8ad809]
 7月 05 08:46:34 powerhouse3000x kernel:  rm_kernel_rmapi_op+0x127/0x213 [nvidia 233321e971d767f188c1b97ef7f3f5977f8ad809]
 7月 05 08:46:34 powerhouse3000x kernel:  nvkms_call_rm+0x4c/0x80 [nvidia_modeset 4e58df98f11f03737eecd9053f6ec9befa1fd689]
 7月 05 08:46:34 powerhouse3000x kernel:  _nv002705kms+0x42/0x50 [nvidia_modeset 4e58df98f11f03737eecd9053f6ec9befa1fd689]
 7月 05 08:46:34 powerhouse3000x kernel:  ? _nv000684kms+0xb1/0x190 [nvidia_modeset 4e58df98f11f03737eecd9053f6ec9befa1fd689]
 7月 05 08:46:34 powerhouse3000x kernel:  ? _nv002542kms+0x241/0x400 [nvidia_modeset 4e58df98f11f03737eecd9053f6ec9befa1fd689]
 7月 05 08:46:34 powerhouse3000x kernel:  ? _nv002542kms+0x49/0x400 [nvidia_modeset 4e58df98f11f03737eecd9053f6ec9befa1fd689]
 7月 05 08:46:34 powerhouse3000x kernel:  ? _nv000531kms+0xd20/0xf10 [nvidia_modeset 4e58df98f11f03737eecd9053f6ec9befa1fd689]
 7月 05 08:46:34 powerhouse3000x kernel:  ? _nv002766kms+0x3fce/0x4cd0 [nvidia_modeset 4e58df98f11f03737eecd9053f6ec9befa1fd689]
 7月 05 08:46:34 powerhouse3000x kernel:  ? _nv000355kms+0x100/0x100 [nvidia_modeset 4e58df98f11f03737eecd9053f6ec9befa1fd689]
 7月 05 08:46:34 powerhouse3000x kernel:  ? nvKmsIoctl+0xf7/0x270 [nvidia_modeset 4e58df98f11f03737eecd9053f6ec9befa1fd689]
 7月 05 08:46:34 powerhouse3000x kernel:  ? nvkms_ioctl+0x11a/0x180 [nvidia_modeset 4e58df98f11f03737eecd9053f6ec9befa1fd689]
 7月 05 08:46:34 powerhouse3000x kernel:  ? nvidia_frontend_unlocked_ioctl+0x39/0x50 [nvidia 233321e971d767f188c1b97ef7f3f5977f8ad809]
 7月 05 08:46:34 powerhouse3000x kernel:  crc32c_generic crc16 mbcache jbd2 usbhid i915 i2c_algo_bit drm_buddy nvme intel_gtt spi_intel_pci drm_display_helper spi_intel crc32c_intel nvme_core cec xhci_pci nvme_common ttm xhci_pci_renesas vfio_pci vfio_pci_core irqbypass vfio_iommu_type1 vfio iommufd nvidia_drm(POE) nvidia_uvm(POE) nvidia_modeset(POE) video wmi nvidia(POE)
 7月 05 08:46:34 powerhouse3000x kernel: RIP: 0010:nv_audio_dynamic_power+0xc7/0x130 [nvidia]

also, my boot kernal is this:

options root=PARTUUID=3c941c0e-7be3-4455-bedc-6c586db83c7d rw nvidia-drm.modeset=1 intel_iommu=on iommu=pt vfio_iommu_type1.allow_unsafe_interrupts=1  quiet splash video=efifb:off video=vesafb:off video=simplefb:off

thank you!

Last edited by Keyemail (2023-07-05 20:51:52)

seth

Member

From: Won't reply 2 private help req

Registered: 2012-09-03

Posts: 76,048

Re: [SOLVED] VFIO PCI Graphics Card freezing system up

According to the kernEl commandline you're not isolating any devices, the RIP code looks like the audio part.
Please post the entire journal, not random excerpts and detail which device(s) you seek to pass through.

---

How to upload text · How to boot w/o GUI · Disable Windows Fast-Start! · Fix your xinitrc

Keyemail

Member

Registered: 2023-07-05

Posts: 8

Re: [SOLVED] VFIO PCI Graphics Card freezing system up

Ah, sorry. Well i figured out the issue which was that i wasnt loading the hooks correctly, I loaded nvidia before the VFIO which caused an issue!

seth

Member

From: Won't reply 2 private help req

Registered: 2012-09-03

Posts: 76,048

Re: [SOLVED] VFIO PCI Graphics Card freezing system up

Please always remember to mark resolved threads by editing your initial posts subject - so others will know that there's no task left, but maybe a solution to find.
Thanks.

---

How to upload text · How to boot w/o GUI · Disable Windows Fast-Start! · Fix your xinitrc

ewaller

Administrator

From: Pasadena, CA

Registered: 2009-07-13

Posts: 20,642

Re: [SOLVED] VFIO PCI Graphics Card freezing system up

Keyemail, I saw your request.  I would prefer to leave the thread visible as a resource for others having the same issue.

---

Nothing is too wonderful to be true, if it be consistent with the laws of nature -- Michael Faraday
The shortest way to ruin a country is to give power to demagogues.— Dionysius of Halicarnassus
---
How to Ask Questions the Smart Way

Keyemail

Member

Registered: 2023-07-05

Posts: 8

Re: [SOLVED] VFIO PCI Graphics Card freezing system up

Alright, just kinda something i didnt spot lol.. i spent like 2 days on it

archenroot

Member

Registered: 2016-03-13

Posts: 3

Re: [SOLVED] VFIO PCI Graphics Card freezing system up

I hit the same issue on Ubuntu 22.04.3 LTS

I managed to get it working by following
/etc/default/grub

GRUB_CMDLINE_LINUX_DEFAULT="quiet splash intel_iommu=on kvm.ignore_msrs=1 iommu=pt pcie_acs_override=downstream,multifunction vfio-pci.ids=10de:1bb1,10de:10f0 pcie_port_pm=off"

root@HP-Z840:~# cat /etc/modules-load.d/modules.conf 
# /etc/modules: kernel modules to load at boot time.
#
# This file contains the names of kernel modules that should be loaded
# at boot time, one per line. Lines beginning with "#" are ignored.


# Generated by sensors-detect on Thu Nov  2 20:18:15 2023
# Chip drivers
coretemp
lm92
nct6775
vfio
vfio_iommu_type1
vfio_pci
vfio_virqfd
#vfio_amd
vfio_nvidia

root@HP-Z840:/etc# cat modprobe.d/vfio.conf 
options vfio-pci ids=10de:1bb1,10de:10f0 disable_vga=1
softdep drm pre: vfio-pci
#options vfio-pci disable_vga=1
blacklist nouveau

oot@HP-Z840:/etc# cat initramfs-tools/conf.d/vfio 
#vfio_pci vfio vfio_iommu_type1 vfio_virqfd
vfio vfio_iommu_type1 vfio_pci vfio_virqfd vfio_amd vfio_nvidia

then run:

update-initramfs -u -k all
update-grub

igneel

Member

Registered: 2021-06-17

Posts: 10

Re: [SOLVED] VFIO PCI Graphics Card freezing system up

This is an issue that began with the newest update on 15th January. My setup is also single gpu and I have used it all of last year since shifting to my new laptop. It has worked great, then I updated to qemu8.2.0-3 and now my system hangs on a black screen. Even ssh hangs when I try launching through it. Of course nothing in /var/log/libvirt/qemu/vm.log either. At least nothing indicating an issue.