[SOLVED] Ryzen 7000 IGPU QEMU passthrough

M440 · 2023-09-01 18:41:20

hello,

i followed the steps in the arch wiki, but the vm won't start with the following error. Please help - what i need to do?

https://wiki.archlinux.org/title/PCI_pa … ide_patch)

Error starting domain: internal error: QEMU unexpectedly closed the monitor (vm='win10'): 2023-09-01T18:28:08.864679Z qemu-system-x86_64: -device {"driver":"vfio-pci","host":"0000:0f:00.0","id":"hostdev1","bus":"pci.5","addr":"0x0"}: vfio 0000:0f:00.0: group 4 is not viable
Please ensure all devices within the iommu_group are bound to their vfio bus driver.

Traceback (most recent call last):
  File "/usr/share/virt-manager/virtManager/asyncjob.py", line 72, in cb_wrapper
    callback(asyncjob, *args, **kwargs)
  File "/usr/share/virt-manager/virtManager/asyncjob.py", line 108, in tmpcb
    callback(*args, **kwargs)
  File "/usr/share/virt-manager/virtManager/object/libvirtobject.py", line 57, in newfn
    ret = fn(self, *args, **kwargs)
          ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/share/virt-manager/virtManager/object/domain.py", line 1402, in startup
    self._backend.create()
  File "/usr/lib/python3.11/site-packages/libvirt.py", line 1373, in create
    raise libvirtError('virDomainCreate() failed')
libvirt.libvirtError: internal error: QEMU unexpectedly closed the monitor (vm='win10'): 2023-09-01T18:28:08.864679Z qemu-system-x86_64: -device {"driver":"vfio-pci","host":"0000:0f:00.0","id":"hostdev1","bus":"pci.5","addr":"0x0"}: vfio 0000:0f:00.0: group 4 is not viable
Please ensure all devices within the iommu_group are bound to their vfio bus driver.

logs

0f:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Raphael (rev c3) (prog-if 00 [VGA controller])
        Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Raphael
        Flags: bus master, fast devsel, latency 0, IRQ 255, IOMMU group 4
        Memory at 7fe10000000 (64-bit, prefetchable) [size=256M]
        Memory at 7fe20000000 (64-bit, prefetchable) [size=2M]
        I/O ports at d000 [disabled] [size=256]
        Memory at fca00000 (32-bit, non-prefetchable) [size=512K]
        Capabilities: [48] Vendor Specific Information: Len=08 <?>
        Capabilities: [50] Power Management version 3
        Capabilities: [64] Express Legacy Endpoint, MSI 00
        Capabilities: [a0] MSI: Enable- Count=1/4 Maskable- 64bit+
        Capabilities: [c0] MSI-X: Enable- Count=4 Masked-
        Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
        Capabilities: [270] Secondary PCI Express
        Capabilities: [2b0] Address Translation Service (ATS)
        Capabilities: [2c0] Page Request Interface (PRI)
        Capabilities: [2d0] Process Address Space ID (PASID)
        Capabilities: [410] Physical Layer 16.0 GT/s <?>
        Capabilities: [450] Lane Margining at the Receiver <?>
        Kernel driver in use: vfio-pci
        Kernel modules: amdgpu

0f:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Rembrandt Radeon High Definition Audio Controller
        Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Rembrandt Radeon High Definition Audio Controller
        Flags: fast devsel, IRQ 255, IOMMU group 4
        Memory at fca88000 (32-bit, non-prefetchable) [disabled] [size=16K]
        Capabilities: [48] Vendor Specific Information: Len=08 <?>
        Capabilities: [50] Power Management version 3
        Capabilities: [64] Express Legacy Endpoint, MSI 00
        Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
        Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
        Kernel driver in use: vfio-pci
        Kernel modules: snd_hda_intel

mm@desktop: ~ $ #!/bin/bash
shopt -s nullglob
for g in $(find /sys/kernel/iommu_groups/* -maxdepth 0 -type d | sort -V); do
    echo "IOMMU Group ${g##*/}:"
    for d in $g/devices/*; do
        echo -e "\t$(lspci -nns ${d##*/})"
    done;
done;

IOMMU Group 0:
        00:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14da]
        00:01.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:14db]
        00:01.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:14db]
        01:00.0 VGA compatible controller [0300]: NVIDIA Corporation GA106 [RTX A2000] [10de:2531] (rev a1)
        01:00.1 Audio device [0403]: NVIDIA Corporation GA106 High Definition Audio Controller [10de:228e] (rev a1)
        02:00.0 Non-Volatile memory controller [0108]: Kingston Technology Company, Inc. Device [2646:5017] (rev 03)
IOMMU Group 1:
        00:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14da]
        00:02.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:14db]
        03:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f4] (rev 01)
        04:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f5] (rev 01)
        04:01.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f5] (rev 01)
        04:02.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f5] (rev 01)
        04:03.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f5] (rev 01)
        04:04.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f5] (rev 01)
        04:05.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f5] (rev 01)
        04:06.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f5] (rev 01)
        04:08.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f5] (rev 01)
        04:0c.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f5] (rev 01)
        04:0d.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f5] (rev 01)
        07:00.0 Network controller [0280]: MEDIATEK Corp. MT7922 802.11ax PCI Express Wireless Network Adapter [14c3:0616]
        08:00.0 Ethernet controller [0200]: Realtek Semiconductor Co., Ltd. RTL8125 2.5GbE Controller [10ec:8125] (rev 05)
        0d:00.0 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f7] (rev 01)
        0e:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f6] (rev 01)
IOMMU Group 2:
        00:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14da]
IOMMU Group 3:
        00:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14da]
IOMMU Group 4:
        00:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14da]
        00:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:14dd]
        00:08.3 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:14dd]
        0f:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Raphael [1002:164e] (rev c3)
        0f:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Rembrandt Radeon High Definition Audio Controller [1002:1640]
        0f:00.2 Encryption controller [1080]: Advanced Micro Devices, Inc. [AMD] VanGogh PSP/CCP [1022:1649]
        0f:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Device [1022:15b6]
        0f:00.4 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Device [1022:15b7]
        0f:00.6 Audio device [0403]: Advanced Micro Devices, Inc. [AMD] Family 17h/19h HD Audio Controller [1022:15e3]
        10:00.0 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Device [1022:15b8]
IOMMU Group 5:
        00:14.0 SMBus [0c05]: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller [1022:790b] (rev 71)
        00:14.3 ISA bridge [0601]: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge [1022:790e] (rev 51)
IOMMU Group 6:
        00:18.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14e0]
        00:18.1 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14e1]
        00:18.2 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14e2]
        00:18.3 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14e3]
        00:18.4 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14e4]
        00:18.5 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14e5]
        00:18.6 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14e6]
        00:18.7 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14e7]

$ sudo dmesg | grep -i vfio
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-linux root=UUID=2d770838-e86d-4329-ba2d-a96ecd71b7fc rw nvidia_drm.modeset=1 iommu=pt loglevel=3 vfio-pci.ids=1002:164e,1002:1640
[    0.024513] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-linux root=UUID=2d770838-e86d-4329-ba2d-a96ecd71b7fc rw nvidia_drm.modeset=1 iommu=pt loglevel=3 vfio-pci.ids=1002:164e,1002:1640
[    3.457179] VFIO - User Level meta-driver version: 0.3
[    3.465325] vfio-pci 0000:0f:00.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=io+mem:owns=none
[    3.465418] vfio_pci: add [1002:164e[ffffffff:ffffffff]] class 0x000000/00000000
[    3.487397] vfio_pci: add [1002:1640[ffffffff:ffffffff]] class 0x000000/00000000

$ cat /etc/default/grub 
# GRUB boot loader configuration
...
#GRUB_CMDLINE_LINUX_DEFAULT="loglevel=3 quiet"
GRUB_CMDLINE_LINUX_DEFAULT="nvidia_drm.modeset=1 iommu=pt loglevel=3 vfio-pci.ids=1002:164e,1002:1640"
GRUB_CMDLINE_LINUX=""

# Preload both GPT and MBR modules so that they are not missed
GRUB_PRELOAD_MODULES="part_gpt part_msdos"
...

╰─>$ cat /etc/mkinitcpio.conf
...
MODULES=(nvidia nvidia_modeset nvidia_uvm nvidia_drm vfio_pci vfio vfio_iommu_type1)
...
HOOKS=(base udev autodetect modconf keyboard keymap consolefont block filesystems fsck)
..

if i enable threads in cpu topology the error message also says smp is not supported

Error starting domain: internal error: QEMU unexpectedly closed the monitor (vm='win10'): 2023-09-01T18:38:22.547846Z qemu-system-x86_64: warning: This family of AMD CPU doesn't support hyperthreading(2)
Please configure -smp options properly or try enabling topoext feature.
2023-09-01T18:38:22.704568Z qemu-system-x86_64: -device {"driver":"vfio-pci","host":"0000:0f:00.0","id":"hostdev1","bus":"pci.5","addr":"0x0"}: vfio 0000:0f:00.0: group 4 is not viable
Please ensure all devices within the iommu_group are bound to their vfio bus driver.

Traceback (most recent call last):
  File "/usr/share/virt-manager/virtManager/asyncjob.py", line 72, in cb_wrapper
    callback(asyncjob, *args, **kwargs)
  File "/usr/share/virt-manager/virtManager/asyncjob.py", line 108, in tmpcb
    callback(*args, **kwargs)
  File "/usr/share/virt-manager/virtManager/object/libvirtobject.py", line 57, in newfn
    ret = fn(self, *args, **kwargs)
          ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/share/virt-manager/virtManager/object/domain.py", line 1402, in startup
    self._backend.create()
  File "/usr/lib/python3.11/site-packages/libvirt.py", line 1373, in create
    raise libvirtError('virDomainCreate() failed')
libvirt.libvirtError: internal error: QEMU unexpectedly closed the monitor (vm='win10'): 2023-09-01T18:38:22.547846Z qemu-system-x86_64: warning: This family of AMD CPU doesn't support hyperthreading(2)
Please configure -smp options properly or try enabling topoext feature.
2023-09-01T18:38:22.704568Z qemu-system-x86_64: -device {"driver":"vfio-pci","host":"0000:0f:00.0","id":"hostdev1","bus":"pci.5","addr":"0x0"}: vfio 0000:0f:00.0: group 4 is not viable
Please ensure all devices within the iommu_group are bound to their vfio bus driver.

╰─>$ inxi -F
System:
  Host: desktop Kernel: 6.4.12-arch1-1 arch: x86_64 bits: 64
    Desktop: KDE Plasma v: 5.27.7 Distro: Arch Linux
Machine:
  Type: Desktop Mobo: ASRock model: B650M-HDV/M.2 serial: <superuser required>
    UEFI: American Megatrends LLC. v: 1.28 date: 07/28/2023
CPU:
  Info: 8-core model: AMD Ryzen 7 7700X bits: 64 type: MT MCP cache: L2: 8 MiB
  Speed (MHz): avg: 3117 min/max: 3000/5572 cores: 1: 2774 2: 2825 3: 3000
    4: 3668 5: 3000 6: 2796 7: 2880 8: 4399 9: 3000 10: 3000 11: 2878 12: 3000
    13: 3000 14: 3000 15: 2818 16: 3835
Graphics:
  Device-1: NVIDIA GA106 [RTX A2000] driver: nvidia v: 535.104.05
  Device-2: AMD Raphael driver: vfio-pci v: N/A
  Display: x11 server: X.Org v: 21.1.8 with: Xwayland v: 23.2.0 driver: X:
    loaded: nvidia gpu: nvidia,nvidia-nvswitch resolution: 1: 2560x1440~65Hz
    2: 3440x1440
  API: OpenGL v: 4.6.0 NVIDIA 535.104.05 renderer: NVIDIA RTX
    A2000/PCIe/SSE2
Audio:
  Device-1: NVIDIA GA106 High Definition Audio driver: snd_hda_intel
  Device-2: AMD Rembrandt Radeon High Definition Audio driver: vfio-pci
  Device-3: AMD Family 17h/19h HD Audio driver: snd_hda_intel
  API: ALSA v: k6.4.12-arch1-1 status: kernel-api
  Server-1: PipeWire v: 0.3.79 status: active
Network:
  Device-1: MEDIATEK MT7922 802.11ax PCI Express Wireless Network Adapter
    driver: mt7921e
  IF: wlp7s0 state: down mac: x
  Device-2: Realtek RTL8125 2.5GbE driver: r8169
  IF: enp8s0 state: up speed: 100 Mbps duplex: full mac: x
  IF-ID-1: virbr0 state: up speed: 10000 Mbps duplex: unknown
    mac: x
  IF-ID-2: vnet2 state: unknown speed: 10000 Mbps duplex: full
    mac:x
Bluetooth:
  Device-1: Foxconn / Hon Hai Wireless_Device driver: btusb type: USB
  Report: btmgmt ID: hci0 state: up address: x bt-v: 5.2
Drives:
  Local Storage: total: 4.78 TiB used: 772.57 GiB (15.8%)
  ID-1: /dev/nvme0n1 vendor: Kingston model: SNV2S2000G size: 1.82 TiB
  ID-2: /dev/sda vendor: Western Digital model: WD30EZRX-00DC0B0
    size: 2.73 TiB
  ID-3: /dev/sdb vendor: SanDisk model: USB 3.2Gen1 size: 232.88 GiB
    type: USB
Partition:
  ID-1: / size: 261.25 GiB used: 64.06 GiB (24.5%) fs: ext4
    dev: /dev/nvme0n1p3
  ID-2: /boot/efi size: 475.1 MiB used: 31.7 MiB (6.7%) fs: vfat
    dev: /dev/nvme0n1p1
Swap:
  ID-1: swap-1 type: partition size: 35.39 GiB used: 512 KiB (0.0%)
    dev: /dev/nvme0n1p2
Sensors:
  System Temperatures: cpu: 46.1 C mobo: N/A gpu: nvidia temp: 43 C
  Fan Speeds (rpm): N/A gpu: nvidia fan: 30%
Info:
  Processes: 345 Uptime: 39m Memory: total: 32 GiB note: est.
  available: 30.47 GiB used: 12.42 GiB (40.8%) Shell: fish inxi: 3.3.29

Last edited by M440 (2024-04-08 12:34:57)

M440 · 2023-09-01 21:44:11

ok, i installed the linux-zen kernel and the virtual machines are starting but i'm unable to install the AMD drivers (windows code 31)

This device is not working properly because Windows cannot load the drivers required for this device. (Code 31).

The driver trying to start is not the same as the driver for the POSTed display adapter.

 sudo pacman -S linux-zen linux-zen-headers nvidia-dkms

  mm@desktop: ~ $ uname -r
6.4.12-zen1-1-zen

i added the " <vendor_id state='on' value='randomid'/>", but i'm unable to remove the spice - could this be the cause? please help

 mm@desktop: ~ $ for g in $(find /sys/kernel/iommu_groups/* -maxdepth 0 -type d | sort -V); do     echo "IOMMU Group ${g##*/}:";     for d in $g/devices/*; do         echo -e "\t$(lspci -nns ${d##*/})";     done; done;
IOMMU Group 0:
        00:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14da]
IOMMU Group 1:
        00:01.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:14db]
IOMMU Group 2:
        00:01.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:14db]
IOMMU Group 3:
        00:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14da]
IOMMU Group 4:
        00:02.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:14db]
IOMMU Group 5:
        00:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14da]
IOMMU Group 6:
        00:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14da]
IOMMU Group 7:
        00:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14da]
IOMMU Group 8:
        00:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:14dd]
IOMMU Group 9:
        00:08.3 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:14dd]
IOMMU Group 10:
        00:14.0 SMBus [0c05]: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller [1022:790b] (rev 71)
        00:14.3 ISA bridge [0601]: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge [1022:790e] (rev 51)
IOMMU Group 11:
        00:18.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14e0]
        00:18.1 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14e1]
        00:18.2 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14e2]
        00:18.3 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14e3]
        00:18.4 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14e4]
        00:18.5 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14e5]
        00:18.6 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14e6]
        00:18.7 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14e7]
IOMMU Group 12:
        01:00.0 VGA compatible controller [0300]: NVIDIA Corporation GA106 [RTX A2000] [10de:2531] (rev a1)
IOMMU Group 13:
        01:00.1 Audio device [0403]: NVIDIA Corporation GA106 High Definition Audio Controller [10de:228e] (rev a1)
IOMMU Group 14:
        02:00.0 Non-Volatile memory controller [0108]: Kingston Technology Company, Inc. Device [2646:5017] (rev 03)
IOMMU Group 15:
        03:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f4] (rev 01)
IOMMU Group 16:
        04:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f5] (rev 01)
IOMMU Group 17:
        04:01.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f5] (rev 01)
IOMMU Group 18:
        04:02.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f5] (rev 01)
IOMMU Group 19:
        04:03.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f5] (rev 01)
IOMMU Group 20:
        04:04.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f5] (rev 01)
IOMMU Group 21:
        04:05.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f5] (rev 01)
IOMMU Group 22:
        04:06.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f5] (rev 01)
IOMMU Group 23:
        04:08.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f5] (rev 01)
IOMMU Group 24:
        04:0c.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f5] (rev 01)
IOMMU Group 25:
        04:0d.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f5] (rev 01)
IOMMU Group 26:
        07:00.0 Network controller [0280]: MEDIATEK Corp. MT7922 802.11ax PCI Express Wireless Network Adapter [14c3:0616]
IOMMU Group 27:
        08:00.0 Ethernet controller [0200]: Realtek Semiconductor Co., Ltd. RTL8125 2.5GbE Controller [10ec:8125] (rev 05)
IOMMU Group 28:
        0d:00.0 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f7] (rev 01)
IOMMU Group 29:
        0e:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f6] (rev 01)
IOMMU Group 30:
        0f:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Raphael [1002:164e] (rev c3)
IOMMU Group 31:
        0f:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Rembrandt Radeon High Definition Audio Controller [1002:1640]
IOMMU Group 32:
        0f:00.2 Encryption controller [1080]: Advanced Micro Devices, Inc. [AMD] VanGogh PSP/CCP [1022:1649]
IOMMU Group 33:
        0f:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Device [1022:15b6]
IOMMU Group 34:
        0f:00.4 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Device [1022:15b7]
IOMMU Group 35:
        0f:00.6 Audio device [0403]: Advanced Micro Devices, Inc. [AMD] Family 17h/19h HD Audio Controller [1022:15e3]
IOMMU Group 36:
        10:00.0 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Device [1022:15b8]

post edit:

if i just install the drivers manually it shows windows error code 43

Windows has stopped this device because it has reported problems. (Code 43)

edit #2:

i tried bios settings like disabling resizable bar, ARI, but it does not work - windows driver error 43

╰─>$ cat /etc/default/grub
..
GRUB_CMDLINE_LINUX_DEFAULT="nvidia_drm.modeset=1 video=efifb:off amd_iommu=on iommu=pt loglevel=3 vfio-pci.ids=1002:164e,1002:1640 pcie_acs_override=downstream,multifunction"

─>$ sudo cat /proc/iomem
00000000-00000fff : Reserved
00001000-0009ffff : System RAM
000a0000-000fffff : Reserved
  000a0000-000dffff : PCI Bus 0000:00
  000f0000-000fffff : System ROM
00100000-09afefff : System RAM
09aff000-09ffffff : Reserved
0a000000-0a1fffff : System RAM
0a200000-0a20ffff : ACPI Non-volatile Storage
0a210000-0affffff : System RAM
0b000000-0b020fff : Reserved
0b021000-586f5017 : System RAM
  24e00000-25ffffff : Kernel code
  26000000-26c55fff : Kernel rodata
  26e00000-270171bf : Kernel data
  27871000-27bfffff : Kernel bss
586f5018-58719657 : System RAM
58719658-66edb017 : System RAM
66edb018-66ee5e57 : System RAM
66ee5e58-6914ffff : System RAM
69150000-69150fff : Reserved
69151000-6d67efff : System RAM
6d67f000-7367efff : Reserved
7367f000-7567efff : ACPI Tables
7567f000-7767efff : ACPI Non-volatile Storage
7767f000-797fefff : Reserved
797ff000-7bffafff : System RAM
7bffb000-7cffffff : Reserved
7d7f3000-7fffffff : Reserved
80000000-fec02fff : PCI Bus 0000:00
  b0000000-c1ffffff : PCI Bus 0000:01
    b0000000-bfffffff : 0000:01:00.0
    c0000000-c1ffffff : 0000:01:00.0
  d0000000-e01fffff : PCI Bus 0000:0f
    d0000000-dfffffff : 0000:0f:00.0
    e0000000-e01fffff : 0000:0f:00.0
  f0000000-f7ffffff : PCI MMCONFIG 0000 [bus 00-7f]
    f0000000-f7ffffff : pnp 00:00
  fb000000-fc0fffff : PCI Bus 0000:01
    fb000000-fbffffff : 0000:01:00.0
      fb000000-fbffffff : nvidia
    fc000000-fc07ffff : 0000:01:00.0
    fc080000-fc083fff : 0000:01:00.1
      fc080000-fc083fff : ICH HD audio
  fc200000-fc6fffff : PCI Bus 0000:03
    fc200000-fc6fffff : PCI Bus 0000:04
      fc200000-fc3fffff : PCI Bus 0000:07
        fc200000-fc2fffff : 0000:07:00.0
          fc200000-fc2fffff : 0000:07:00.0
        fc300000-fc307fff : 0000:07:00.0
      fc400000-fc4fffff : PCI Bus 0000:0e
        fc400000-fc47ffff : 0000:0e:00.0
        fc480000-fc4803ff : 0000:0e:00.0
          fc480000-fc4803ff : ahci
      fc500000-fc5fffff : PCI Bus 0000:0d
        fc500000-fc507fff : 0000:0d:00.0
          fc500000-fc507fff : xhci-hcd
      fc600000-fc6fffff : PCI Bus 0000:08
        fc600000-fc60ffff : 0000:08:00.0
          fc600000-fc60ffff : r8169
        fc610000-fc613fff : 0000:08:00.0
  fc700000-fcafffff : PCI Bus 0000:0f
    fc700000-fc7fffff : 0000:0f:00.4
      fc700000-fc7fffff : xhci-hcd
    fc800000-fc8fffff : 0000:0f:00.3
      fc800000-fc8fffff : xhci-hcd
    fc900000-fc9fffff : 0000:0f:00.2
      fc900000-fc9fffff : ccp
    fca00000-fca7ffff : 0000:0f:00.0
    fca80000-fca87fff : 0000:0f:00.6
      fca80000-fca87fff : ICH HD audio
    fca88000-fca8bfff : 0000:0f:00.1
    fca8c000-fca8dfff : 0000:0f:00.2
      fca8c000-fca8dfff : ccp
  fcb00000-fcbfffff : PCI Bus 0000:10
    fcb00000-fcbfffff : 0000:10:00.0
      fcb00000-fcbfffff : xhci-hcd
  fcc00000-fccfffff : PCI Bus 0000:02
    fcc00000-fcc03fff : 0000:02:00.0
      fcc00000-fcc03fff : nvme
  fd600000-fd67ffff : amd_iommu
  feb00000-feb00007 : SB800 TCO
  fec00000-fec003ff : IOAPIC 0
  fec01000-fec013ff : IOAPIC 1
fec10000-fec10fff : pnp 00:04
fec30000-fec30fff : AMDIF031:00
  fec30000-fec30fff : AMDIF031:00 AMDIF031:00
fed00000-fed003ff : HPET 0
  fed00000-fed003ff : PNP0103:00
fed81500-fed818ff : AMDI0030:00
  fed81500-fed818ff : AMDI0030:00 AMDI0030:00
fedc0000-fedc0fff : pnp 00:04
fee00000-ffffffff : PCI Bus 0000:00
  fee00000-fee00fff : Local APIC
    fee00000-fee00fff : Reserved
      fee00000-fee00fff : pnp 00:04
  ff000000-ffffffff : pnp 00:04
100000000-877ffffff : System RAM
878000000-87bffffff : Reserved
  878000000-87bffffff : pnp 00:01
87ef40000-87fffffff : Reserved
fd00000000-ffffffffff : Reserved

edit #3

unable to dump the igpu apu bios using

 mm@desktop: /sys/bus/pci/devices/0000:0f:00.0 $ sudo echo 1 >rom
bash: rom: Permission denied

i'm not able to do the dump of the other GPU A2000 using this method either

Last edited by M440 (2023-09-02 13:20:48)

M440 · 2024-04-08 12:34:10

i was able to make it work thanks to guide:

https://github.com/isc30/ryzen-7000-series-proxmox

basically we now can extract iGPU bios and use it, so the windows error code 43 is gone

❯ cat /etc/modprobe.d/vfio.conf

options vfio-pci ids=1002:164e,1002:1640
#softdep drm pre: vfio-pci
softdep radeon pre: vfio-pci
softdep amdgpu pre: vfio-pci
softdep snd_hda_intel pre: vfio-pci

Arch Linux

#1 2023-09-01 18:41:20

[SOLVED] Ryzen 7000 IGPU QEMU passthrough

#2 2023-09-01 21:44:11

Re: [SOLVED] Ryzen 7000 IGPU QEMU passthrough

#3 2024-04-08 12:34:10

Re: [SOLVED] Ryzen 7000 IGPU QEMU passthrough

Board footer