You are not logged in.

#1 2018-01-27 22:21:29

NeroBurner
Member
Registered: 2013-09-05
Posts: 30

PCI Passthrough Geforce GTX 560 ti fails

Specs:
- Motherboard: GIGABYTE Aorus GA-AX370-Gaming 5
  - most up to date BIOS F10 (same error with F6)
  - IOMMU enabled
  - virtualization enabled
- CPU: AMD Ryzen 5 1600 Six-Core Processor
- Host-GPU: Nvidia GTX 780Ti
- Guest-GPU: Nvidia GTX 560Ti
- Driver: nvidia 387.34-21
- Virtualization: virt-manager + KVM

I'm trying to get PCI Passthrough to work following https://wiki.archlinux.org/index.php/PC … h_via_OVMF

I installed Arch as guest system and want to pass my old Geforce GTX 560Ti to the guest system. Install of the system runs fine. Pass the GPU, second Monitor lights up. Having a good feeling, all is working.

When I install nvidia proprietary drivers I get the following errors in the host

NVRM: RmInitAdapter failed! (0x23:0x56:471)
NVRM: rm_init_adapter failed for device bearing minor number 0

Full dmesg log since nvidia kernel loading:

[    7.961044] nvidia: loading out-of-tree module taints kernel.
[    7.961051] nvidia: module license 'NVIDIA' taints kernel.
[    7.961051] Disabling lock debugging due to kernel taint
[    7.977392] nvidia-nvlink: Nvlink Core is being initialized, major device number 243
[    7.991628] nvidia 0000:00:02.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=none:owns=io+mem
[    7.991731] NVRM: loading NVIDIA UNIX x86_64 Kernel Module  387.34  Tue Nov 21 03:09:00 PST 2017 (using threaded interrupts)
[    8.135208] usbcore: registered new interface driver usbhid
[    8.135211] usbhid: USB HID core driver
[    8.153764] input: Logitech USB Receiver as /devices/pci0000:00/0000:00:05.0/usb2/2-1/2-1:1.0/0003:046D:C52E.0001/input/input7
[    8.211202] hid-generic 0003:046D:C52E.0001: input,hidraw0: USB HID v1.11 Keyboard [Logitech USB Receiver] on usb-0000:00:05.0-1/input0
[    8.211768] input: Logitech USB Receiver as /devices/pci0000:00/0000:00:05.0/usb2/2-1/2-1:1.1/0003:046D:C52E.0002/input/input9
[    8.224048] nvidia-modeset: Loading NVIDIA Kernel Mode Setting Driver for UNIX platforms  387.34  Tue Nov 21 02:09:45 PST 2017
[    8.238905] [drm] [nvidia-drm] [GPU ID 0x00000002] Loading driver
[    8.238909] [drm] Initialized nvidia-drm 0.0.0 20160202 for 0000:00:02.0 on minor 0
[    8.267488] hid-generic 0003:046D:C52E.0002: input,hiddev0,hidraw1: USB HID v1.11 Mouse [Logitech USB Receiver] on usb-0000:00:05.0-1/input1
[    8.267706] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:05.7/usb1/1-2/1-2:1.0/0003:0627:0001.0003/input/input10
[    8.268337] hid-generic 0003:0627:0001.0003: input,hidraw2: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:05.7-2/input0
[    8.293974] mousedev: PS/2 mouse device common for all mice
[    8.307367] input: HDA NVidia HDMI/DP,pcm=3 as /devices/pci0000:00/0000:00:0a.0/sound/card1/input5
[    8.307439] input: HDA NVidia HDMI/DP,pcm=7 as /devices/pci0000:00/0000:00:0a.0/sound/card1/input6
[    8.307501] input: HDA NVidia HDMI/DP,pcm=8 as /devices/pci0000:00/0000:00:0a.0/sound/card1/input8
[    8.307559] input: HDA NVidia HDMI/DP,pcm=9 as /devices/pci0000:00/0000:00:0a.0/sound/card1/input11
[    8.312910] input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input4
[   11.227688] IPv6: ADDRCONF(NETDEV_UP): ens3: link is not ready
[   12.665586] NVRM: RmInitAdapter failed! (0x23:0x56:471)
[   12.665844] NVRM: rm_init_adapter failed for device bearing minor number 0
[   12.745222] NVRM: RmInitAdapter failed! (0x23:0x56:471)
[   12.745538] NVRM: rm_init_adapter failed for device bearing minor number 0
[   12.749669] traps: lightdm[329] general protection ip:5632c458a20b sp:7ffeac821f60 error:0 in lightdm[5632c4577000+40000]
[   13.226291] NVRM: RmInitAdapter failed! (0x23:0x56:471)
[   13.226506] NVRM: rm_init_adapter failed for device bearing minor number 0
[   13.245076] NVRM: RmInitAdapter failed! (0x23:0x56:471)
[   13.245257] NVRM: rm_init_adapter failed for device bearing minor number 0
[   13.247205] traps: lightdm[399] general protection ip:555a5cdc820b sp:7ffc31358a10 error:0 in lightdm[555a5cdb5000+40000]
[   13.589759] NVRM: RmInitAdapter failed! (0x23:0x56:471)
[   13.589912] NVRM: rm_init_adapter failed for device bearing minor number 0
[   13.611829] NVRM: RmInitAdapter failed! (0x23:0x56:471)
[   13.612111] NVRM: rm_init_adapter failed for device bearing minor number 0
[   13.615709] traps: lightdm[421] general protection ip:559f2e98920b sp:7ffd26114ac0 error:0 in lightdm[559f2e976000+40000]
[   13.954749] NVRM: RmInitAdapter failed! (0x23:0x56:471)
[   13.954944] NVRM: rm_init_adapter failed for device bearing minor number 0
[   13.973771] NVRM: RmInitAdapter failed! (0x23:0x56:471)
[   13.973952] NVRM: rm_init_adapter failed for device bearing minor number 0
[   13.975489] traps: lightdm[443] general protection ip:563db6d6a20b sp:7ffc58ba5f00 error:0 in lightdm[563db6d57000+40000]
[   14.508880] NVRM: RmInitAdapter failed! (0x23:0x56:471)
[   14.509169] NVRM: rm_init_adapter failed for device bearing minor number 0
[   14.545422] NVRM: RmInitAdapter failed! (0x23:0x56:471)
[   14.545792] NVRM: rm_init_adapter failed for device bearing minor number 0
[   14.549289] traps: lightdm[465] general protection ip:5608d7f4c20b sp:7ffee31e9dc0 error:0 in lightdm[5608d7f39000+40000]

With nouveau driver the second display turns on and everything works as expected for the first boot of the guest. For other boots the display stays off and many errors are printed to dmesg. Only after a host reboot the guest works again.

nouveau module loading on first guest boot:

[    5.005053] nouveau 0000:00:02.0: NVIDIA GF114 (0ce000a1)
[    5.014643] IPv6: ADDRCONF(NETDEV_UP): ens3: link is not ready
[    5.176254] nouveau 0000:00:02.0: bios: version 70.24.11.00.01
[    5.301776] nouveau 0000:00:02.0: fb: 1024 MiB GDDR5
[    5.312860] nouveau 0000:00:02.0: iccsense: found invalid sensor id: 1, power readingmight be invalid
[    5.313930] nouveau 0000:00:02.0: iccsense: found invalid sensor id: 2, power readingmight be invalid
[    5.315049] nouveau 0000:00:02.0: iccsense: found invalid sensor id: 3, power readingmight be invalid
[    5.368908] [TTM] Zone  kernel: Available graphics memory: 1538058 kiB
[    5.368909] [TTM] Initializing pool allocator
[    5.368915] [TTM] Initializing DMA pool allocator
[    5.368930] nouveau 0000:00:02.0: DRM: VRAM: 1024 MiB
[    5.368931] nouveau 0000:00:02.0: DRM: GART: 1048576 MiB
[    5.368934] nouveau 0000:00:02.0: DRM: TMDS table version 2.0
[    5.368936] nouveau 0000:00:02.0: DRM: DCB version 4.0
[    5.368937] nouveau 0000:00:02.0: DRM: DCB outp 00: 02000300 00000000
[    5.368939] nouveau 0000:00:02.0: DRM: DCB outp 01: 01000302 00020030
[    5.368940] nouveau 0000:00:02.0: DRM: DCB outp 02: 04011380 00000000
[    5.368941] nouveau 0000:00:02.0: DRM: DCB outp 03: 08011382 00020030
[    5.368942] nouveau 0000:00:02.0: DRM: DCB outp 04: 02022362 00020010
[    5.368944] nouveau 0000:00:02.0: DRM: DCB conn 00: 00001030
[    5.368945] nouveau 0000:00:02.0: DRM: DCB conn 01: 00010130
[    5.368946] nouveau 0000:00:02.0: DRM: DCB conn 02: 00002261
[    5.370822] [drm] Supports vblank timestamp caching Rev 2 (21.10.2013).
[    5.370823] [drm] Driver supports precise vblank timestamp query.
[    5.456950] nouveau 0000:00:02.0: DRM: MM: using COPY0 for buffer copies
[    5.620164] nouveau 0000:00:02.0: DRM: allocated 1680x1050 fb: 0x60000, bo ffff8bfbb22bd800
[    5.620681] fbcon: nouveaufb (fb0) is primary device
[    5.621890] Console: switching to colour frame buffer device 210x65
[    5.621902] nouveau 0000:00:02.0: fb0: nouveaufb frame buffer device
[    5.633392] [drm] Initialized nouveau 1.3.1 20120801 for 0000:00:02.0 on minor 0
[    5.644218] input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input4
[    5.763953] input: HDA NVidia HDMI/DP,pcm=3 as /devices/pci0000:00/0000:00:0a.0/sound/card1/input8
[    5.764039] input: HDA NVidia HDMI/DP,pcm=7 as /devices/pci0000:00/0000:00:0a.0/sound/card1/input9
[    5.764113] input: HDA NVidia HDMI/DP,pcm=8 as /devices/pci0000:00/0000:00:0a.0/sound/card1/input10
[    5.764184] input: HDA NVidia HDMI/DP,pcm=9 as /devices/pci0000:00/0000:00:0a.0/sound/card1/input11
[   10.260656] fuse init (API version 7.26)

on the following guest boots the following errors are displayed

[    7.842474] nouveau 0000:00:02.0: bus: MMIO read of 00000000 FAULT at 610270 [ IBUS ]                                             
[    7.842477] nouveau 0000:00:02.0: timeout
[    7.842493] ------------[ cut here ]------------
[    7.842533] WARNING: CPU: 1 PID: 213 at drivers/gpu/drm/nouveau/nvkm/engine/disp/piocnv50.c:72 nv50_disp_pioc_init+0x1b7/0x210 [nouveau]
[    7.842534] Modules linked in: snd_hda_codec_hdmi joydev mousedev nouveau(+) hid_generic mxm_wmi wmi video snd_hda_codec_generic i2c_algo_bit ttm drm_kms_helper snd_hda_intel snd_hda_codec usbhid crct10dif_pclmul drm snd_hda_core crc32_pclmul hid nls_iso8859_1 nls_cp437 ghash_clmulni_intel vfat snd_hwdep fat pcbc ppdev snd_pcm aesni_intel evdev input_leds aes_x86_64 crypto_simd led_class glue_helper snd_timer cryptd mac_hid psmouse pcspkr intel_agp snd intel_gtt syscopyarea sysfillrect sysimgblt fb_sys_fops soundcore i2c_piix4 agpgart parport_pc parport button qemu_fw_cfg sch_fq_codel sg crypto_user ip_tables x_tables ext4 crc16 mbcache jbd2 fscrypto sr_mod cdrom ata_generic virtio_rng virtio_net virtio_console virtio_blk rng_core virtio_balloon pata_acpi uhci_hcd serio_raw atkbd libps2 crc32c_intel
[    7.842568]  ata_piix floppy i8042 libata serio virtio_pci ehci_pci ehci_hcd virtio_ring virtio usbcore usb_common scsi_mod
[    7.842575] CPU: 1 PID: 213 Comm: systemd-udevd Tainted: G        W       4.14.15-1-ARCH #1
[    7.842576] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 0.0.0 02/06/2015
[    7.842577] task: ffff9a5efcbfc9c0 task.stack: ffffc07e80918000
[    7.842604] RIP: 0010:nv50_disp_pioc_init+0x1b7/0x210 [nouveau]
[    7.842605] RSP: 0018:ffffc07e8091b7b0 EFLAGS: 00010282
[    7.842607] RAX: 000000000000001d RBX: ffff9a5efe53f4c0 RCX: 000000000000001d
[    7.842608] RDX: 0000000000000000 RSI: 0000000000000002 RDI: 0000000000000282
[    7.842609] RBP: 0000000000610270 R08: 00000006f621a410 R09: 000000000000001d
[    7.842609] R10: ffff9a5ef5f6bc00 R11: 0000000000047bec R12: ffff9a5eff3e2000
[    7.842610] R13: ffff9a5ef5e6ad20 R14: ffff9a5ef5f6bc00 R15: 000000015c3b92c0
[    7.842613] FS:  00007ff2347df8c0(0000) GS:ffff9a5efed00000(0000) knlGS:0000000000000000
[    7.842616] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    7.842616] CR2: 0000557534e30c18 CR3: 00000000bca64000 CR4: 00000000003406e0
[    7.842619] Call Trace:
[    7.842644]  nvkm_object_init+0x3d/0x180 [nouveau]
[    7.842665]  nvkm_ioctl_new+0x1cc/0x290 [nouveau]
[    7.842691]  ? nv50_disp_root_dmac_new_+0x40/0x40 [nouveau]
[    7.842711]  nvkm_ioctl+0x10a/0x240 [nouveau]
[    7.842731]  nvif_object_init+0xbf/0x110 [nouveau]
[    7.842758]  nv50_display_create+0x8b8/0xf10 [nouveau]
[    7.842783]  nouveau_display_create+0x494/0x680 [nouveau]
[    7.842808]  nouveau_drm_load+0x1e9/0x8f0 [nouveau]
[    7.842818]  drm_dev_register+0x132/0x1c0 [drm]
[    7.842826]  drm_get_pci_dev+0x93/0x170 [drm]
[    7.842849]  nouveau_drm_probe+0x1cd/0x250 [nouveau]
[    7.842853]  local_pci_probe+0x42/0xa0
[    7.842855]  ? pci_match_device+0xde/0x110
[    7.842856]  pci_device_probe+0x146/0x1b0
[    7.842861]  driver_probe_device+0x2ff/0x450
[    7.842863]  __driver_attach+0xa0/0xe0
[    7.842864]  ? driver_probe_device+0x450/0x450
[    7.842866]  bus_for_each_dev+0x6b/0xb0
[    7.842867]  bus_add_driver+0x1c2/0x260
[    7.842869]  ? 0xffffffffc0b76000
[    7.842870]  driver_register+0x57/0xc0
[    7.842871]  ? 0xffffffffc0b76000
[    7.842873]  do_one_initcall+0x4e/0x190
[    7.842876]  ? kmem_cache_alloc_trace+0x99/0x1b0
[    7.842879]  do_init_module+0x5b/0x1ea
[    7.842880]  load_module+0x2542/0x2ad0
[    7.842883]  ? SYSC_init_module+0x15b/0x190
[    7.842885]  SYSC_init_module+0x15b/0x190
[    7.842887]  do_syscall_64+0x5a/0x120
[    7.842890]  entry_SYSCALL64_slow_path+0x25/0x25
[    7.842891] RIP: 0033:0x7ff23410c6ca
[    7.842892] RSP: 002b:00007ffe75a84e78 EFLAGS: 00000246 ORIG_RAX: 00000000000000af
[    7.842893] RAX: ffffffffffffffda RBX: 000055ba39e9ea40 RCX: 00007ff23410c6ca
[    7.842894] RDX: 00007ff2339d2cb5 RSI: 00000000003838e8 RDI: 000055ba3a86e680
[    7.842894] RBP: 00007ff2339d2cb5 R08: 0000000000000005 R09: 0000000000000000
[    7.842895] R10: 0000000000000005 R11: 0000000000000246 R12: 000055ba3a86e680
[    7.842896] R13: 000055ba39e9fcd0 R14: 0000000000020000 R15: 00007ffe75a85970
[    7.842897] Code: eb 8f 49 8b 7c 24 10 48 8b 5f 50 48 85 db 75 04 48 8b 5f 10 e8 9b 28 a8 cb 48 89 da 48 89 c6 48 c7 c7 42 2c b2 c0 e8 74 e5 6c cb <0f> ff 41 8b 46 50 85 c0 0f 84 79 ff ff ff 49 8b 7c 24 78 48 01 
[    7.842917] ---[ end trace a2f92d7a5344e47c ]---
[    7.842980] nouveau 0000:00:02.0: disp: ch 7 timeout1: 00000000
[    7.842986] nouveau: DRM:00000000:0000857a: init failed with -16
[    7.843359] nouveau 0000:00:02.0: bus: MMIO read of 00000000 FAULT at 610270 [ IBUS ]
[    7.843372] nouveau 0000:00:02.0: DRM: curs857a allocation failed: -16
[    7.843828] nouveau 0000:00:02.0: bus: MMIO read of 00000000 FAULT at 610200 [ IBUS ]
[    7.844264] [TTM] Finalizing pool allocator
[    7.844267] [TTM] Finalizing DMA pool allocator
[    7.844300] [TTM] Zone  kernel: Used memory at exit: 0 kiB
[    7.844437] nouveau 0000:00:02.0: bus: MMIO read of 00000000 FAULT at 610210 [ IBUS ]
[    7.925531] traps: lightdm[371] general protection ip:55b5109bf20b sp:7ffe6ce0c950 error:0 in lightdm[55b5109ac000+40000]
[    7.936364] nouveau: probe of 0000:00:02.0 failed with error -16
[    8.422490] traps: lightdm[391] general protection ip:5559c1ade20b sp:7ffe4f0f8e90 error:0 in lightdm[5559c1acb000+40000]
[    8.878389] traps: lightdm[406] general protection ip:55573ba0620b sp:7ffc956dc200 error:0 in lightdm[55573b9f3000+40000]
[    9.242017] traps: lightdm[420] general protection ip:557b42fb020b sp:7ffd71a21520 error:0 in lightdm[557b42f9d000+40000]

I'd like to use the closed drivers for performance. I'm not able to find the reason for the non starting X-Server

I tried Ubuntu 16.04 and 17.10 as the guest OS with the same errors

I found https://devtalk.nvidia.com/default/topi … works-fine
It says, that nvidia-367 worked fine, but nvidia-370 broke his gtx 460. The bug was apparently fixed with nvidia-375

I don't know what to try next

Edit:
tried AUR-Package nvidia-beta with 390.12, still no luck

[    9.224410] nvidia: loading out-of-tree module taints kernel.
[    9.224421] nvidia: module license 'NVIDIA' taints kernel.
[    9.224422] Disabling lock debugging due to kernel taint
[    9.248704] nvidia-nvlink: Nvlink Core is being initialized, major device number 242
[    9.264080] nvidia 0000:00:02.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=none:owns=io+mem
[    9.264203] NVRM: loading NVIDIA UNIX x86_64 Kernel Module  390.12  Wed Dec 20 07:19:16 PST 2017 (using threaded interrupts)
[    9.564892] nvidia-modeset: Loading NVIDIA Kernel Mode Setting Driver for UNIX platforms  390.12  Wed Dec 20 06:13:53 PST 2017
[    9.577835] [drm] [nvidia-drm] [GPU ID 0x00000002] Loading driver
[    9.577839] [drm] Initialized nvidia-drm 0.0.0 20160202 for 0000:00:02.0 on minor 0
[   12.590129] IPv6: ADDRCONF(NETDEV_UP): ens3: link is not ready
[   13.956941] NVRM: RmInitAdapter failed! (0x23:0x56:471)
[   13.957246] NVRM: rm_init_adapter failed for device bearing minor number 0
[   14.037216] NVRM: RmInitAdapter failed! (0x23:0x56:471)
[   14.037589] NVRM: rm_init_adapter failed for device bearing minor number 0
[   14.041465] traps: lightdm[330] general protection ip:55b5b28c320b sp:7ffe0e6dd3e0 error:0 in lightdm[55b5b28b0000+40000]
[   14.545542] NVRM: RmInitAdapter failed! (0x23:0x56:471)
[   14.545931] NVRM: rm_init_adapter failed for device bearing minor number 0
[   14.581916] NVRM: RmInitAdapter failed! (0x23:0x56:471)
[   14.582311] NVRM: rm_init_adapter failed for device bearing minor number 0
[   14.585565] traps: lightdm[397] general protection ip:55fbeda8d20b sp:7ffc137bff30 error:0 in lightdm[55fbeda7a000+40000]
[   14.949913] NVRM: RmInitAdapter failed! (0x23:0x56:471)
[   14.950271] NVRM: rm_init_adapter failed for device bearing minor number 0
[   14.980539] NVRM: RmInitAdapter failed! (0x23:0x56:471)
[   14.980686] NVRM: rm_init_adapter failed for device bearing minor number 0
[   14.982712] traps: lightdm[419] general protection ip:55c3ea22f20b sp:7ffdfaa28370 error:0 in lightdm[55c3ea21c000+40000]
[   15.280212] NVRM: RmInitAdapter failed! (0x23:0x56:471)
[   15.280596] NVRM: rm_init_adapter failed for device bearing minor number 0
[   15.315771] NVRM: RmInitAdapter failed! (0x23:0x56:471)
[   15.316038] NVRM: rm_init_adapter failed for device bearing minor number 0
[   15.318583] traps: lightdm[443] general protection ip:557a7f1ff20b sp:7ffd299ee870 error:0 in lightdm[557a7f1ec000+40000]
[   15.638746] NVRM: RmInitAdapter failed! (0x23:0x56:471)
[   15.639188] NVRM: rm_init_adapter failed for device bearing minor number 0
[   15.659171] NVRM: RmInitAdapter failed! (0x23:0x56:471)
[   15.659333] NVRM: rm_init_adapter failed for device bearing minor number 0
[   15.661316] traps: lightdm[462] general protection ip:55c2423a120b sp:7ffe530a5420 error:0 in lightdm[55c24238e000+40000]

Last edited by NeroBurner (2018-01-27 22:57:45)

Offline

Board footer

Powered by FluxBB