KVM VGA-Passthrough using the new vfio-vga support in kernel =>3.9

andy123 · 2013-06-26 10:14:16

I missed the "vfio_dma_map", which indicates some things, but I'm not the expert here. I managed to set this up and did some strange stuff with (1GB) hugepages, so I thought it might be that.
Maybe nbhs has some ideas.

alpha_one_x86 · 2013-06-26 13:00:46

Fixed by kdesu, now I have:
qemu-system-x86_64: virtio_ioport_write: unexpected address 0x13 value 0x1
Add crash into amd officiel windows drivers. Blue screen at windows boot.

Last edited by alpha_one_x86 (2013-06-26 13:01:03)

alphaniner · 2013-06-26 13:22:10

@rabcor

You still have a rogue space after the first -device vfio-pci.

# qemu-system-x86_64 ... -device vfio-pci, host=01:00.0,...

I put a space in a working command and got a "could not open disk image" error, so that could be it.

Last edited by alphaniner (2013-06-26 13:22:39)

andy123 · 2013-06-26 13:22:31

alpha_one_x86 wrote:

Add crash into amd officiel windows drivers. Blue screen at windows boot.

Sounds like you're not using a vfio-vga-reset patched qemu+kernel. Is it a fresh windows install or are you trying to migrate an old one?

alpha_one_x86 · 2013-06-26 13:26:07

andy123 wrote:

alpha_one_x86 wrote:
Add crash into amd officiel windows drivers. Blue screen at windows boot.
Sounds like you're not using a vfio-vga-reset patched qemu+kernel. Is it a fresh windows install or are you trying to migrate an old one?

Near to be fresh. I will try the patch, and after the clean install.

EDIT: This repository is temporarily unavailable.
The backend storage is temporarily offline. Usually this means the storage server is undergoing maintenance. Please contact support if the problem persists.

Some body can send me the patch?

Last edited by alpha_one_x86 (2013-06-26 13:31:41)

nbhs · 2013-06-27 04:45:56

alpha_one_x86 wrote:

andy123 wrote:
alpha_one_x86 wrote:
Add crash into amd officiel windows drivers. Blue screen at windows boot.
Sounds like you're not using a vfio-vga-reset patched qemu+kernel. Is it a fresh windows install or are you trying to migrate an old one?
Near to be fresh. I will try the patch, and after the clean install.
EDIT: This repository is temporarily unavailable.
The backend storage is temporarily offline. Usually this means the storage server is undergoing maintenance. Please contact support if the problem persists.
Some body can send me the patch?

On page 6 i posted some builds for arch that contains the patches

powerhouse · 2013-06-27 07:23:18

apocolypse600 wrote:

Where does everyone keep up to date with news about VGA passthrough? I follow this thread, http://forums.linuxmint.com/viewtopic.php?f=42&t=112013 and http://www.overclock.net/t/1205216/guid … al-machine , although those are both aimed at passthrough via Xen rather than KVM. I also follow the xen-users, xen-devel and kvm general mailing lists. I notice that nbhs sometimes posts from a different mailing list (like the post directly before this one), but I can't find an easy way to navigate that list. Mailing lists aren't really my thing though, so that could be why. The KVM irc on freenode is pretty quiet most of the time, but I usually lurk there aswell.
...

Have been busy moving to a new appartment, so sorry for the late reply.

About the Linux Mint forum thread on VGA passthrough: I'm not an expert in Linux/virtualization/etc., but I usually get things done somehow. My favorite distro is Linux Mint and since there wasn't any VGA passthrough guide for Linux Mint, I simply wrote one. If you're looking for the latest developments in Xen, then that thread will probably not help you much. It doesn't cover KVM at all, at least not now. I hope to be able to update it for LM15 and Xen 4.2 with xl toolstack.
My aim was to get VGA passthrough working without the need for kernel/Xen patches, etc., just using standard packages. I definitely chose the hardware to support the software (Xen), not vice versa.

This thread here is my main source for info on KVM, and for getting a general perspective on KVM versus Xen. But I haven't tried KVM, yet. One reason for not trying KVM in the first place was the lack of documentation on the Internet, but nbhs is doing a good job here. Today I would definitely give KVM a try.

I second the advice of nbhs about choosing the right video card!

Last edited by powerhouse (2013-06-27 07:24:23)

alpha_one_x86 · 2013-06-27 08:37:41

nbhs wrote:

On page 6 i posted some builds for arch that contains the patches

I have gentoo + custom kernel build, then I need a patch more than all.

nbhs · 2013-06-27 10:01:54

alpha_one_x86 wrote:

nbhs wrote:
On page 6 i posted some builds for arch that contains the patches
I have gentoo + custom kernel build, then I need a patch more than all.

Yeah i know, but the zip packages contains the needed patches

alpha_one_x86 · 2013-06-27 10:17:17

I prefer do my self the patching, but well, you speak well about: message of 2013-06-21 00:17:12, no? I can't dl: Error 102 (net::ERR_CONNECTION_REFUSED): The server refused the connection.

nbhs · 2013-06-27 10:26:41

alpha_one_x86 wrote:

I prefer do my self the patching, but well, you speak well about: message of 2013-06-21 00:17:12, no? I can't dl: Error 102 (net::ERR_CONNECTION_REFUSED): The server refused the connection.

kernel and qemu patches here: http://www.fileswap.com/dl/LFDgdLJbyj/

dogblue · 2013-06-27 11:03:47

nbhs wrote:

NIce! have you tried the patched nvidia drivers yet?

Yep, no trouble there at all actually, or at least no trouble that wasn't due to my own unfamiliarity with Arch :)

I have a couple of minor issues on the windows side (BSOD installing certain drivers), but nothing that can't be resolved, I think.
I can also confirm that the Etron EJ168 USB controller mentioned earlier in this thread is a pain to get going in Win 7 (had to test-sign drivers, etc), but it worked out of the box for me in Win 8.

I'm going to get the rest of these drivers installed then work my way through the optimizations that you posted on the first page. I'll report back with results and/or any more questions.

alpha_one_x86 · 2013-06-27 11:36:22

On linux 3.10 RC7, I have to do manual patching, after I have the error:

drivers/pci/pci.c:3261:2: error: implicit declaration of function 'pci_hp_reset_slot' [-Werror=implicit-function-declaration]

Then I have put into the header:
int pci_hp_reset_slot(struct hotplug_slot *hotplug, int probe);
After it:

*drivers/vfio/pci/vfio_pci.c:85:10: error: 'irq_type' undeclared (first use in this function)

unknow resolution, can you help me?

*drivers/vfio/pci/vfio_pci.c:268:3: error: duplicate (or overlapping) case value
*drivers/vfio/pci/vfio_pci.c:257:3: error: this is the first entry overlapping that value

Fixed the switch.

*drivers/vfio/pci/vfio_pci.c:416:18: error: 'VFIO_DEVICE_PCI_BUS_RESET' undeclared (first use in this function)

resolved by define into the header.
Do you think release patch for 3.10 final?
After I will try patch qemu.

Last edited by alpha_one_x86 (2013-06-27 11:36:54)

nbhs · 2013-06-27 18:13:40

alpha_one_x86 wrote:

On linux 3.10 RC7, I have to do manual patching, after I have the error:
drivers/pci/pci.c:3261:2: error: implicit declaration of function 'pci_hp_reset_slot' [-Werror=implicit-function-declaration]
Then I have put into the header:
int pci_hp_reset_slot(struct hotplug_slot *hotplug, int probe);
After it:
*drivers/vfio/pci/vfio_pci.c:85:10: error: 'irq_type' undeclared (first use in this function)
unknow resolution, can you help me?
*drivers/vfio/pci/vfio_pci.c:268:3: error: duplicate (or overlapping) case value
*drivers/vfio/pci/vfio_pci.c:257:3: error: this is the first entry overlapping that value
Fixed the switch.
*drivers/vfio/pci/vfio_pci.c:416:18: error: 'VFIO_DEVICE_PCI_BUS_RESET' undeclared (first use in this function)
resolved by define into the header.
Do you think release patch for 3.10 final?
After I will try patch qemu.

You need to build pcie hotplug static instead of as a module, i suggest you use kernel 3.9

Last edited by nbhs (2013-06-27 18:30:56)

alpha_one_x86 · 2013-06-27 19:07:38

I need the kernel 3.10 to my haswell.
PCIe hotplug already in static.

nbhs · 2013-06-27 19:09:56

For 3.10-rc7 try this patch kernel-vfio-vga-reset.patch.tar.gz

alpha_one_x86 · 2013-06-28 08:28:10

Well same, under windows (with kernel + qemu patched):
http://files.first-world.info/temp/ati-crash.png
And in console:

qemu-system-x86_64: virtio_ioport_write: unexpected address 0x13 value 0x1

nbhs · 2013-06-28 16:09:07

alpha_one_x86 wrote:

Well same, under windows (with kernel + qemu patched):
http://files.first-world.info/temp/ati-crash.png
And in console:
qemu-system-x86_64: virtio_ioport_write: unexpected address 0x13 value 0x1

Could you please post your qemu cmdline

perfectsine · 2013-06-28 22:00:48

nbhs,

Do foresee any problems with doing multiple VM's and passing a different VGA adapter to each?

-perfectsine

nbhs · 2013-06-29 02:56:24

perfectsine wrote:

nbhs,
Do foresee any problems with doing multiple VM's and passing a different VGA adapter to each?
-perfectsine

I havent tried since i only have 2 cards ( and my brother's gtx 470) but i dont think its a problem if you got it working with one

Last edited by nbhs (2013-06-29 02:58:09)

Chais · 2013-06-30 11:55:25

Thanks a lot for this huge tutorial. I can't say I have fully understood it. I'm quite new to the deeper magic of virtualisation.
My idea is build a gaming system that can run a virtual Windows for those games unavailable for linux.
I'd like to do a primary vga passthrough, as I don't want to buy two potent graphics cards. Since only host or guest will be needing it ata a time that shouldn't be a problem. Just I have no idea how to do it.
If that's impossible for some reason, plan B would be to have have an Intel igp as primary vga for Arch, pass the nvidia through to Windows or, if the VM isn't running, use it for the host with bumblebee. How would I do that?

alpha_one_x86 · 2013-07-01 19:07:45

/usr/bin/qemu-system-x86_64 -drive file=hdd.img,if=virtio,cache=none,aio=native -k fr -alt-grab -m 512 -vga vmware -net nic,vlan=0,model=virtio -net user -rtc base=localtime -smp 4,cores=4,sockets=1 -boot once=c -cpu kvm64,+nx -enable-kvm -device vfio-pci,host=01:00.0,multifunction=on,x-vga=on

With x-vga=on I have artifact on my second screen of my dual screen (and black screen for qemu), with it do the BsD.

nbhs · 2013-07-02 03:26:33

alpha_one_x86 wrote:

/usr/bin/qemu-system-x86_64 -drive file=hdd.img,if=virtio,cache=none,aio=native -k fr -alt-grab -m 512 -vga vmware -net nic,vlan=0,model=virtio -net user -rtc base=localtime -smp 4,cores=4,sockets=1 -boot once=c -cpu kvm64,+nx -enable-kvm -device vfio-pci,host=01:00.0,multifunction=on,x-vga=on

With x-vga=on I have artifact on my second screen of my dual screen (and black screen for qemu), with it do the BsD.

You should probably send the redhat dev a bug report (alex williamson), see: http://lists.nongnu.org/archive/html/qe … 00432.html to submit a bug report

teekay · 2013-07-03 13:23:51

I'm going to try this with my Gigabyte 990FXA-UD5, a Nvidia GT-430 (host), and some older Geforce 7xxx which currently rotting in the cellar. (If I can use it for that: great)
The display panel has two inputs, so I'm planning to switch video between host and guest by simply pressing the source button.

But I wonder if it's possible to use a single keyboard and mouse for both host and guest? Not at the same time of course, more like in usual KVM VNC window.
And if so, how's the handling of the focus (vm or host)?
Or would it be better to get a separate PCIe USB controller and use a KVM switch?

Sorry for the maybe stupid question.

andy123 · 2013-07-03 13:35:00

teekay wrote:

But I wonder if it's possible to use a single keyboard and mouse for both host and guest? Not at the same time of course, more like in usual KVM VNC window.
And if so, how's the handling of the focus (vm or host)?
Or would it be better to get a separate PCIe USB controller and use a KVM switch?

Hi,
I use a setup with KVM switch and it's not that complicated, assuming you have multiple usb controllers on your mainboard (are there boards that don't?). You simply have to pass one through to the guest as a PCI device. The host will ignore the input on those, since it doesn't load a driver for it and it'll appear as a normal usb controller to the guest.
I don't thik I get what you mean by "usual KVM VNC window", so no idea about that one.
I hope this helps…

Arch Linux

#176 2013-06-26 10:14:16

Re: KVM VGA-Passthrough using the new vfio-vga support in kernel =>3.9

#177 2013-06-26 13:00:46

Re: KVM VGA-Passthrough using the new vfio-vga support in kernel =>3.9

#178 2013-06-26 13:22:10

Re: KVM VGA-Passthrough using the new vfio-vga support in kernel =>3.9

#179 2013-06-26 13:22:31

Re: KVM VGA-Passthrough using the new vfio-vga support in kernel =>3.9

#180 2013-06-26 13:26:07

Re: KVM VGA-Passthrough using the new vfio-vga support in kernel =>3.9

#181 2013-06-27 04:45:56

Re: KVM VGA-Passthrough using the new vfio-vga support in kernel =>3.9

#182 2013-06-27 07:23:18

Re: KVM VGA-Passthrough using the new vfio-vga support in kernel =>3.9

#183 2013-06-27 08:37:41

Re: KVM VGA-Passthrough using the new vfio-vga support in kernel =>3.9

#184 2013-06-27 10:01:54

Re: KVM VGA-Passthrough using the new vfio-vga support in kernel =>3.9

#185 2013-06-27 10:17:17

Re: KVM VGA-Passthrough using the new vfio-vga support in kernel =>3.9

#186 2013-06-27 10:26:41

Re: KVM VGA-Passthrough using the new vfio-vga support in kernel =>3.9

#187 2013-06-27 11:03:47

Re: KVM VGA-Passthrough using the new vfio-vga support in kernel =>3.9

#188 2013-06-27 11:36:22

Re: KVM VGA-Passthrough using the new vfio-vga support in kernel =>3.9

#189 2013-06-27 18:13:40

Re: KVM VGA-Passthrough using the new vfio-vga support in kernel =>3.9

#190 2013-06-27 19:07:38

Re: KVM VGA-Passthrough using the new vfio-vga support in kernel =>3.9

#191 2013-06-27 19:09:56

Re: KVM VGA-Passthrough using the new vfio-vga support in kernel =>3.9

#192 2013-06-28 08:28:10

Re: KVM VGA-Passthrough using the new vfio-vga support in kernel =>3.9

#193 2013-06-28 16:09:07

Re: KVM VGA-Passthrough using the new vfio-vga support in kernel =>3.9

#194 2013-06-28 22:00:48

Re: KVM VGA-Passthrough using the new vfio-vga support in kernel =>3.9

#195 2013-06-29 02:56:24

Re: KVM VGA-Passthrough using the new vfio-vga support in kernel =>3.9

#196 2013-06-30 11:55:25

Re: KVM VGA-Passthrough using the new vfio-vga support in kernel =>3.9

#197 2013-07-01 19:07:45

Re: KVM VGA-Passthrough using the new vfio-vga support in kernel =>3.9

#198 2013-07-02 03:26:33

Re: KVM VGA-Passthrough using the new vfio-vga support in kernel =>3.9

#199 2013-07-03 13:23:51

Re: KVM VGA-Passthrough using the new vfio-vga support in kernel =>3.9

#200 2013-07-03 13:35:00

Re: KVM VGA-Passthrough using the new vfio-vga support in kernel =>3.9

Board footer