Requesting some changes for xen PKGBUILD to work with --enable-ovmf

zir_blazer · 2014-09-03 23:43:59

For background about this issue, you may want to read these two E-Mails to edk2 Mailing List:

http://sourceforge.net/p/edk2/mailman/e … sg32776907
http://sourceforge.net/p/edk2/mailman/e … sg32793684

Basically, it goes like this:

- Xen can be compiled with the optional --enable-ovmf option, so it can make DomU VMs using UEFI Firmware. Instructions here:
http://wiki.xen.org/wiki/OVMF
This can be done in Arch Linux by adding in the ./configure line of PKGBUILD --enable-ovmf, adding an additional step where makepkg downloads Source Code from edk2 repository.

- Currently, it fails to build that way with this error:
http://lists.xen.org/archives/html/xen- … 02855.html

This error is caused because the edk2 Source Code that xen pulls during build is fresh and doesn't include any patch to make it aware that Arch Linux has both Python 3 (python) and Python 2 (python2). By default, it tries to compile with Python 3, so it fails.

- Assuming than the Python version issue was fixed (I did it in a non-elegant way, replacing /usr/bin/python with /usr/bin/python2), it will still fail with this error:
https://bugs.archlinux.org/task/40277
https://aur.archlinux.org/packages/ovmf-svn/ (Some of the latest comments)

This error is caused by building with GCC 4.9, earlier versions seems unaffected.

The AUR has also a very similar package (If not identical) that is based on edk2 Source Code, the same which xen downloads while building, ovmf-svn:
https://aur.archlinux.org/packages/ovmf-svn/

This one has a PKGBUILD which includes some lines that seem to point that it is aware of both the python version issue, and the GCC 4.9 build issue, by providing a patch:
https://aur.archlinux.org/packages/ov/ovmf-svn/PKGBUILD

Reelevant lines seems to be these ones:

msg "Fix GenFw: ERROR 3000: Invalid, Unsupported section alignment"
patch -Np1 -i "${srcdir}/edk2-basetools-add-gcc4.9-support.patch" || true
patch -Np1 -i "${srcdir}/edk2-ovmfpkg-add-gcc4.9-support.patch" || true

msg "Use python2 for UDK BaseTools"
sed 's|python |python2 |g' -i "${EDK_TOOLS_PATH}/BinWrappers/PosixLike"/* || true
sed 's|python |python2 |g' -i "${EDK_TOOLS_PATH}/Tests/GNUmakefile"

I didn't found any info regarding if Xen can work with OVMF ready-to-use binaries, or either building ovmf-svn, which I didn't tested but I suppose should build properly. All instructions regarding using Xen with OVMF request that it is added as option during build time. This forces me to have to modify the edk2 Source Code that xen downloads.

Basically, what I want to request is if xen PKGBUILD can be modified to include a statement that checks if --enable-ovmf is being used, then make the appropriate changes to the edk2 Source Code that gets downloaded while building Xen so it successfully builds. This could *POSSIBILY* be based on existing ovmf-svn PKGBUILD code.

This change could also be applied to other xen-based packages that can also be builded with --enable-ovmf and presents the same issues.

Scimmia · 2014-09-03 23:51:51

Requesting it here won't do anything, this is what the AUR comments section is for. Failing that, contact the maintainer directly.

zir_blazer · 2014-09-03 23:58:46

Scimmia wrote:

Requesting it here won't do anything

What?? Doesn't the name of this Forum includes "PKGBUILD Request"?

Anyways, will have to make another account to Post comments in the AUR. Here we go...

Trilby · 2014-09-04 00:34:57

The subforum title is because this is a place were people can request (new) PKGBUILDs.

kantras · 2014-09-04 00:37:29

I also don't get as much chance to log into the forums, whereas I get emailed whenever anyone leaves a comment for any AUR package I maintain. If possible, will take a look at this either tonight or tomorrow; depends on how much I have to change for the xen 4.3 release which happened at the same time as the 4.4 one.

sheep_42 · 2014-09-04 11:44:52

Hi,

you could try to build and install the package ovmf-svn, then build xen with --with-system-ovmf=$PATH_TO_OVMF. That way, you don't have to do complicated things with the xen build system. I haven't try that, I hope it works.

zir_blazer · 2014-09-04 21:37:19

sheep_42 wrote:

Hi,
you could try to build and install the package ovmf-svn, then build xen with --with-system-ovmf=$PATH_TO_OVMF. That way, you don't have to do complicated things with the xen build system. I haven't try that, I hope it works.

On all Xen documentation I saw, it was nowhere stated that such option existed. If you google "--with-system-ovmf", you will figure out how obscure that thing is, surprising someone knew about it. Gonna give it a try.

Assuming it works, my need could be workarounded by building ovmf-svn, then giving Xen the path when building.

sheep_42 · 2014-09-05 11:12:44

zir_blazer wrote:

On all Xen documentation I saw, it was nowhere stated that such option existed. If you google "--with-system-ovmf", you will figure out how obscure that thing is, surprising someone knew about it.

Yeah , one would need to run ./tools/configure --help, or look into ./tools/configure.ac to find this option... and several others options.

zir_blazer · 2014-09-06 06:50:43

FINALLY managed to get this thing working:
http://i.imgur.com/ZWTRcn0.png

I tried to build xen with --with-system-ovmf= as suggested like ten times or so, with no success. While xen seemed to build fine, when I tried to create a UEFI DomU, it simply opens and inmediately closes, through if using SeaBIOS worked fine. On xen IRC there was another Arch Linux user claiming that he recently got Xen with OVMF working using that parameter and the bios.bin binary from the ovmf-bin package from AUR. Installing ovmf-bin then providing xen the full path (--with-system-ovmf=/usr/share/ovmf/bios.bin) didn't worked, neither building ovmf-svn myself then using ovmf_x64.bin (Or renaming it to OVMF.fd, ovmf.bin, etc). It always builded perfectly, yet it failed to make a UEFI DomU. Still, both Firmwares worked when using qemu from the official Arch Linux repository (Note that ovmf-bin bios.bin is 1 MiB in size while ovmf-svn ovmf_x64.bin is 2 MiB, not sure what accounts for the difference).

So how I got it working? A bit complex:
- While in my first post I mention that ovmf-svn had a patch for GCC 4.9, it seems than the patch was removed in the last two days. Without the patch, ovmf-svn still builded properly, so I expected than the GCC 4.9 fix got included in edk2 Source Repository. This was blocking me earlier, so decided to give --enable-ovmf another go.
- Renamed python2 to python as a workaround to not have to touch the edk2 tree that xen downloads, which worked the last time.
- Used makepkg with --enable-ovmf in the PKGBUILD ./configure line. I expected it to work due what I mentioned earlier, but it still fails with the GCC 4.9's GenFw: ERROR 3000.
- As a last resort measure, I decided to try to merge into xen the source that ovmf-svn PKGBUILD modifies, as that one builds properly.
- I replaced all the directories inside xen/src/xen-4.4.1/tools/firmware/ovmf-dir-remote/ with the ones from ovmf-svn/src/tianocore-edk2-svn_build/. Not all directories were replaced, seems than ovmf-svn just downloads the parts of the tree required for building the OVMF Firmware, not everything, which xen does.
- Used makepkg again, which used the existing source to try to build again.
- It builded, no python or GenFw error. Installed the new package, rebooted, tried to make the UEFI DomU and BAM! There it is, as you can see in the Screenshot.

Why can some users get this running with just providing bios.bin from ovmf-bin while I have to do a walk around the globe is anyone guess...

To not derail this request further, I can say the following:
- Assuming than --with-system-ovmf= works consistently, which for me didn't, is currently possible to build Xen with OVMF, so making a more complex PKGBUILD to be able to use --enable-ovmf may not be needed.
- --enable-ovmf is still useful because it may reduce a two-step process (Installing ovmf-bin or building ovmf-svn) into one, through I'm not sure if there are pros/cons for each approach besides than you will have latest OVMF version compared to the ready-to-use binary. It also makes xen package more compatible with the mainstream Xen instructions, as --with-system-ovmf= is quite unknow.
These decisions are for kantras to make.

Last edited by zir_blazer (2014-09-06 06:54:02)

kantras · 2014-10-28 03:45:57

In the end, I've gone with the latter solution, since I don't know whether there are necessary patches, that haven't been upstreamed yet, within the git repository where xen is hosting their branch of ovmf. I've just uploaded a new xen AUR package that should hopefully successfully compile with --enable-ovmf enabled.

Arch Linux

#1 2014-09-03 23:43:59

Requesting some changes for xen PKGBUILD to work with --enable-ovmf

#2 2014-09-03 23:51:51

Re: Requesting some changes for xen PKGBUILD to work with --enable-ovmf

#3 2014-09-03 23:58:46

Re: Requesting some changes for xen PKGBUILD to work with --enable-ovmf

#4 2014-09-04 00:34:57

Re: Requesting some changes for xen PKGBUILD to work with --enable-ovmf

#5 2014-09-04 00:37:29

Re: Requesting some changes for xen PKGBUILD to work with --enable-ovmf

#6 2014-09-04 11:44:52

Re: Requesting some changes for xen PKGBUILD to work with --enable-ovmf

#7 2014-09-04 21:37:19

Re: Requesting some changes for xen PKGBUILD to work with --enable-ovmf

#8 2014-09-05 11:12:44

Re: Requesting some changes for xen PKGBUILD to work with --enable-ovmf

#9 2014-09-06 06:50:43

Re: Requesting some changes for xen PKGBUILD to work with --enable-ovmf

#10 2014-10-28 03:45:57

Re: Requesting some changes for xen PKGBUILD to work with --enable-ovmf

Board footer