Official firefox-pgo thread

blasse · 2009-06-04 16:50:02

Useful links:
firefox-pgo on AUR
firefox-pgo-beta on AUR

This is pkgbuild for this 3.0.11-1 (if anyone want older version):
http://omploader.org/vMXduaw/firefox-pgo-3.0.11.tar.gz

ps. This post will be updated with new links and new pkgbuilds Please post your problems here instead of AUR comments, so everyone could find problems and workarounds if there will be any.

Last edited by blasse (2010-07-13 18:13:27)

Army · 2009-06-04 20:27:07

Just give firefox-pgo-beta a shot, compiles just fine, is really stable here and really fast :-)

methuselah · 2009-06-05 02:44:51

Army wrote:

Just give firefox-pgo-beta a shot, compiles just fine, is really stable here and really fast :-)

The op that posted this thread is the creator/maintainer of both those AUR PGO packages...... and as of this last month (all of May) it has been nothing but trouble when compiling PGO..... I've tried every workaround that blasse and anyone else has suggested for the firefox-pgo-beta and I can't get it to build.

I'm about ready to give up on PGO until it is announced as working again.

Last edited by methuselah (2009-06-05 02:46:22)

bangkok_manouel · 2009-06-05 04:50:47

FWIW, I'm doing (almost) daily PGO builds from mercurial (1.9.1 branch) without (too many) problem (up-to-date [testing] machine). what are the actual errors?

if someone's interested, here's a build from this night (i686 - intel core2 cpu only):
http://omploader.org/vMXM2dA/firefox-3. … pkg.tar.gz
f1eeb7b838832de243bd165b10a59b24 firefox-3.5pre-2-i686.pkg.tar.gz

blasse · 2009-06-05 05:08:50

With 3.0.11 I've got errors while second pass with js. I will post it later exactly.

@bangkok_manouel
Are you using the same pkgbuild/mozconfig as mine pgo's or with some changes?

bangkok_manouel · 2009-06-05 05:53:08

blasse wrote:

@bangkok_manouel
Are you using the same pkgbuild/mozconfig as mine pgo's or with some changes?

I'm not using your package but it is extremely likely that they are very similar.

PKGBUILD (there's no source as I'm updating the tree with mercurial manually)

# $Id: PKGBUILD,v 1.26 2007/12/21 12:07:16 alexander Exp $
# Maintainer: Alexander Baldeck <alexander@archlinux.org>
# Contributor: Dale Blount <dale@archlinux.org>
# Contributer: Nick Penwarden <toth64@yahoo.com>
pkgname=firefox
pkgver=3.5pre
pkgrel=2
mozver=1.9.1
pkgdesc="Standalone web browser from mozilla.org"
arch=(i686 x86_64)
license=('MPL' 'GPL' 'LGPL')
depends=('gtk2>=2.12.0' 'pango>=1.16.1' 'gcc-libs' 'libxt' 'libidl2' 'mozilla-common' 'nss>=3.11.7' 'desktop-file-utils')
makedepends=('zip' 'imagemagick' 'pkgconfig' 'gcc' 'diffutils')
replaces=('mozilla-firebird' 'phoenix' 'mozilla-firefox')
conflicts=('mozilla-firefox')
provides=('mozilla-firefox')
install=firefox.install
url="http://www.mozilla.org/projects/firefox"
source=(mozconfig
    firefox.desktop
    firefox-safe.desktop)

build() {
  cd ${srcdir}/

  export LDFLAGS="-Wl,-rpath,/usr/lib/firefox-${pkgver}"

  make -j1 -f client.mk profiledbuild MOZ_MAKE_FLAGS="${MAKEFLAGS}" || return 1 #PGO
  make -j1 DESTDIR=${pkgdir} -C ./meh install || return 1 #PGO

  install -m755 -d ${pkgdir}/usr/share/applications
  install -m755 -d ${pkgdir}/usr/share/pixmaps
  install -m644 ${srcdir}/browser/branding/unofficial/default48.png ${pkgdir}/usr/share/pixmaps/firefox.png || return 1
  install -m644 ${srcdir}/firefox.desktop ${pkgdir}/usr/share/applications/ || return 1
  install -m644 ${srcdir}/firefox-safe.desktop ${pkgdir}/usr/share/applications/ || return 1
}

mozconfig

mk_add_options MOZ_CO_PROJECT=browser
ac_add_options --enable-application=browser
ac_add_options --enable-optimize 
ac_add_options --enable-default-toolkit=cairo-gtk2
ac_add_options --enable-xft
ac_add_options --enable-extensions=default
ac_add_options --enable-system-cairo
ac_add_options --enable-strip
ac_add_options --enable-install-strip
ac_add_options --enable-pango
ac_add_options --enable-svg
ac_add_options --enable-canvas
ac_add_options --disable-tests
ac_add_options --disable-accessibility
ac_add_options --disable-jsd
ac_add_options --disable-mochitest
ac_add_options --disable-safe-browsing
ac_add_options --disable-debug
ac_add_options --disable-installer
ac_add_options --disable-crashreporter
ac_add_options --disable-parental-controls
ac_add_options --disable-javaxpcom
ac_add_options --with-pthreads
ac_add_options --enable-profile-guided-optimization
mk_add_options MOZ_OBJDIR=@TOPSRCDIR@/meh
mk_add_options PROFILE_GEN_SCRIPT='$(PYTHON) $(MOZ_OBJDIR)/_profile/pgo/profileserver.py'

makepkg.conf (part)

#########################################################################
# ARCHITECTURE, COMPILE FLAGS
#########################################################################
#
CARCH="i686"
CHOST="i686-pc-linux-gnu"

#-- Exclusive: will only run on -march=i686 
# -march (or -mcpu) builds exclusively for an architecture
# -mtune optimizes for an architecture, but builds for whole processor family
CFLAGS="-march=i686 -mtune=native -O2 -pipe -fomit-frame-pointer -floop-interchange -floop-strip-mine -floop-block"
CXXFLAGS="-march=i686 -mtune=native -O2 -pipe -fomit-frame-pointer -floop-interchange -floop-strip-mine -floop-block"
#-- Make Flags: change this for DistCC/SMP systems
MAKEFLAGS="-j3"

blasse · 2009-06-05 06:57:52

I hadn't run into this option before:

ac_add_options --disable-jsd

What it changes?

bangkok_manouel · 2009-06-05 08:00:16

blasse wrote:

I hadn't run into this option before:
ac_add_options --disable-jsd
What it changes?

it's a js debugger
http://mxr.mozilla.org/mozilla/source/js/jsd/README

bond · 2009-06-05 13:12:39

garrrr

I've tried compiling all the pgo related builds in aur, also tried turning off optimization (-O0) and got the same error, using a c2d e2140. x86_64

OBJDIR=/tmp/yaourt-tmp-bond/aur-firefox-pgo-beta/firefox-pgo-beta/src/mozilla-1.9.1/ff-opt-obj 
python /tmp/yaourt-tmp-bond/aur-firefox-pgo-beta/firefox-pgo-beta/src/mozilla-1.9.1/ff-pt-obj/_profile/pgo/profileserver.py
INFO | (automation.py) | Application pid: 1656
TEST-UNEXPECTED-FAIL | (automation.py) | Exited with code -11 during test run
INFO | (automation.py) | Application ran for: 0:00:00.149556
make: *** [profiledbuild] Error 245

so I checked out the 1.9.1 tree from mozilla, and tried using bangkok_manouel's pkgbuild ... and got:

OBJDIR=/home/bond/Desktop/firefox/src/meh python /home/bond/Desktop/firefox/src/meh/_profile/pgo/profileserver.py
INFO | (automation.py) | Application pid: 9279
ERROR: ld.so: object 'libfakeroot.so' from LD_PRELOAD cannot be preloaded: ignored.
TEST-UNEXPECTED-FAIL | (automation.py) | Exited with code -11 during test run
INFO | (automation.py) | Application ran for: 0:00:00.479301
make: *** [profiledbuild] Error 245
==> ERROR: Build Failed.
    Aborting...

my makepkg.conf is

CFLAGS="-march=x86-64 -mtune=native -O2 -pipe -fomit-frame-pointer -floop-interchange -floop-strip-mine -floop-block"
CXXFLAGS="-march=x86-64 -mtune=native -O2 -pipe -fomit-frame-pointer -floop-interchange -floop-strip-mine -floop-block"
MAKEFLAGS="-j3"

i don't really know where to go from here

blasse · 2009-06-05 16:48:07

Btw. My error on buildin 3.0.11

/home/sigma/Desktop/aur/firefox-pgo/src/mozilla/xpcom/io/nsStreamUtils.cpp:701: warning: no coverage for function '_ZN23nsInputStreamReadyEvent14QueryInterfaceERK4nsIDPPv' found
/home/sigma/Desktop/aur/firefox-pgo/src/mozilla/xpcom/io/nsStreamUtils.cpp: In member function 'virtual nsrefcnt nsAStreamCopier::Release()':
/home/sigma/Desktop/aur/firefox-pgo/src/mozilla/xpcom/io/nsStreamUtils.cpp:701: warning: no coverage for function '_ZN15nsAStreamCopier7ReleaseEv' found
/home/sigma/Desktop/aur/firefox-pgo/src/mozilla/xpcom/io/nsStreamUtils.cpp:701: warning: no coverage for function '_ZN15nsAStreamCopier7ReleaseEv' found
/home/sigma/Desktop/aur/firefox-pgo/src/mozilla/xpcom/io/nsStreamUtils.cpp: In member function 'virtual nsrefcnt nsAStreamCopier::AddRef()':
/home/sigma/Desktop/aur/firefox-pgo/src/mozilla/xpcom/io/nsStreamUtils.cpp:701: warning: no coverage for function '_ZN15nsAStreamCopier6AddRefEv' found
/home/sigma/Desktop/aur/firefox-pgo/src/mozilla/xpcom/io/nsStreamUtils.cpp: In member function 'virtual nsrefcnt nsOutputStreamReadyEvent::AddRef()':
/home/sigma/Desktop/aur/firefox-pgo/src/mozilla/xpcom/io/nsStreamUtils.cpp:701: warning: no coverage for function '_ZN24nsOutputStreamReadyEvent6AddRefEv' found
/home/sigma/Desktop/aur/firefox-pgo/src/mozilla/xpcom/io/nsStreamUtils.cpp: In member function 'virtual nsrefcnt nsInputStreamReadyEvent::AddRef()':
/home/sigma/Desktop/aur/firefox-pgo/src/mozilla/xpcom/io/nsStreamUtils.cpp:701: warning: no coverage for function '_ZN23nsInputStreamReadyEvent6AddRefEv' found
/home/sigma/Desktop/aur/firefox-pgo/src/mozilla/xpcom/io/nsStreamUtils.cpp: In member function 'virtual nsrefcnt nsOutputStreamReadyEvent::Release()':
/home/sigma/Desktop/aur/firefox-pgo/src/mozilla/xpcom/io/nsStreamUtils.cpp:701: warning: no coverage for function '_ZN24nsOutputStreamReadyEvent7ReleaseEv' found
/home/sigma/Desktop/aur/firefox-pgo/src/mozilla/xpcom/io/nsStreamUtils.cpp:701: warning: no coverage for function '_ZN24nsOutputStreamReadyEvent7ReleaseEv' found
/home/sigma/Desktop/aur/firefox-pgo/src/mozilla/xpcom/io/nsStreamUtils.cpp: In member function 'virtual nsrefcnt nsInputStreamReadyEvent::Release()':
/home/sigma/Desktop/aur/firefox-pgo/src/mozilla/xpcom/io/nsStreamUtils.cpp:701: warning: no coverage for function '_ZN23nsInputStreamReadyEvent7ReleaseEv' found
/home/sigma/Desktop/aur/firefox-pgo/src/mozilla/xpcom/io/nsStreamUtils.cpp:701: warning: no coverage for function '_ZN23nsInputStreamReadyEvent7ReleaseEv' found
make[6]: *** [nsStreamUtils.o] Błąd 1
make[6]: Opuszczenie katalogu `/home/sigma/Desktop/aur/firefox-pgo/src/mozilla/ff-pgo/xpcom/io'
make[5]: *** [libs] Błąd 2
make[5]: Opuszczenie katalogu `/home/sigma/Desktop/aur/firefox-pgo/src/mozilla/ff-pgo/xpcom'
make[4]: *** [libs_tier_xpcom] Błąd 2
make[4]: Opuszczenie katalogu `/home/sigma/Desktop/aur/firefox-pgo/src/mozilla/ff-pgo'
make[3]: *** [tier_xpcom] Błąd 2
make[3]: Opuszczenie katalogu `/home/sigma/Desktop/aur/firefox-pgo/src/mozilla/ff-pgo'
make[2]: *** [default] Błąd 2
make[2]: Opuszczenie katalogu `/home/sigma/Desktop/aur/firefox-pgo/src/mozilla/ff-pgo'
make[1]: *** [build] Błąd 2
make[1]: Opuszczenie katalogu `/home/sigma/Desktop/aur/firefox-pgo/src/mozilla'
make: *** [profiledbuild] Błąd 2

methuselah · 2009-06-06 01:26:46

bond wrote:

garrrr

I've tried compiling all the pgo related builds in aur, also tried turning off optimization (-O0) and got the same error, using a c2d e2140. x86_64

OBJDIR=/tmp/yaourt-tmp-bond/aur-firefox-pgo-beta/firefox-pgo-beta/src/mozilla-1.9.1/ff-opt-obj 
python /tmp/yaourt-tmp-bond/aur-firefox-pgo-beta/firefox-pgo-beta/src/mozilla-1.9.1/ff-pt-obj/_profile/pgo/profileserver.py
INFO | (automation.py) | Application pid: 1656
TEST-UNEXPECTED-FAIL | (automation.py) | Exited with code -11 during test run
INFO | (automation.py) | Application ran for: 0:00:00.149556
make: *** [profiledbuild] Error 245

so I checked out the 1.9.1 tree from mozilla, and tried using bangkok_manouel's pkgbuild ... and got:

OBJDIR=/home/bond/Desktop/firefox/src/meh python /home/bond/Desktop/firefox/src/meh/_profile/pgo/profileserver.py
INFO | (automation.py) | Application pid: 9279
ERROR: ld.so: object 'libfakeroot.so' from LD_PRELOAD cannot be preloaded: ignored.
TEST-UNEXPECTED-FAIL | (automation.py) | Exited with code -11 during test run
INFO | (automation.py) | Application ran for: 0:00:00.479301
make: *** [profiledbuild] Error 245
==> ERROR: Build Failed.
    Aborting...

my makepkg.conf is

I've tried all sorts of the workarounds from the AUR page for blasse's firefox-pgo-beta. I get this same "TEST-UNEXPECTED-FAIL | (automation.py) | Exited with code -11 during test run" error each time.

I finally decided to ditch my 3.1b3-pgo that had been running perfectly and go with an optimized build of the 3.5b4 without PGO..... anyway, it was mistake because it feels slower and the benchmarks are worse.

Then I tried to re-build the old firefox-pgo-beta for 3.1b3 from an old PKGBUILD and now I get some pango error now

I'll post the error:

/home/seventy3/AUR/FIREFOX-opto/OLD/firefox-pgo-beta/src/mozilla-1.9.1/gfx/thebes/src/gfxPangoFonts.cpp:1833: error: 'struct _PangoFcFontMapClass' has no member named 'context_substitute'
/home/seventy3/AUR/FIREFOX-opto/OLD/firefox-pgo-beta/src/mozilla-1.9.1/gfx/thebes/src/gfxPangoFonts.cpp:1834: error: invalid conversion from 'PangoFcFont* (*)(PangoFcFontMap*, PangoContext*, const PangoFontDescription*, FcPattern*)' to 'PangoFcFont* (*)(PangoFcFontMap*, PangoFcFontKey*)'
make[7]: *** [gfxPangoFonts.o] Error 1
make[7]: Leaving directory `/home/seventy3/AUR/FIREFOX-opto/OLD/firefox-pgo-beta/src/mozilla-1.9.1/ff-opt-obj/gfx/thebes/src'
make[6]: *** [libs] Error 2
make[6]: Leaving directory `/home/seventy3/AUR/FIREFOX-opto/OLD/firefox-pgo-beta/src/mozilla-1.9.1/ff-opt-obj/gfx/thebes'
make[5]: *** [libs] Error 2
make[5]: Leaving directory `/home/seventy3/AUR/FIREFOX-opto/OLD/firefox-pgo-beta/src/mozilla-1.9.1/ff-opt-obj/gfx'
make[4]: *** [libs_tier_gecko] Error 2
make[4]: Leaving directory `/home/seventy3/AUR/FIREFOX-opto/OLD/firefox-pgo-beta/src/mozilla-1.9.1/ff-opt-obj'
make[3]: *** [tier_gecko] Error 2
make[3]: Leaving directory `/home/seventy3/AUR/FIREFOX-opto/OLD/firefox-pgo-beta/src/mozilla-1.9.1/ff-opt-obj'
make[2]: *** [default] Error 2
make[2]: Leaving directory `/home/seventy3/AUR/FIREFOX-opto/OLD/firefox-pgo-beta/src/mozilla-1.9.1/ff-opt-obj'
make[1]: *** [build] Error 2
make[1]: Leaving directory `/home/seventy3/AUR/FIREFOX-opto/OLD/firefox-pgo-beta/src/mozilla-1.9.1'
make: *** [profiledbuild] Error 2

Last edited by methuselah (2009-06-06 02:28:42)

bangkok_manouel · 2009-06-06 03:41:10

methuselah wrote:

Then I tried to re-build the old firefox-pgo-beta for 3.1b3 from an old PKGBUILD and now I get some pango error now

I'll post the error:

/home/seventy3/AUR/FIREFOX-opto/OLD/firefox-pgo-beta/src/mozilla-1.9.1/gfx/thebes/src/gfxPangoFonts.cpp:1833: error: 'struct _PangoFcFontMapClass' has no member named 'context_substitute'
/home/seventy3/AUR/FIREFOX-opto/OLD/firefox-pgo-beta/src/mozilla-1.9.1/gfx/thebes/src/gfxPangoFonts.cpp:1834: error: invalid conversion from 'PangoFcFont* (*)(PangoFcFontMap*, PangoContext*, const PangoFontDescription*, FcPattern*)' to 'PangoFcFont* (*)(PangoFcFontMap*, PangoFcFontKey*)'
make[7]: *** [gfxPangoFonts.o] Error 1
make[7]: Leaving directory `/home/seventy3/AUR/FIREFOX-opto/OLD/firefox-pgo-beta/src/mozilla-1.9.1/ff-opt-obj/gfx/thebes/src'
make[6]: *** [libs] Error 2
make[6]: Leaving directory `/home/seventy3/AUR/FIREFOX-opto/OLD/firefox-pgo-beta/src/mozilla-1.9.1/ff-opt-obj/gfx/thebes'
make[5]: *** [libs] Error 2
make[5]: Leaving directory `/home/seventy3/AUR/FIREFOX-opto/OLD/firefox-pgo-beta/src/mozilla-1.9.1/ff-opt-obj/gfx'
make[4]: *** [libs_tier_gecko] Error 2
make[4]: Leaving directory `/home/seventy3/AUR/FIREFOX-opto/OLD/firefox-pgo-beta/src/mozilla-1.9.1/ff-opt-obj'
make[3]: *** [tier_gecko] Error 2
make[3]: Leaving directory `/home/seventy3/AUR/FIREFOX-opto/OLD/firefox-pgo-beta/src/mozilla-1.9.1/ff-opt-obj'
make[2]: *** [default] Error 2
make[2]: Leaving directory `/home/seventy3/AUR/FIREFOX-opto/OLD/firefox-pgo-beta/src/mozilla-1.9.1/ff-opt-obj'
make[1]: *** [build] Error 2
make[1]: Leaving directory `/home/seventy3/AUR/FIREFOX-opto/OLD/firefox-pgo-beta/src/mozilla-1.9.1'
make: *** [profiledbuild] Error 2

http://bbs.archlinux.org/viewtopic.php? … 09#p541009

bangkok_manouel · 2009-06-06 05:12:24

bond wrote:

garrrr

I've tried compiling all the pgo related builds in aur, also tried turning off optimization (-O0) and got the same error, using a c2d e2140. x86_64

OBJDIR=/tmp/yaourt-tmp-bond/aur-firefox-pgo-beta/firefox-pgo-beta/src/mozilla-1.9.1/ff-opt-obj 
python /tmp/yaourt-tmp-bond/aur-firefox-pgo-beta/firefox-pgo-beta/src/mozilla-1.9.1/ff-pt-obj/_profile/pgo/profileserver.py
INFO | (automation.py) | Application pid: 1656
TEST-UNEXPECTED-FAIL | (automation.py) | Exited with code -11 during test run
INFO | (automation.py) | Application ran for: 0:00:00.149556
make: *** [profiledbuild] Error 245

so I checked out the 1.9.1 tree from mozilla, and tried using bangkok_manouel's pkgbuild ... and got:

OBJDIR=/home/bond/Desktop/firefox/src/meh python /home/bond/Desktop/firefox/src/meh/_profile/pgo/profileserver.py
INFO | (automation.py) | Application pid: 9279
ERROR: ld.so: object 'libfakeroot.so' from LD_PRELOAD cannot be preloaded: ignored.
TEST-UNEXPECTED-FAIL | (automation.py) | Exited with code -11 during test run
INFO | (automation.py) | Application ran for: 0:00:00.479301
make: *** [profiledbuild] Error 245
==> ERROR: Build Failed.
    Aborting...

my makepkg.conf is

CFLAGS="-march=x86-64 -mtune=native -O2 -pipe -fomit-frame-pointer -floop-interchange -floop-strip-mine -floop-block"
CXXFLAGS="-march=x86-64 -mtune=native -O2 -pipe -fomit-frame-pointer -floop-interchange -floop-strip-mine -floop-block"
MAKEFLAGS="-j3"

i don't really know where to go from here

This is quite strange, I suspect the script that launches firefox doesn't like x86_64 machines anymore, could you try with another script?
https://developer.mozilla.org/En/Buildi … ion_script

methuselah · 2009-06-06 06:18:23

bangkok_manouel wrote:

http://bbs.archlinux.org/viewtopic.php? … 09#p541009

Thank you, I added that patch for the old 3.1b3 and now I got this new error for something else:

/home/seventy3/AUR/FIREFOX-opto/OLD/firefox-pgo-beta/src/mozilla-1.9.1/toolkit/xre/nsAppRunner.cpp:1487:6: error: #elif with no expression
make[6]: *** [nsAppRunner.o] Error 1
make[6]: Leaving directory `/home/seventy3/AUR/FIREFOX-opto/OLD/firefox-pgo-beta/src/mozilla-1.9.1/ff-opt-obj/toolkit/xre'
make[5]: *** [libs] Error 2
make[5]: Leaving directory `/home/seventy3/AUR/FIREFOX-opto/OLD/firefox-pgo-beta/src/mozilla-1.9.1/ff-opt-obj/toolkit'
make[4]: *** [libs_tier_toolkit] Error 2
make[4]: Leaving directory `/home/seventy3/AUR/FIREFOX-opto/OLD/firefox-pgo-beta/src/mozilla-1.9.1/ff-opt-obj'
make[3]: *** [tier_toolkit] Error 2
make[3]: Leaving directory `/home/seventy3/AUR/FIREFOX-opto/OLD/firefox-pgo-beta/src/mozilla-1.9.1/ff-opt-obj'
make[2]: *** [default] Error 2
make[2]: Leaving directory `/home/seventy3/AUR/FIREFOX-opto/OLD/firefox-pgo-beta/src/mozilla-1.9.1/ff-opt-obj'
make[1]: *** [build] Error 2
make[1]: Leaving directory `/home/seventy3/AUR/FIREFOX-opto/OLD/firefox-pgo-beta/src/mozilla-1.9.1'
make: *** [profiledbuild] Error 2
==> ERROR: Build Failed.
    Aborting...

and still no luck for me and the 3.5b4-PGO version.... just that same error: TEST-UNEXPECTED-FAIL | (automation.py) | Exited......

Last edited by methuselah (2009-06-06 06:18:54)

bangkok_manouel · 2009-06-06 06:24:25

methuselah wrote:

and still no luck for me and the 3.5b4-PGO version.... just that same error: TEST-UNEXPECTED-FAIL | (automation.py) | Exited......

out of curiosity, are you using x86_64? could you try this script https://developer.mozilla.org/En/Buildi … ion_script instead of the one provided in the source?

blasse · 2009-06-06 08:38:26

I've added some links to first post.

bangkok_manouel · 2009-06-06 15:01:30

blasse, i just tried your PKGBUILD (3.0.11 build2) and it built fine (i didn't install it however) except that i had to correct one error:

in mozconfig:
mk_add_options MOZ_OBJDIR=@TOPSRCDIR@/ff-pgo

in PKGBUILD:
make DESTDIR=${pkgdir} -C ff-opt-obj install || return 1

you have to chose between ff-pgo and ff-opt-obj.

here's the binary (i686 - core2duo cpu only)
http://omploader.org/vMXNnZg/firefox-pg … pkg.tar.gz
937ba2cbe29ea30569f955650ef3f025 firefox-pgo-3.0.11-1-i686.pkg.tar.gz

blasse · 2009-06-06 15:53:10

True, I missed it while reworking PKGBUILD Thx

haxit · 2009-06-06 16:01:36

Its available on my repo, just fyi!

blasse · 2009-06-06 16:35:28

Few corrections to pkgbuild:
http://rapidshare.com/files/241533560/f … pgo.tar.gz

Could someone try and report if it works?

methuselah · 2009-06-06 19:37:27

bangkok_manouel wrote:

methuselah wrote:
and still no luck for me and the 3.5b4-PGO version.... just that same error: TEST-UNEXPECTED-FAIL | (automation.py) | Exited......
out of curiosity, are you using x86_64? could you try this script https://developer.mozilla.org/En/Buildi … ion_script instead of the one provided in the source?

Yes, I am using Arch x86_64, my kernel is actually AMD64 k8 and patched with these C[XX]LFAGS="-march=athlon64-sse3 -O2 -pipe -floop-interchange -floop-strip-mine -floop-block"

I built the regular 3.5b4 (without PGO) using these C[XX]FLAGS exported as "-march=athlon64-sse3 -floop-interchange -floop-strip-mine -floop-block" and also optimized with mozilla's "ac_add_options --enable-optimize" setting in the mozconfig. I also used these LDFLAGS (which I'm not sure if I wrote this in the correct way or if I over did it with: "-Wl,--hash-style=gnu -Wl,--as-needed"):

export LDFLAGS="-Wl,--rpath,/usr/lib/firefox-${pkgver} -Wl,--hash-style=gnu -Wl,--as-needed"

I also used blasse's LDFLAGS patch of: +LDFLAGS += -lX11 -lXrender

.....................................................................................................

So I went ahead and tried that shell script to create /_profileprofile (I should have put the profile folder in the correct place with my other profiles)

It worked (I had to change it to /usr/bin/firefox and like I said above I shouldn't of added a new profile in my root directory), but all this seemed to do was create a new clean profile like the way the command "firefox -ProfileManager" can do.

Then I wasn't sure what "manually run(ning) your profiling scenarios" meant so I just added all of my extensions and clicked through all of my most used pages and logged in with my passwords..... probably for no reason...... In my terminal I got a lot of 'gdk' warnings about some "trouble ahead", and I also got this alsa error a few times (I use oss4):

ALSA lib confmisc.c:768:(parse_card) cannot find card '0'
ALSA lib conf.c:3513:(_snd_config_evaluate) function snd_func_card_driver returned error: No such file or directory
ALSA lib confmisc.c:392:(snd_func_concat) error evaluating strings
ALSA lib conf.c:3513:(_snd_config_evaluate) function snd_func_concat returned error: No such file or directory
ALSA lib confmisc.c:1251:(snd_func_refer) error evaluating name
ALSA lib conf.c:3513:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:3985:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2211:(snd_pcm_open_noupdate) Unknown PCM default

Maybe I don't really know what a Profile Guided Optimization really does, but I thought it was all about the build process and optimizing the code for my hardware? I'll probably scrap this /_profileprofile and try it again in the correct ~./mozilla/firefox directory..... and when I do I will repost those gdk errors that I got to see if you know what it is (I hastily closed the terminal before writing down th exact error message).

EDIT: This is the error message for gdk..... it turns out that it had nothing to do with that /_profileprofile shell script:

(firefox-bin:32058): Gdk-WARNING **: XID collision, trouble ahead

Last edited by methuselah (2009-06-06 20:41:27)

blasse · 2009-06-06 20:02:23

Add3d 3.5rc1pre (3.5b99) pkgbuild. PGO runs second pass compile after genereting profile data - statistics gathered from running non profiled application.

methuselah · 2009-06-06 21:33:12

blasse wrote:

Add3d 3.5rc1pre (3.5b99) pkgbuild. PGO runs second pass compile after genereting profile data - statistics gathered from running non profiled application.

Same error:

make[1]: Leaving directory `/home/seventy3/AUR/NEW-PGO/NEWEST-beta/src/mozilla-1.9.1'
OBJDIR=/home/seventy3/AUR/NEW-PGO/NEWEST-beta/src/mozilla-1.9.1/ff-pgo python /home/seventy3/AUR/NEW-PGO/NEWEST-beta/src/mozilla-1.9.1/ff-pgo/_profile/pgo/profileserver.py
INFO | (automation.py) | Application pid: 12098
TEST-UNEXPECTED-FAIL | (automation.py) | Exited with code -11 during test run
INFO | (automation.py) | Application ran for: 0:00:00.023988
make: *** [profiledbuild] Error 245

EDIT:

after the pgo build failed, I went ahead and built a regular optimized build with my CFLAGS/LDFLAGS as:

  export CFLAGS="-march=athlon64-sse3 -floop-interchange -floop-strip-mine -floop-block"
  export CXXFLAGS="-march=athlon64-sse3 -floop-interchange -floop-strip-mine -floop-block"
  export LDFLAGS="-Wl,--rpath,/usr/lib/firefox-${pkgver},--hash-style=gnu"

I also use your patches including the lX11 and -lXrender

Anyway, I'm only posting this next part to mention that I've noticed the benchmarks getting worse for every new version:

with firefox-pgo-beta 3.1b3 the SunSpider JavaScript Benchmark were: around 4200/4300/4400

then with 3.5b4 regular it was: 4600

now with 3.5b99 it's this:

Total: 4806.8ms +/- 1.6%

I've also seen the exact opposite of people's result when I saw an article on digg.com about firefox 3.5b4 and it's SunSpider JavaScript Benchmark where people had their benchmarks from 3.1b3 and 3.5b4 go in the other direction, as in from 4000 to 3000..... the article was about why firefox in wine is faster than Linux firefox and how version 3.5b4 should help make native Linux firefox benchmarks closer to the ones people get when using firefox in wine.

Last edited by methuselah (2009-06-06 23:38:10)

bangkok_manouel · 2009-06-07 00:50:46

methuselah wrote:

Then I wasn't sure what "manually run(ning) your profiling scenarios" meant so I just added all of my extensions and clicked through all of my most used pages and logged in with my passwords.....

my best bet is that you only should go to http://dromaeo.com/ (mozilla javascript performance testing) and run all the tests, it will run dromaeo, sunspider and google v8 tests. results should actually be much more better than the automated script included in the source. it is much closer to the tests they included in mozilla-central (a serie of intensive javascript tests).

methuselah · 2009-06-07 02:53:15

bangkok_manouel wrote:

methuselah wrote:
Then I wasn't sure what "manually run(ning) your profiling scenarios" meant so I just added all of my extensions and clicked through all of my most used pages and logged in with my passwords.....
my best bet is that you only should go to http://dromaeo.com/ (mozilla javascript performance testing) and run all the tests, it will run dromaeo, sunspider and google v8 tests. results should actually be much more better than the automated script included in the source. it is much closer to the tests they included in mozilla-central (a serie of intensive javascript tests).

Thanks, I ran all those tests and then re-ran them. I had already ran the sunspider tests a couple of times and the acid3 tests. I had also wondered about the files included in the "src/mozilla-1.9.1/ff-pgo/build/pgo" directory:

profileserver.py
Makefile
genpgocert.py
automation.pyc
automation.py

..... I had wondered if there was a way to run the profileserver.py and those other scripts to optimize similar to the way it does when building (like maybe using the /obj-xulrunner/build/pgo directory somehow), but if you say using those tests from that dromaeo page while running "firefox -no-remote -profile" is better than cool.

Arch Linux

#1 2009-06-04 16:50:02

Official firefox-pgo thread

#2 2009-06-04 20:27:07

Re: Official firefox-pgo thread

#3 2009-06-05 02:44:51

Re: Official firefox-pgo thread

#4 2009-06-05 04:50:47

Re: Official firefox-pgo thread

#5 2009-06-05 05:08:50

Re: Official firefox-pgo thread

#6 2009-06-05 05:53:08

Re: Official firefox-pgo thread

#7 2009-06-05 06:57:52

Re: Official firefox-pgo thread

#8 2009-06-05 08:00:16

Re: Official firefox-pgo thread

#9 2009-06-05 13:12:39

Re: Official firefox-pgo thread

#10 2009-06-05 16:48:07

Re: Official firefox-pgo thread

#11 2009-06-06 01:26:46

Re: Official firefox-pgo thread

#12 2009-06-06 03:41:10

Re: Official firefox-pgo thread

#13 2009-06-06 05:12:24

Re: Official firefox-pgo thread

#14 2009-06-06 06:18:23

Re: Official firefox-pgo thread

#15 2009-06-06 06:24:25

Re: Official firefox-pgo thread

#16 2009-06-06 08:38:26

Re: Official firefox-pgo thread

#17 2009-06-06 15:01:30

Re: Official firefox-pgo thread

#18 2009-06-06 15:53:10

Re: Official firefox-pgo thread

#19 2009-06-06 16:01:36

Re: Official firefox-pgo thread

#20 2009-06-06 16:35:28

Re: Official firefox-pgo thread

#21 2009-06-06 19:37:27

Re: Official firefox-pgo thread

#22 2009-06-06 20:02:23

Re: Official firefox-pgo thread

#23 2009-06-06 21:33:12

Re: Official firefox-pgo thread

#24 2009-06-07 00:50:46

Re: Official firefox-pgo thread

#25 2009-06-07 02:53:15

Re: Official firefox-pgo thread

Board footer