Official firefox-pgo thread

toxygen · 2009-09-22 16:04:50

will try that from work, thanks!

[edit]

ok back home now, successfully built 3.7a1 (i called it firefox-pgo-hg on my pkgbuild), build 2009 09 22 232207.

jit options in about:config both set to true

sunspider javascript benchmark shows:
Total: 967.2ms

running it in 3.5 was around 1300ms, on 3.6a1 around the same, and 3.6a2 was around 1100ms (i had the results saved but lost the file). i'll probably retest on a day off from work to make sure. so far so good! goign to test extensions and html5 next.

[further]
for comparison, according to the other thread (OP anyway):

firefox 3.0.11 - 3200 ms
firefox 3.5rc2 - 1500 ms
midori 0.1.7 - 1400 ms
firefox 3.0.11 - 3800 ms
firefox 3.5rc3 - 3200 ms
midori 0.1.7 - 860 ms

Last edited by toxygen (2009-09-23 05:09:42)

toxygen · 2009-09-23 20:26:38

some more comments after using ff 3.7a1 for a few hours.

some html5 tests work ok (daily motion ok, a couple of tests [ambient light] crash firefox, youtube demo not so much (nothing plays)). other html5 demo/test pages i've seen work relative well, though not all html5 features are supported.

oss sound in html5 appears to be working and not as buggy as before. TM as mentioned before is snappy and fast on most pages. most of my extensions works, with the most noticeable not working one being xmarks, which is not a deal-breaker for me, but i would like to have it working, according to xmarks own people though they're not planning on making a build compatible with 3.7 ("or other beta versions"). other than that, other extensions havent given me problems once you override compatibility check with developer extension or the about:config trick.

visiting my normal pages (youtube, forums, stumble pages) has not caused any problems for me. so I say if you want to try it out, go for it, just remember to always backup your ~/.mozilla folder.

Last edited by toxygen (2009-09-23 20:31:42)

Harlequin · 2009-09-23 22:29:37

I got an error while building

make[6]: Leaving directory `/home/jack/Downloads/src/mozilla-central/ff-opt-obj/nsprpub/pr/src/misc'                                                         
cd threads; make clobber_all                                                                                                                                 
make[6]: Entering directory `/home/jack/Downloads/src/mozilla-central/ff-opt-obj/nsprpub/pr/src/threads'                                                     
rm -rf  dist ./prcmon.o ./prrwlock.o ./prtpd.o  ./prcmon.o ./prrwlock.o ./prtpd.o    LOGS TAGS ./.md core  /no-such-file so_locations                        
make[6]: Leaving directory `/home/jack/Downloads/src/mozilla-central/ff-opt-obj/nsprpub/pr/src/threads'                                                      
cd pthreads; make clobber_all                                                                                                                                
make[6]: Entering directory `/home/jack/Downloads/src/mozilla-central/ff-opt-obj/nsprpub/pr/src/pthreads'                                                    
rm -rf  dist ./ptio.o ./ptsynch.o ./ptthread.o ./ptmisc.o  ./ptio.o ./ptsynch.o ./ptthread.o ./ptmisc.o    LOGS TAGS ./.md core  /no-such-file so_locations  
make[6]: Leaving directory `/home/jack/Downloads/src/mozilla-central/ff-opt-obj/nsprpub/pr/src/pthreads'                                                     
make[5]: Leaving directory `/home/jack/Downloads/src/mozilla-central/ff-opt-obj/nsprpub/pr/src'                                                              
make[4]: Leaving directory `/home/jack/Downloads/src/mozilla-central/ff-opt-obj/nsprpub/pr'                                                                  
cd lib; make -j1 clobber_all                                                                                                                                 
make[4]: Entering directory `/home/jack/Downloads/src/mozilla-central/ff-opt-obj/nsprpub/lib'                                                                
rm -rf  dist       LOGS TAGS ./.md core  /no-such-file so_locations                                                                                          
cd ds; make clobber_all                                                                                                                                      
make[5]: Entering directory `/home/jack/Downloads/src/mozilla-central/ff-opt-obj/nsprpub/lib/ds'                                                             
rm -rf  dist ./libplds4.a ./libplds4.so ./plarena.o ./plhash.o ./plvrsion.o    LOGS TAGS ./.md core  ./_pl_bld.h /no-such-file so_locations                  
make[5]: Leaving directory `/home/jack/Downloads/src/mozilla-central/ff-opt-obj/nsprpub/lib/ds'                                                              
cd libc; make clobber_all                                                                                                                                    
make[5]: Entering directory `/home/jack/Downloads/src/mozilla-central/ff-opt-obj/nsprpub/lib/libc'                                                           
rm -rf  dist       LOGS TAGS ./.md core  /no-such-file so_locations                                                                                          
cd include; make clobber_all                                                                                                                                 
make[6]: Entering directory `/home/jack/Downloads/src/mozilla-central/ff-opt-obj/nsprpub/lib/libc/include'                                                   
rm -rf  dist       LOGS TAGS ./.md core  /no-such-file so_locations                                                                                          
make[6]: Leaving directory `/home/jack/Downloads/src/mozilla-central/ff-opt-obj/nsprpub/lib/libc/include'                                                    
cd src; make clobber_all                                                                                                                                     
make[6]: Entering directory `/home/jack/Downloads/src/mozilla-central/ff-opt-obj/nsprpub/lib/libc/src'                                                       
rm -rf  dist ./libplc4.a ./libplc4.so ./plvrsion.o ./strlen.o ./strcpy.o ./strdup.o ./strcase.o ./strcat.o ./strcmp.o ./strchr.o ./strpbrk.o ./strstr.o ./strtok.o ./base64.o ./plerror.o ./plgetopt.o    LOGS TAGS ./.md core  ./_pl_bld.h /no-such-file so_locations                                                    
make[6]: Leaving directory `/home/jack/Downloads/src/mozilla-central/ff-opt-obj/nsprpub/lib/libc/src'                                                        
make[5]: Leaving directory `/home/jack/Downloads/src/mozilla-central/ff-opt-obj/nsprpub/lib/libc'                                                            
make[4]: Leaving directory `/home/jack/Downloads/src/mozilla-central/ff-opt-obj/nsprpub/lib'                                                                 
make[3]: Leaving directory `/home/jack/Downloads/src/mozilla-central/ff-opt-obj/nsprpub'                                                                     
make[3]: Entering directory `/home/jack/Downloads/src/mozilla-central/ff-opt-obj/js/ctypes/libffi'                                                           
make[3]: *** Keine Regel, um »clobber_all« zu erstellen.  Schluss.                                                                                           
make[3]: Leaving directory `/home/jack/Downloads/src/mozilla-central/ff-opt-obj/js/ctypes/libffi'
make[2]: *** [clobber_all] Fehler 2
make[2]: Leaving directory `/home/jack/Downloads/src/mozilla-central/ff-opt-obj'
make[1]: *** [maybe_clobber_profiledbuild] Fehler 2
make[1]: Leaving directory `/home/jack/Downloads/src/mozilla-central'
make: *** [profiledbuild] Fehler 2
==> FEHLER: Build fehlgeschlagen.
    Breche ab ...

Ideas, anyone?

Last edited by Harlequin (2009-09-23 22:30:10)

blasse · 2009-09-24 06:20:13

What Firefox are you trying to build? 3.5.3, 3.6a2 or 3.7a1?

Harlequin · 2009-09-24 09:04:03

I am trying to build 3.7a on x86_64 with a fresh gcc-svn build.

blasse · 2009-09-24 10:16:30

Try with official stable GCC. Using experimental compiler to build experimental soft with highly optimized settings is a bad idea. If you want to stick with experimental soft - use default mozconfig and remove my optimizations from pkgbuild. You will than have greater chance to succeed.

Evanlec · 2009-09-25 06:36:45

toxygen wrote:

will try that from work, thanks!
[edit]
ok back home now, successfully built 3.7a1 (i called it firefox-pgo-hg on my pkgbuild), build 2009 09 22 232207.
jit options in about:config both set to true
sunspider javascript benchmark shows:
Total: 967.2ms
running it in 3.5 was around 1300ms, on 3.6a1 around the same, and 3.6a2 was around 1100ms (i had the results saved but lost the file). i'll probably retest on a day off from work to make sure. so far so good! goign to test extensions and html5 next.

Mind commenting on how you got that to build? i.e. which patches did you have to remove etc ?

Procyon · 2009-09-25 07:54:39

I compiled a2 and for the first time while compiling a pgo when a firefox window popped up it didn't say "something timed out" but it actually started running dozens of tests.

But I still get that the background overwrites everything until you scroll out and back in.

blasse · 2009-09-25 08:29:51

Evanlec wrote:

Mind commenting on how you got that to build? i.e. which patches did you have to remove etc ?

Compile it with gcc-4.4. Remove hunspell patch. Rest should be fine "as is"

toxygen · 2009-09-25 19:49:46

Evanlec wrote:

Mind commenting on how you got that to build? i.e. which patches did you have to remove etc ?

the PKGBUILD was from aur comments (on the pgo-beta aur page). as commented in last page of this thread, i already had firefox-pgo-beta (3.6a2) built, i made a new folder for 3.7a1 called firefox-pgo-hg, and copied the PKGBUILD from the comments. then i copied the other source files from the 3.6a2 folder. editted the PKGbuild, commented out the hunspell patch stuff, and re-did md5sum, then built it.

blasse wrote:

Compile it with gcc-4.4. Remove hunspell patch. Rest should be fine "as is"

when i first built it i had gcc-snapshot installed, and commented out the hunspell entries in pkgbuild (sources, md5, and later in the 'build' portion). i also enabled oss with setting _sndsystem. that was on 9/22/09. i happened to rebuild gcc-snapshot a couple of days ago, and tried rebuilding firefox, but it failed with what appears to be a a gcc error. i now removed gcc-snapshot and will try rebuilding with plain gcc 4.4.

i'm still using 3.7a1 from the 9/22 build, i've had no crashes at all (other than when trying to enable xmarks).

Last edited by toxygen (2009-09-25 19:54:10)

toxygen · 2009-09-25 23:53:22

Here is the PKGBUILD i used:

# Contributor: blasse <koralik(at)gmail(dot)com>
pkgname=firefox-pgo-alpha-hg
#pkgver=33060
pkgver=33083
pkgrel=1
pkgdesc="Mozilla Firefox - tracemonkey-enabled, XULRunner independent, optimized with PGO - real standalone"
arch=('i686' 'x86_64')
license=('MPL' 'GPL' 'LGPL')
_soundsystem='oss' # 'alsa-lib' for ALSA and 'oss' for OSS
makedepends=('mercurial' 'zip' 'pkgconfig' 'diffutils' 'python' 'xorg-server' 'imagemagick' 'file' 'wireless_tools')
depends=('gtk2>=2.16.0' 'gcc-libs>=4.4' 'libidl2>=0.8.13' 'mozilla-common' 'nss>=3.12.2' 'libxt' 'startup-notification>=0.9' 'desktop-file-utils' 'libjpeg' 'libpng' 'cairo' 'hunspell' 'libnotify' $_soundsystem)
provides=('firefox'="3.7")
conflicts=('firefox')
options=('!makeflags' 'ccache')
_hgroot="http://hg.mozilla.org"
_hgrepo=mozilla-central
url="http://www.mozilla.org/projects/firefox"
source=(
mozconfig
#100-system-hunspell-corrections.patch
firefox.desktop
firefox-safe.desktop
ldflags.patch
ldflags2.patch)
#x64config.patch)

md5sums=(
'f12db64cedf53e5b105381a8588bfaae'
#'5efd6772ed0ecf8eddec5d5650191d3c'
'4b766d6d21e1168dd365f467e4275e13'
'1034e29d85c2d22faeb5899732321559'
'9e461e5fc73b241d68d08be908405a5e'
'9587e0e6da42c883e34a46ee35cc3b7d')
#'96615d45f14540a9d9f3c0bcb7c286dd')

build() {
cd ${srcdir}/mozilla-central
cp $srcdir/mozconfig .mozconfig

if _soundsystem='oss'; then
#Use OSS instead of ALSA.
sed -i 's/sydney_audio_alsa/sydney_audio_oss/' media/libsydneyaudio/src/Makefile.in || return 1

#Get rid of ALSA stuff in the build system.
sed -i '/alsa\//d' config/system-headers || return 1
sed -i '/alsa\//d' js/src/config/system-headers || return 1
sed -i '/LIB(asound/d' configure.in || return 1
autoconf-2.13 || return 1
fi

#if [ `uname -m` = 'x86_64' ]; then
#enable TM on x86_64 - not working yet :/
# patch -Np1 -i ${srcdir}/x64config.patch || return 1
# fi

#fix build with system hunspell - gentoo
#patch -Np0 -i ${srcdir}/100-system-hunspell-corrections.patch || return 1

patch -Np1 -i ${srcdir}/ldflags.patch || return 1

#PGO patch - use when compiling stops with control sum mismatch error, thanks to methuselah
# patch -Np1 -i ${srcdir}/ldflags2.patch || return 1

# unset LD_PRELOAD
# unset CFLAGS
# unset CXXFLAGS
export CFLAGS="-march=native"
export CXXFLAGS="-march=native"
export LDFLAGS="-Wl,-rpath,/usr/lib/firefox-${pkgver}-hg -Wl,--hash-style=gnu,--sort-common"

if [ `uname -m` = 'x86_64' ]; then
#for non-pgo build - enabled for x86-64, pgo seems to build fine if non-pgo is build first with the same source.
make -f client.mk MOZ_MAKE_FLAGS="${MAKEFLAGS}" || return 1
fi
#for pgo build
#make -f client.mk profiledbuild MOZ_MAKE_FLAGS="${MAKEFLAGS}" || return 1
#
# kill $XPID
make -j1 DESTDIR=${pkgdir} -C ff-pgo install || return 1

install -m755 -d ${pkgdir}/usr/share/applications
install -m755 -d ${pkgdir}/usr/share/pixmaps
install -m644 "$srcdir"/mozilla-central/other-licenses/branding/firefox/mozicon128.png ${pkgdir}/usr/share/pixmaps/firefox.png || return 1
install -m644 ${srcdir}/firefox.desktop ${pkgdir}/usr/share/applications/ || return 1
install -m644 ${srcdir}/firefox-safe.desktop ${pkgdir}/usr/share/applications/ || return 1
#Remove devel stuff
rm -rf "$pkgdir"/usr/include/
rm -rf "$pkgdir"/usr/lib/firefox-devel-${pkgver}-hg/
# rm -rf "$pkgdir"/usr/lib/firefox-devel-3.5/
rm -rf "$pkgdir"/usr/share/idl/ || return 0
}

I commented out the profiledbuild because it was erroring out as Harlequin's above. "no rule to make clobberall" if i remember the wording right.
also gcc 4.4 failed building it as it was, i reinstalled gcc-snapshot and it worked again. I did a quick test on the sunspider test and get this:

Total: 985.6ms

firefox shows build # 20090925 182211
by the way, my system is quad core @ 2.6ghz, 2gig ram
[edit] i was running amarok, firefox with many tabs open when i did the test, which i think would explain the slight increase from the previous build. I'm also going to try building the profiledbuild again.

Last edited by toxygen (2009-09-25 23:56:39)

Gen2ly · 2009-09-26 03:28:45

Looks pretty good toxygen. I'd like to try this out. Could you do makepkg source for me so that I can give it a try? Or is mozconfig... the same as in AUR? Btw, what the heck does hg mean?

Last edited by Gen2ly (2009-09-26 03:30:51)

blasse · 2009-09-26 08:03:50

hg = mercurial (something like svn, but newer)
It uses patches and mozconfig from my build, so downloading firefox-pgo-beta and replacing pkgbuild should work.

Harlequin · 2009-09-26 21:39:54

Ok finally did id with pkg from toxygen, thanks for that. It builds for me with gcc 4.4 but not with the snapshot or the svn, pgo still fails with the error i posted above. But the difference is really impressive:

Firefox 3.6.2a pgo
Total: 1635.8ms +/- 7.8%

Firefox 3.7a non pgo
Total: 777.8ms +/- 2.7%

on my system (quadcore 3.2 ghz and 4gig ram)

and it feels way more snappier thanks a lot guys. Maybe i will post some results from other browser but for now i am happy

Evanlec · 2009-09-26 23:42:01

tried to build with toxygens pkgbuild (only using alsa instead of oss) and get this

/home/el/aur/firefox-hg/PKGBUILD: line 48: autoconf-2.13: command not found
==> ERROR: Build Failed.
    Aborting...

wtf?

flamelab · 2009-09-26 23:49:04

Evanlec wrote:

tried to build with toxygens pkgbuild (only using alsa instead of oss) and get this
/home/el/aur/firefox-hg/PKGBUILD: line 48: autoconf-2.13: command not found
==> ERROR: Build Failed.
    Aborting...
wtf?

pacman -S base-devel

?

Gen2ly · 2009-09-27 01:36:38

flamelab wrote:

Evanlec wrote:
tried to build with toxygens pkgbuild (only using alsa instead of oss) and get this
/home/el/aur/firefox-hg/PKGBUILD: line 48: autoconf-2.13: command not found
==> ERROR: Build Failed.
    Aborting...
wtf?
pacman -S base-devel
?

Yeah, got this too. From the error it looks like it's looking for autoconf-2.13, which hasn't been around for awhile.

toxygen · 2009-09-27 02:48:27

Evanlec wrote:

tried to build with toxygens pkgbuild (only using alsa instead of oss) and get this
/home/el/aur/firefox-hg/PKGBUILD: line 48: autoconf-2.13: command not found
==> ERROR: Build Failed.
    Aborting...
wtf?

I believe that was for an old error, but i have the following:

yaourt -Qs autoconf
core/autoconf 2.64-1 (base-devel)
A GNU tool for automatically configuring source code
local/autoconf-compat 2.13-3
A GNU tool for automatically configuring source code

also from page 2 of this thread:

blasse wrote:

Try to disable patch. autoconf 2.13 is avaiable as autoconf-compat in aur. In my mozconfig there is (commented out) line, that makes mozilla use autoconf 2.13. Mercurial uses it since I remember

==============

Gen2ly wrote:

Looks pretty good toxygen. I'd like to try this out. Could you do makepkg source for me so that I can give it a try? Or is mozconfig... the same as in AUR? Btw, what the heck does hg mean?

as blasse pointed out, i used his pgo-beta package (yaourt -G firefox-pgo-beta) and replace the PKGBUILD

Harlequin wrote:

Ok finally did id with pkg from toxygen, thanks for that. It builds for me with gcc 4.4 but not with the snapshot or the svn, pgo still fails with the error i posted above. But the difference is really impressive:
Firefox 3.6.2a pgo
Total: 1635.8ms +/- 7.8%
Firefox 3.7a non pgo
Total: 777.8ms +/- 2.7%
on my system (quadcore 3.2 ghz and 4gig ram)
and it feels way more snappier thanks a lot guys. Maybe i will post some results from other browser but for now i am happy

wow that is a huge difference, almost half! and it does feel much snappier to me, a lot of pages i'm used to "waiting" for come right up and overall the experience has been very satisfying.
pgo build is also failing for me on 3.7a1, i just commented that build line out of the pkgbuild.
the error i'm getting is

0;gmake: clobber_all in mozilla-central/ff-pgo/js/ctypes/libffi^Gmake[3]: Entering directory `packages/sources/firefox/firefox-hg/src/mozilla-central/ff-pgo/js/ctypes/libffi'
make[3]: *** No rule to make target `clobber_all'.  Stop.

and i couldnt find anything online about it.

Last edited by toxygen (2009-09-27 02:55:57)

Gen2ly · 2009-09-27 08:02:58

blasse wrote:

hg = mercurial (something like svn, but newer)
It uses patches and mozconfig from my build, so downloading firefox-pgo-beta and replacing pkgbuild should work.

Thanks blasse, wanted to be sure if anything got changed from here to there.

toxygen wrote:

local/autoconf-compat 2.13-3
A GNU tool for automatically configuring source code

Yikes, missed that. Guess I've been up to late.

I built and it went smoothly. I also was able to compile with the default gcc 4.4. Went and tested ogv video on dailymotion and now I got sound. Big plus (not so good at reading lips). The video is a bit choppy on the transformer link. I'm not sure if this has to do with oss or the build itself (was previously using 3.5.3).

Having tracemonkey is a very nice. Noticed good gains on sites I use alot: Gmail, espn... They all load a good deal faster. I did a sunspider test but the results don't look great:

Total: 1673.8ms +/- 1.5%

Didn't test before but definitely noticing a good speed improvement. Using a dual-core 2ghz, hmm.

Good work on the package blasse, toxygen.

guzz46 · 2009-09-27 08:14:47

Having tracemonkey is a very nice. Noticed good gains on sites I use alot: Gmail, espn... They all load a good deal faster. I did a sunspider test but the results don't look great:

Out of curiosity have you done any comparisons with chromium (if you still have it installed), i'm curious if tracemonkey is any faster but don't have the time to compile firefox at the moment

Last edited by guzz46 (2009-09-27 08:17:14)

blasse · 2009-09-27 08:24:09

Gen2ly wrote:

The video is a bit choppy on the transformer link. I'm not sure if this has to do with oss or the build itself (was previously using 3.5.3).

Probably trunk-connected. Tested 3.6a2 with OSS (installed OSS on my laptop specially for that ) and video and sound were smooth
However not many sites use video tag...

Evanlec · 2009-09-27 22:10:48

I got firefox 3.7 alpha to build.

Sunspider results:

Total: 969.4ms +/- 1.6%

before with 3.6a2 I was getting around 2300ms.

Quite pleased

ammon · 2009-09-29 18:13:13

==> ERROR: Integrity checks (md5) differ in size from the source array.
Error: Makepkg was unable to build firefox-pgo-beta package.

I've checked md5sums. They match. What is the problem?

I've tried to build firefox-beta-pgo
thats 3.6a2

Last edited by ammon (2009-09-29 18:53:14)

toxygen · 2009-09-29 21:40:49

ammon wrote:

==> ERROR: Integrity checks (md5) differ in size from the source array.
Error: Makepkg was unable to build firefox-pgo-beta package.
I've checked md5sums. They match. What is the problem?
I've tried to build firefox-beta-pgo
thats 3.6a2

sounds like you have more md5sum listed in the array than you do files that require the md5. can you post your PKGBUILD?

ammon · 2009-09-29 21:46:11

It's not mine. lol

It from aur, blasse pkgbuild

Arch Linux

#351 2009-09-22 16:04:50

Re: Official firefox-pgo thread

#352 2009-09-23 20:26:38

Re: Official firefox-pgo thread

#353 2009-09-23 22:29:37

Re: Official firefox-pgo thread

#354 2009-09-24 06:20:13

Re: Official firefox-pgo thread

#355 2009-09-24 09:04:03

Re: Official firefox-pgo thread

#356 2009-09-24 10:16:30

Re: Official firefox-pgo thread

#357 2009-09-25 06:36:45

Re: Official firefox-pgo thread

#358 2009-09-25 07:54:39

Re: Official firefox-pgo thread

#359 2009-09-25 08:29:51

Re: Official firefox-pgo thread

#360 2009-09-25 19:49:46

Re: Official firefox-pgo thread

#361 2009-09-25 23:53:22

Re: Official firefox-pgo thread

#362 2009-09-26 03:28:45

Re: Official firefox-pgo thread

#363 2009-09-26 08:03:50

Re: Official firefox-pgo thread

#364 2009-09-26 21:39:54

Re: Official firefox-pgo thread

#365 2009-09-26 23:42:01

Re: Official firefox-pgo thread

#366 2009-09-26 23:49:04

Re: Official firefox-pgo thread

#367 2009-09-27 01:36:38

Re: Official firefox-pgo thread

#368 2009-09-27 02:48:27

Re: Official firefox-pgo thread

#369 2009-09-27 08:02:58

Re: Official firefox-pgo thread

#370 2009-09-27 08:14:47

Re: Official firefox-pgo thread

#371 2009-09-27 08:24:09

Re: Official firefox-pgo thread

#372 2009-09-27 22:10:48

Re: Official firefox-pgo thread

#373 2009-09-29 18:13:13

Re: Official firefox-pgo thread

#374 2009-09-29 21:40:49

Re: Official firefox-pgo thread

#375 2009-09-29 21:46:11

Re: Official firefox-pgo thread

Board footer