Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

eyolf · 2010-02-12 10:52:01

Xyne wrote:

I've added an prompt which will let you keep going after a failed build (haven't tested it though). Let me know if it works.

Doesn't seem to be working yet -- I still get thrown out to the shell when one build fails (so far, the cases I've come across are: missing dependencies and failed downloads (I seem to remember, but perhaps not), and general build failures.

Configuring foo-1.0...
Setup: The following installed packages are broken because other packages they
depend on are missing. These broken packages must be rebuilt before they can
be used.
package random-1.0.0.2 is broken due to missing package
time-1.1.4-74673f7d068def85b6a33c1cfba358a9
==> ERROR: Build Failed.
    Aborting...
ERROR: makepkg exited with an error (512)

I don't know what's going on in this case; I get the error even though time has been installed. If that's a version number, it's a strange one, and I can't find a packet "random" anywhere.

make[1]: *** [tmp/obj/dictmanager.o] Error 1
make[1]: Leaving directory `/home/eyolf/pkg/bauerbill/build/AUR/simpledict/src/simpledict-0.3.0-src'
make: *** [release] Error 2
==> ERROR: Build Failed.
    Aborting...
ERROR: makepkg exited with an error (512)

By the way: I forgot to say: it looks like a great tool.

Last edited by eyolf (2010-02-12 10:52:52)

Xyne · 2010-02-12 11:10:07

@eyolf
Are you using the latest version of perl-xyne-arch from the repo on my site?

jowilkin · 2010-02-12 22:48:58

Having an issue installing from the AUR, here is what happened:

> sudo bauerbill --aur -S libaqpm-git shaman2-svn
WARNING: libaqpm-git does not match any package or group in sync db
WARNING: shaman2-svn does not match any package or group in sync db
--> Searching for AUR packages...
--> Loading AUR taurball data...
WARNING: about to source /tmp/bauerbill/build/aur/shaman2-svn/PKGBUILD
view [v]  backup [b]  edit [e]  continue [ok]  skip [s]  abort [x]  ok
WARNING: about to source /tmp/bauerbill/build/aur/libaqpm-git/PKGBUILD
view [v]  backup [b]  edit [e]  continue [ok]  skip [s]  abort [x]  ok
--> resolving pacman... installed
--> resolving kdelibs... installed
--> resolving dbus... installed
Undefined subroutine &Xyne::Arch::Bauerbill::check_name_and_ver_spec called at /usr/share/perl5/vendor_perl/Xyne/Arch/Bauerbill.pm line 1626.
--> resolving libaqpm-git...

I'm using the xyne-any repository:

> pacman -Qs xyne
local/perl-xyne-arch 2010.02.12.1-1
    Xyne's Arch-specific Perl modules.
local/perl-xyne-common 2010.02.11.1-1
    Xyne's common Perl modules.

> pacman -Q bauerbill
bauerbill 0.2.3-3

Edit: It worked when I installed the 2 packages separately instead of trying to install them together.

Last edited by jowilkin (2010-02-12 22:54:55)

eyolf · 2010-02-13 01:17:40

Xyne wrote:

@eyolf
Are you using the latest version of perl-xyne-arch from the repo on my site?

Apparently I didn't. My bad. Works now. Excellent.

I don't know if these are requests or what, but there is one feature of yaourt which is quite neat: the most recent comments from the AUR page, which will usually give hints as to whether I need to edit the pkgbuild, or if I need to recompile at all, if I'm doing a -Syu --aur. I know there are quite a few options already, and I'm not asking for it to be a default option as in yaourt -- it does slow things down -- but an optional "[c] check comments" option, perhaps...?

One more thing, while I'm at it: some of the aur packages take a lot of time to build, and I'm not always there in the sudo gap, so to speak, so I end up with this situation:

==> Finished making: rakarrack-git 20100213-1 i686 (Sat Feb 13 01:54:00 CET 2010)
--> moved rakarrack-git-20100213-1-i686.pkg.tar.gz to the cache (/var/cache/pacman/pkg/rakarrack-git-20100213-1-i686.pkg.tar.gz)
--> Installing /var/cache/pacman/pkg/rakarrack-git-20100213-1-i686.pkg.tar.gz...
--> Running pacman: /usr/bin/sudo /usr/bin/pacman-color --cachedir "/var/cache/pacman/pkg" -U  /var/cache/pacman/pkg/rakarrack-git-20100213-1-i686.pkg.tar.gz
Password:
error: pacman exited with an error (256)
eyo:eyolf[~]%

if you see what I mean. The package is still there, of course, but it would have been nice with a "sudo timeout safety net". I see the beauty of having everything running seamlessly as long as sudo is still active, but if I miss the window, I'm out.

But hey, I'm beginning to like this little program of yours...

wesley_of_course · 2010-02-13 08:50:56

What am I doing wrong here ?

[wesley@ratdog ~]$  pacman -Qs xyne
local/perl-xyne-arch 2010.02.10.4-1
    Xyne's Arch-specific Perl modules.
local/perl-xyne-common 2010.02.09.2-1
    Xyne's common Perl modules.
[wesley@ratdog ~]$ pacman -Q bauerbill
bauerbill 0.2.3-3

http://dpaste.com/158208/

[wesley@ratdog ~]$ sudo bauerbill -Syu
:: Synchronizing package databases...
 testing is up to date
 core is up to date
 extra is up to date
 community-testing is up to date
 community is up to date
 xyne-any is up to date
 archlinuxfr is up to date
 archrepo is up to date
 compiz-fusion is up to date
 arch-games is up to date
--> Searching for upgradable repo packages...
--> Searching for upgradable AUR packages...
:: ABS build queue:
:: Build all? [Y/n] y
--> Switching to pacman: /usr/bin/pacman -S -u
:: Starting full system upgrade...
 local database is up to date

Thanks Xyne for bauerbill , switched from yaourt . Or is this the newest ?

Xyne · 2010-02-13 11:56:55

@eyolf
I would have to add code to scrape the AUR webpage to get the comments. That feels hackish and unnecessary. If I did that then I should also include code to check the latest news from the front page, information about packages from CPAN, same for Hackage, etc.... if I go down that path then I'll end up with the Emacs of Pacman wrappers.

I don't know what to do about the sudo timeout during builds. Can't you just run bauerbill with sudo to avoid that? It drops privileges when building so there's no real reason not to.

@wesley_of_course
Do you mean the empy ABS build queue and prompt? I had forgotten to check if the array was empty before prompting. It's been fixed.

Be careful with using ABS by default. It will not work for repos which do not provide the $repo.abs.tar.gz archive. I'll probably add an option to list ABS-compatible repos in the config.

I also recommend placing [xyne-any] above [community] to use the latest versions of my packages.

wesley_of_course · 2010-02-13 16:41:09

Yes that was it and Thank You again .

A short question ; when Bauerbill reaches the line , ' Searching for upgradable ' it'll blink empty for up to 5 seconds before a response , is it because of my configuration ? Thanks again .

Primoz · 2010-02-13 23:37:09

Any idea why is bauerbill so slow when I wish to install invaders (the same that are on ArchLive).
It takes a small eternity to find it.
I think it has to be a local problem...

Xyne · 2010-02-14 01:31:27

@wesley_of_course
What do you mean by "blink empty"?
If you've enabled AUR, CPAN or Hackage support then it will take a little longer to query upgradable packages (server queries, database loading, etc).

@Primoz
Maybe you're on a slow system. It takes a while to check all the provides and groups in the local database. Try the "--memoize" option to see if that helps. It will cache lookups in memory to speed them up.

wesley_of_course · 2010-02-14 04:41:36

I'm not complaining by any means it seemed to take a while and I'm new with Bauerbill .

http://dpaste.com/158622/

Still playing with it . Thanks again , Xyne .

Primoz · 2010-02-14 15:41:57

Xyne wrote:

@wesley_of_course
@Primoz
Maybe you're on a slow system. It takes a while to check all the provides and groups in the local database. Try the "--memoize" option to see if that helps. It will cache lookups in memory to speed them up.

While my system isn't the newest, it' still two core AMD Athlon 4400+ with 2GB of RAM.
But memoize does speed up things...
Thanks.
It also varies, the whole updating isn't that slow, but searching through AUR is mostly as slow as yaourt.
But at downloading and installing it is faster than anything...

Runiq · 2010-02-14 15:46:36

Xyne wrote:

@eyolf
I would have to add code to scrape the AUR webpage to get the comments. That feels hackish and unnecessary. If I did that then I should also include code to check the latest news from the front page, information about packages from CPAN, same for Hackage, etc.... if I go down that path then I'll end up with the Emacs of Pacman wrappers.

Please don't add any more features. Bauerbill is pretty much perfect as-is. Go work on something else, man.

hash · 2010-02-14 16:42:10

I just gave bauerbill a try, and so far its great. The only thing that annoys me is progress of download. Is there any way to show total download size/% of total download instead of just one file that is being downloaded? At the moment when i install something i get something like this:

[#1 SIZE:480.0KiB/600.9KiB(79%) CN:1 SPD:19.0KiBs ETA:06s](9more...) [TOTAL SPD:204.1KiBs]

which doesn't tell me how much MB more i need to download.

Xyne · 2010-02-14 16:58:38

@hash
I used to show that information in an older version of Powerpill but getting it is complicated. Perl's built-in size functions report allocated size rather than actual size (at least that's what I think), which is meaningless for segmented downloads (e.g. it might report the size as 80% of the total when it's just started downloading and thus closer to 0). The only way to get the actual size that I've found is with a system call to "du" followed by a comparison with the size reported by Perl to determine the minimum of the two. When I rewrote Powerpill to create Bauerbill, I left out that code because I didn't think a pretty progress bar was worth all the system calls and kludgy code.

The progress line that you see now during a download is the raw progress line from aria2c. I would recommend posting a feature request upstream to change the output. I think it would be much more informative if it focused on global stats rather than showing stats for a single download at a time (e.g. total connections, size remaining, etc).

hash · 2010-02-14 17:05:28

Xyne wrote:

@hash
I used to show that information in an older version of Powerpill but getting it is complicated. Perl's built-in size functions report allocated size rather than actual size (at least that's what I think), which is meaningless for segmented downloads (e.g. it might report the size as 80% of the total when it's just started downloading and thus closer to 0). The only way to get the actual size that I've found is with a system call to "du" followed by a comparison with the size reported by Perl to determine the minimum of the two. When I rewrote Powerpill to create Bauerbill, I left out that code because I didn't think a pretty progress bar was worth all the system calls and kludgy code.
The progress line that you see now during a download is the raw progress line from aria2c. I would recommend posting a feature request upstream to change the output. I think it would be much more informative if it focused on global stats rather than showing stats for a single download at a time (e.g. total connections, size remaining, etc).

Thanks a lot for an extensive explanation. I've just thought that i missed some option, but as it is not implemented in aria2c then i i'll most likely post a feature request on their site.

Runiq · 2010-02-15 00:07:20

Hey Xyne,

I just encountered this:

$ sudo bauerbill -S --aur gmpc-lyrics-git
Password: 
WARNING: gmpc-lyrics-git does not match any package or group in sync db
--> Searching for AUR packages...
--> Loading AUR taurball data...
WARNING: about to source /home/patrice/pkg/aur/gmpc-lyrics-git/PKGBUILD
view [v]  backup [b]  edit [e]  continue [ok]  skip [s]  abort [x]  ok
--> resolving gmpc-git... installed
--> resolving git... installed
--> resolving pkgconfig... installed
Can't use string ("gmpc-lyrics") as an ARRAY ref while "strict refs" in use at /usr/share/perl5/vendor_perl/Xyne/Arch/Bauerbill.pm line 1625.

Xyne · 2010-02-15 07:52:43

@Runiq
That's an error in the PKGBUILD. "provides" should be an array. Tell the packager to remove the empty arrays too (source, md5sums).

Runiq · 2010-02-15 08:51:23

Xyne wrote:

@Runiq
That's an error in the PKGBUILD. "provides" should be an array. Tell the packager to remove the empty arrays too (source, md5sums).

Thanks! I'm sorry I didn't notice this myself.

jowilkin · 2010-02-17 15:39:51

Xyne - I don't think you ever addressed my previous error, see post #403.

Also just had a new error pop up when dependencies were being resolved, here is a snippet of the output

--> resolving libxmu>=1.0.4... installed
--> resolving librsvg>=2.22.3... installed
--> resolving libmng>=1.0.10... installed
--> resolving dbus-glib>=0.76... installed
--> resolving libexif>=0.6.16... installed
--> resolving pygtk>=2.13.0... installed
--> resolving desktop-file-utils... installed
Use of uninitialized value $_pkgname in string eq at /usr/share/perl5/vendor_perl/Xyne/Arch/Bauerbill.pm line 1610.
Use of uninitialized value $_pkgname in string eq at /usr/share/perl5/vendor_perl/Xyne/Arch/Bauerbill.pm line 1610.
--> resolving gegl>=0.1.2... found in [extra]
--> resolving curl... installed
--> resolving lib32-libxmu... installed
--> resolving lib32-libxcursor... installed
--> resolving lib32-libxinerama... installed
--> resolving lib32-mesa... installed
--> resolving lib32-libxft... installed

Full ouput can be found here http://pastebin.com/m20aae1a2 (bbup is my alias for sudo bauerbill --aur -Syu)

Xyne · 2010-02-17 16:02:31

@jowilkin
I fixed the previous error after I saw your post. Do you still get it?

The new one should be fixed now too.

Xyne · 2010-02-17 16:19:00

I'm hereby officially announcing Hackage support for Bauerbill.

jowilkin · 2010-02-17 17:21:59

Xyne wrote:

@jowilkin
I fixed the previous error after I saw your post. Do you still get it?
The new one should be fixed now too.

Ah ok thanks, I don't think it's happened since then. I will let you know if either errors crop up again.

gav616 · 2010-02-17 18:46:41

couple of things;

Is there a way not to use ABS on a certain package, for example, if i use ABS + the 'build all' option but want to quickly install a package from the extra repo without building.

something like a '--repo'
--

'makedeps' options? for example;
always remove makedeps after successful build
never remove makedeps after successful build
etc..
--

Bauerbill has a list 'Orphaned' packages option (pacman option '-Qdt', extended functions in yaourt**)

Bauerbill only displays the packages, could this include a remove option too? (-Rcs)
also, could it include extra info on each package, such as, packages they were makedeps for..

**"list missed packages installed as dependecies but not required"

Bauerbill is brilliant, cheers!

Last edited by gav616 (2010-02-17 19:12:19)

Xyne · 2010-02-17 18:56:20

So you want a way to tell it to build everything but not build everything?

Btw, if you're using the "--build-all" option, you don't need to use "--abs". Generally, I would recommend not setting either of those option in the config. If you use them often, create a bash alias for them instead.

MAroco · 2010-02-17 19:02:27

Hi Xyne

Just to let you know, bauerbill just gave me this output:

bau -Syu
:: Synchronisiere Paketdatenbanken...
 core ist aktuell
 extra ist aktuell
 xyne-any ist aktuell
 community ist aktuell
--> Searching for upgradable repo packages...
--> Searching for upgradable AUR packages...
--> Searching for upgradable CPAN packages...
--> Loading AUR taurball data...
WARNING: about to source /tmp/bauerbill/build/aur/virtualbox_bin/PKGBUILD
view [v]  backup [b]  edit [e]  continue [ok]  skip [s]  abort [x]  e
view [v]  backup [b]  edit [e]  continue [ok]  skip [s]  abort [x]  ok
ERROR: The PKGBUILD for virtualbox_bin is incorrect. Please inform the packager that the "install" variable should be a string, not an array
--> fixing the packager's mistake...
--> an associated install file was found for virtualbox_bin: /tmp/bauerbill/build/aur/virtualbox_bin/vbox.install
view [v]  backup [b]  edit [e]  continue [ok]  skip [s]  abort [x]  ok
WARNING: about to source /tmp/bauerbill/build/aur/rar/PKGBUILD
view [v]  backup [b]  edit [e]  continue [ok]  skip [s]  abort [x]  ok
--> Loading ABS taurball data...
--> Checking for abs archive updates for the following repos: [community] [core] [extra]
WARNING: about to source /tmp/bauerbill/build/extra/gegl/PKGBUILD
view [v]  backup [b]  edit [e]  continue [ok]  skip [s]  abort [x]  ok

WARNING: about to source /tmp/bauerbill/build/extra/wireshark/PKGBUILD
view [v]  backup [b]  edit [e]  continue [ok]  skip [s]  abort [x]  view [v]  backup [b]  edit [e]  continue [ok]  skip [s]  abort [x]  ok

WARNING: about to source /tmp/bauerbill/build/extra/qt/PKGBUILD
view [v]  backup [b]  edit [e]  continue [ok]  skip [s]  abort [x]  view [v]  backup [b]  edit [e]  continue [ok]  skip [s]  abort [x]

I loved the part about the package maintainer, will hopefully save you having to answer those kinda questions again and again here
I will inform him right away.

The funny part is that starting with the gegl package - when switching from the AUR to the extra repo - suddenly the "just type ok without hitting enter" doesn't work anymore i.e. you have to hit enter again and then the next prompts will all appear twice.
I stopped the process, updated bauerbill (to 2010.02.17.1-2) and perl-xyne-arch (to 2010.02.17.1-1), rebooted (just to be sure) and tried again - same behaviour.
Nonetheless edit, skip, ok etc. work as expected.

(Hope it's not just my system again... The weird changes of ownerships in /tmp didn't occur again after I had reported them. Apparently my box sometimes just gets the hiccup or is part of a conspiracy to make me look stupid )

Thanks for this great tool

[Edit: Why don't you recommend to set ABS and Build all in the config? Thats exactly what I did - thought it would be fun to get a completely selfcompiled system over time - but perhaps that explains the hiccups..?].

Last edited by MAroco (2010-02-17 19:19:53)

Arch Linux

#401 2010-02-12 10:52:01

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#402 2010-02-12 11:10:07

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#403 2010-02-12 22:48:58

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#404 2010-02-13 01:17:40

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#405 2010-02-13 08:50:56

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#406 2010-02-13 11:56:55

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#407 2010-02-13 16:41:09

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#408 2010-02-13 23:37:09

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#409 2010-02-14 01:31:27

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#410 2010-02-14 04:41:36

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#411 2010-02-14 15:41:57

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#412 2010-02-14 15:46:36

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#413 2010-02-14 16:42:10

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#414 2010-02-14 16:58:38

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#415 2010-02-14 17:05:28

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#416 2010-02-15 00:07:20

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#417 2010-02-15 07:52:43

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#418 2010-02-15 08:51:23

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#419 2010-02-17 15:39:51

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#420 2010-02-17 16:02:31

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#421 2010-02-17 16:19:00

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#422 2010-02-17 17:21:59

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#423 2010-02-17 18:46:41

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#424 2010-02-17 18:56:20

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#425 2010-02-17 19:02:27

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

Board footer