Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

smradlev · 2010-05-21 19:44:33

If I run makepkg in the bauerbill tmp directory, it again fails to validate the files. If I clean the directory first, and then run makepkg, it downloads the files and successfully finishes the install.

I'm not completely sure it's an aria2c issue (although it definitely looks like one), because if I download the google-earth files with aria2c separately in the bauerbill tmp directory, and then run bauerbill, the installation is successful. So, just looking at the symptoms (I have no idea of perl, so I do not understand the bauerbill source), it may be that bauerbill feeds wrong arguments to aria?

Below is the full output of bauerbill (failing to install) installing bin32-google-earth (running on a cleaned bauerbill tmp folder).

WARNING: bin32-google-earth does not match any package or group in sync db
--> Searching for AUR packages...
--> Loading AUR taurball data...
WARNING: about to source /tmp/bauerbill/build/aur/bin32-google-earth/PKGBUILD
view [v] backup [b] edit [e] continue [ok] skip [s] abort [x] ok
--> resolving lib32-libsm... installed
--> resolving lib32-libxrandr... installed
--> resolving lib32-libgl... installed
--> resolving lib32-glib2... installed
--> resolving lib32-libxi... installed
--> resolving lib32-pcre... installed
--> resolving lib32-freetype2... installed
--> resolving lib32-libxdamage... installed
--> Determining sizes of source files...

:: The following sources will be downloaded:
http://dl.google.com/earth/client/curre … hLinux.bin
bin32-google-earth

http://earth.google.com/intl/en/license.html
bin32-google-earth

:: Number of Sources: 2
:: Total Download Size: 24.74 MiB

:: Proceed with download? [Y/n]

Status Legend:
(OK):download completed.(ERR):error occurred.

aria2 will resume download if the transfer is restarted.
If there are any errors, then see the log file. See '-l' option in help/man page for details.

--> Building bin32-google-earth...
==> Making package: bin32-google-earth 5.1.3535.3218-2 x86_64 (Fri May 21 15:32:57 EDT 2010)
==> Checking Runtime Dependencies...
==> Checking Buildtime Dependencies...
==> Retrieving Sources...
-> Found GoogleEarthLinux.bin in build dir
-> Found license.html in build dir
-> Found googleearth in build dir
-> Found googleearth.desktop in build dir
-> Found googleearth-mimetypes.xml in build dir
-> Found qt.conf in build dir
==> Validating source files with md5sums...
GoogleEarthLinux.bin ... Passed
license.html ... FAILED
googleearth ... Passed
googleearth.desktop ... Passed
googleearth-mimetypes.xml ... Passed
qt.conf ... Passed
==> ERROR: One or more files did not pass the validity check!
ERROR: makepkg exited with an error (256)
WARNING: expected package does not exist: /tmp/bauerbill/build/aur/bin32-google-earth/bin32-google-earth-5.1.3535.3218-2-x86_64.pkg.tar.xz
--> scanning /tmp/bauerbill/build/aur/bin32-google-earth for matching packages...
ERROR: no package found: /tmp/bauerbill/build/aur/bin32-google-earth/bin32-google-earth-5.1.3535.3218-2-x86_64.pkg.tar.xz
:: Abort? [Y/n] n
--> Done

Xyne · 2010-05-21 22:49:08

The main problem is that aria2c fails to download the file using a metalink. The file that it downloads is empty for some reason.

aria2c -M license.metalink

with license.metalink

<?xml version="1.0" encoding="utf-8"?>
<metalink version="3.0" xmlns="http://www.metalinker.org/">
<files>
  <file name="src/aur/bin32-google-earth/license.html">
    <identity>license.html</identity>
    <size>11304</size>
    <verification>
      <hash type="md5">757d9726191f365209fa13acdd0ab6e7</hash>
    </verification>
    <resources maxconnections="1">
      <url type="http">http://earth.google.com/intl/en/license.html</url>
    </resources>
  </file>
</files>
</metalink>

fails, yet

aria2c http://earth.google.com/intl/en/license.html

works.

I have no idea why so you'll have to ask the aria2 dev.

I've updated perl-xyne-arch to remove incomplete source files so makepkg will not exit with a checksum error. Interestingly I also found another bug which prevented detection of some failed downloads. Update to perl-xyne-arch>=2010.05.21 and try again. When it tells you that the download has failed, choose to ignore it and continue with the installation. Makepkg will correctly download it at the build stage.

Last edited by Xyne (2010-05-21 22:50:05)

maxexcloo · 2010-05-22 03:13:24

I've been using this for about a week and I love it.
Thank you!

Just a quick question, is there any way to hide this text?

--> Switching to pacman: /usr/bin/powerpill --config /etc/pacman.conf -S -c

Xyne · 2010-05-22 14:18:58

maxexcloo wrote:

Just a quick question, is there any way to hide this text?
--> Switching to pacman: /usr/bin/powerpill --config /etc/pacman.conf -S -c

Nope, sorry. Is it causing a problem?

Japanlinux · 2010-05-25 10:45:58

Thought I'd hop in here and show my support for bauerbill. I've been using it for around a week and have been enjoying it.

SanskritFritz · 2010-05-25 11:24:05

Agree, I'm using it for months already, amazing piece of work. I even made some tab completions for bauerbill in fish based on the pacman completions.

Xyne · 2010-05-26 00:37:45

Thanks. It's nice to get positive feedback.

ngoonee · 2010-05-26 00:50:02

Yeah Xyne, I echo SanskritFritz, bauerbill is amazing. Only problems I've been having aren't your fault (the aria2 corrupted download stuff).

Now please put in a --make-extra-sugary-donut-with-iced-latte command please =p

Xyne · 2010-05-26 03:27:22

ngoonee wrote:

Now please put in a --make-extra-sugary-donut-with-iced-latte command please =p

I will, just as soon as the Aria2 dev adds donut and latte download support.

GSF1200S · 2010-06-02 05:01:03

I have a question.. When running pacman -Syu, it checks the repos and then provides a list of packages to be updated. Hitting 'y' at the prompt causes the packages to be downloaded and installed. Why does Bauerbill ask if one would like to download the packages and then ask again if they would like to install them (When running -Syu or installing a package)? I know pacman has the '-w' or --downloadonly option, so it could be explicitly suggested if a situation requiring a download without install was desired. This doesnt bother me one bit- im just curious why it works this way as opposed to how pacman works. I apologize if I am blatantly missing the reason, or this has been explained from page 12 to page 29...

I have removed yaourt as bauerbill is at least twice as good. I especially wanted to note:
1) I have never downloaded a package with any package manager greater than 1.6 MB/s until Bauerbill (w/ reflector 2.4MB/s). The 1.6MB/s was Gentoo after running mirrorselect. Nice!
2) I love the skip option when AUR updates arise, as well as the option to view (v) without opening in an editor. Bauerbill makes it very easy to view, edit, and skip anything AUR related. I usually use IgnorePkg, but its nice if a package slips by that I didnt have in that line..
3) TrustedUsers is a superior concept to accepting everything. While I look at the package builds for errors and malicious code myself, I highly emplore people to use this instead of the --ungodly-long-disclaimer-of-death-that-could-break-your-system.
**EDIT** 4) Also, the mentioning of what repos a package is coming from when being upgraded is a very nice touch. Yaourt did this, but it wasnt as clean.

Thanks Xyne- absolutely fantastic wrapper!

Last edited by GSF1200S (2010-06-02 05:04:50)

ngoonee · 2010-06-02 05:20:20

GSF1200S wrote:

1) I have never downloaded a package with any package manager greater than 1.6 MB/s until Bauerbill (w/ reflector 2.4MB/s). The 1.6MB/s was Gentoo after running mirrorselect. Nice!

Damn you, I feel happy when I can get 120 kB/s.... I tend to get around 40-50.....

Otherwise pretty much agree with everything you posted.

Xyne · 2010-06-06 19:55:46

GSF1200S wrote:

I have a question.. When running pacman -Syu, it checks the repos and then provides a list of packages to be updated. Hitting 'y' at the prompt causes the packages to be downloaded and installed. Why does Bauerbill ask if one would like to download the packages and then ask again if they would like to install them (When running -Syu or installing a package)? I know pacman has the '-w' or --downloadonly option, so it could be explicitly suggested if a situation requiring a download without install was desired. This doesnt bother me one bit- im just curious why it works this way as opposed to how pacman works. I apologize if I am blatantly missing the reason, or this has been explained from page 12 to page 29...

That's a consequence of wrapping pacman. Pacman normally presents a confirmation prompt before it begins a download so the user can abort the operation. Bauerbill therefore does the same. The second prompt occurs after bauerbill has finished downloading the packages and invokes pacman. I could suppress the second confirmation with pacman's "--noconfirm" option but that would also suppress all other confirmations, which could be bad in some situations (e.g. for package replacements).

GSF1200S wrote:

3) TrustedUsers is a superior concept to accepting everything. While I look at the package builds for errors and malicious code myself, I highly emplore people to use this instead of the --ungodly-long-disclaimer-of-death-that-could-break-your-system.

The "TrustedUsers" option is the recommended way to do it. The ridiculously long option is just a consequence of getting nagged to include such an option.

GSF1200S wrote:

Thanks Xyne- absolutely fantastic wrapper!

gtklocker · 2010-06-07 09:47:24

perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
    LANGUAGE = (unset),
    LC_ALL = (unset),
    LANG = "en_US.UTF-8"
    are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
    LANGUAGE = (unset),
    LC_ALL = (unset),
    LANG = "en_US.UTF-8"
    are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").

This is an error msg I get; though the program continues working!

Xyne · 2010-06-07 15:03:52

gtklocker wrote:

perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
    LANGUAGE = (unset),
    LC_ALL = (unset),
    LANG = "en_US.UTF-8"
    are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
    LANGUAGE = (unset),
    LC_ALL = (unset),
    LANG = "en_US.UTF-8"
    are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").

This is an error msg I get; though the program continues working!

That's a Perl warning and it is completely independent of Bauerbill. The message clearly states that the locale isn't set on your system. Check your locale settings in /etc/rc.conf and /etc/locale.gen then run "locale-gen" or just re-install "glibc".

mollison · 2010-06-11 08:49:57

Xyne wrote:

I've created a separate front-end because Powerpill is in [community] and packages in the official repos are not supposed to be able to automatically install from the AUR due to security reasons. That's why Yaourt was never moved into [community] despite having over 1000 votes.

You might want to put this in the FAQ on the bauerbill page on your website. That was my first question and it's also one of the first things asked in this thread. My apologies if this has been suggested already

I'm really looking forward to trying this out!!!

Runiq · 2010-06-14 09:51:03

Hey Xyne,

Is there a way to manually specify a repository to install from? I wanted to install haskell-hlint from hackage because the AUR version was an old one and tried

bauerbill -S hackage/haskell-hlint
bauerbill -S Hackage/haskell-hlint

Neither did work, they all gave me this error message:

WARNING: hackage/haskell-hlint does not match any package or group in sync db
--> Searching for AUR packages...
--> Loading Hackage database...
--> Searching for Hackage packages...
WARNING: ignoring the following unrecognized packages: hackage/haskell-hlint"
--> Switching to pacman: /usr/bin/pacman --config /etc/pacman.conf -S hackage/haskell-hlint
error: repository 'hackage' not found
error: 'hackage/haskell-hlint': no such repository

cabal2arch is installed and Hackage support in bauerbill enabled.

DPX-Infinity · 2010-06-14 13:13:20

one way to do it is to disable all "repositories" in config file that are enabled to use by default and use command line options like

% bauerbill --hackage -S haskell-hlint

but I think there has to be an ability to explicitly tell which repository to use. Some time ago I tried to install something from AUR but bauerbill found something in official repos and refused to use AUR, dropping to plain pacman. I had to use plain makepkg instead.

oh yes, it was haskell-parsec package. It is in repositories and in hackage, but hackage has the 3.1 version, which is different from 2.1 version, so it is not updatable in repos. bu bauerbill asks me to reinstall repository package instead of using hackage.

Last edited by DPX-Infinity (2010-06-14 13:54:04)

ngoonee · 2010-06-16 00:56:23

Hi Xyne, just encountered this today with extra/mplayer. I have 31347-1 installed, and the repo has 31428-1, so it indicates that there's an update. mplayer is on my list of packages to build from ABS with my own patches (config options) as specificed in "Autobuild" and "Autopatch". The option comes up for me to view/edit/blah the PKGBUILD, but the PKGBUILD shown there is the 31347-1 PKGBUILD.

I have verified that the websvn shows version 31428-1 PKGBUILD. I always thought bauerbill got its PKGBUILDs from svn similarly to pbget, is that the case? If not, can I suggest that would be better than (as it seems now) getting the PKGBUILD from abs, which can be out of sync with the repos (basically meaning it notifies me of out-of-date packages everytime I run -Su because the one I built from abs is old).

SanskritFritz · 2010-06-16 08:53:03

We noticed on identi.ca that bauerbill is not listed here:
http://wiki.archlinux.org/index.php/AUR_Helpers
I am willing to contribute to the list, what should be the description?

UPDATE: I made a first version, I hope that is ok.

Last edited by SanskritFritz (2010-06-16 11:15:15)

Xyne · 2010-06-16 23:30:08

@Runiq
I think I've fixed it but I had problems connecting to Hackage when testing it so I may have missed something. Upgrade to the latest version of perl-xyne-arch (>=2010.06.16.1) from my repo and let me know if it works as expected.

@ngoonee
Bauerbill gets the PKGBUILD and local source files from the $repo.abs.tar.gz archive included in the official repos (and [xyne-any]). It uses neither the official SVN repo nor the ABS repo because I wanted to make it easy to expand to other compliant repos. For example, if the games repo were to include such an archive, bauerbill would be able to build packages from it from source.

I don't know how those archives are generated or why they're sometimes desynchronized, but usually you just have to wait a bit for them to catch up. If you can't, you can always use something like pbget to grab the latest svn files. I don't want to build that into bauerbill though because it would force me to provide a separate interface for every repo that provides PKGBUILDs. I may change my mind about this later though as there are already a few potential issues with the current system. I have some other solutions in mind as well, but they're part of something else and will take a while to implement because it's quite low on my list of priorities right now.

@SanskritzFritz
That's perfect. Thanks for including bauerbill on that page.

ngoonee · 2010-06-17 00:24:00

Thanks Xyne, I'll just keep an eye on what happens. It wouldn't be a big deal except that selecting any option other than skip/cancel would overwrite the existing PKGBUILD. Guess I can understand why it'd be a big pain to do it otherwise though.

jceasless · 2010-06-19 12:25:29

I'm getting the following error when trying to install 'pandoc' from Hackage:

sudo bauerbill -S --hackage pandoc 
WARNING: pandoc does not match any package or group in sync db
--> Loading Hackage database...
--> Searching for Hackage packages...
--> Loading Hackage taurball data...
error: failed to create /tmp/bauerbill/hackage/cabal_files

'Hackage' is uncommented in my /etc/bauerbill.conf

Xyne · 2010-06-20 02:06:25

@jceasless
It might be due to recent problems with Hackage. The site has been very slow this week and often times out. I've added an option named "LWPTimeout". Try setting it to 60 or higher to give Hackage more time to respond.

You should also read the comments on the AUR page, which discuss another issue with pandoc. It should work now, but you'll need the latest version of perl-xyne-arch from my site. I'll push it to community in a few days if no bugs show up.

Runiq · 2010-06-20 10:59:01

Thanks Xyne, my original problem was (kinda) solved—after installing haskell-hlint from AUR and -Syu'ing, the package was updated to the hackage version. Still couldn't use "bauerbill -S hackage/*" to use a specific repo, though.

Last edited by Runiq (2010-06-20 11:00:36)

iiijjjiii · 2010-06-23 16:18:38

Bauerbill is a great tool. The odd time though I run into foo when installing cpan modules. Here is an example:

bauerbill -S --cpan perl-geo-distance-xs

--> Building perl-text-tabs+wrap...
==> Making package: perl-text-tabs+wrap 2009.30.500-1 (Wed Jun 23 12:07:15 EDT 2010)
==> Checking Runtime Dependencies...
==> Checking Buildtime Dependencies...
==> Retrieving Sources...
  -> Found Text-Tabs+Wrap-2009.0305.tar.gz
==> ERROR: Integrity checks are missing.
ERROR: makepkg exited with an error (256)
WARNING: perl-text-tabs+wrap is not available for i686
WARNING: expected package does not exist: /var/bauerbill/build/cpan/perl-text-tabs+wrap/perl-text-tabs+wrap-2009.30.500-1-i686.pkg.tar.xz
--> scanning /var/bauerbill/build/cpan/perl-text-tabs+wrap for matching packages...
ERROR: no package found: /var/bauerbill/build/cpan/perl-text-tabs+wrap/perl-text-tabs+wrap-2009.30.500-1-i686.pkg.tar.xz

I was able to avoid the first warning by editing the PKGBUILD and changing the arch setting, but I don't know how to get around the second warning. It appears to be looking for a file named "perl-text-tabs+wrap-2009.30.500-1-i686.pkg.tar.xz" but the source downloads as "Text-Tabs+Wrap-2009.0305.tar.gz". Is there something I have to add to PKGBUILD so bauerbill finds the correct file?

Arch Linux

#701 2010-05-21 19:44:33

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#702 2010-05-21 22:49:08

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#703 2010-05-22 03:13:24

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#704 2010-05-22 14:18:58

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#705 2010-05-25 10:45:58

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#706 2010-05-25 11:24:05

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#707 2010-05-26 00:37:45

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#708 2010-05-26 00:50:02

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#709 2010-05-26 03:27:22

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#710 2010-06-02 05:01:03

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#711 2010-06-02 05:20:20

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#712 2010-06-06 19:55:46

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#713 2010-06-07 09:47:24

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#714 2010-06-07 15:03:52

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#715 2010-06-11 08:49:57

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#716 2010-06-14 09:51:03

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#717 2010-06-14 13:13:20

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#718 2010-06-16 00:56:23

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#719 2010-06-16 08:53:03

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#720 2010-06-16 23:30:08

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#721 2010-06-17 00:24:00

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#722 2010-06-19 12:25:29

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#723 2010-06-20 02:06:25

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#724 2010-06-20 10:59:01

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#725 2010-06-23 16:18:38

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

Board footer