You are not logged in.

#201 2017-10-27 05:10:58

GSF1200S
Member
Registered: 2008-12-24
Posts: 472

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

Not sure what happened here. Apparmor and Google Chrome needed to be upgraded but Bauerbill failed with:

Traceback (most recent call last):
  File "/usr/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/usr/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/usr/lib/python3.6/site-packages/Bauerbill.py", line 1151, in <module>
    sys.exit(run_main())
  File "/usr/lib/python3.6/site-packages/Bauerbill.py", line 1132, in run_main
    return main(args)
  File "/usr/lib/python3.6/site-packages/Bauerbill.py", line 1117, in main
    bb.generate_build_scripts(build_pkgs, build_deps)
  File "/usr/lib/python3.6/site-packages/Bauerbill.py", line 646, in generate_build_scripts
    scripts['download'] = self.download_script(build_pkgs)
  File "/usr/lib/python3.6/site-packages/Bauerbill.py", line 731, in download_script
    self.config, self.powerpill.pargs['pacman_config'], 'predownload', pbs[pkgbase]
  File "/usr/lib/python3.6/site-packages/Bauerbill.py", line 302, in sh_hooks_block
    for pkg in iterate_hook_targets(pbs, as_dict=as_dict):
  File "/usr/lib/python3.6/site-packages/Bauerbill.py", line 285, in iterate_hook_targets
    for pkg in sorted(pbs):
TypeError: '<' not supported between instances of 'AurBuildablePkg' and 'AurBuildablePkg'
bash: /tmp/bbscripts/download.sh: No such file or directory
sed: can't read build.sh: No such file or directory
bash: /tmp/bbscripts/build.sh: No such file or directory

Further is there anyway to install an AUR group, or all the packages of a split package? If I use bauerbill to install "apparmor" it will install just this package despite building the rest that I need built as well. I just used pacman -U manually so I wouldnt have to use bauerbill a bunch of times for all the splits.

Offline

#202 2017-11-01 19:07:45

Xyne
Moderator/TU
Registered: 2008-08-03
Posts: 6,259
Website

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

The comparison error should be fixed with today's update.

Pacman inteprets all arguments as package names so Bauerbill does the same. If you want to install all packages from the apparmor package base, there are two workarounds:

  1. Explicitly list the packages when you first install it (upgrades will autodetect previously installed packages).

  2. Use makepkg instead of makepkgx in bauerbill.json. You can set it as a default command to always install all packages in a package base, or add a custom command for apparmor and any other package for which you want to install the full base.

Example of a default command:

  "makepkg commands" : {
    "build" : {
      "common arguments" : [],
      "default" : ["makepkg", "-irs"]
    }
  }

Example of a custom command for apparmor:

  "makepkg commands" : {
    "build" : {
      "custom" : [
        ["AUR/apparmor", ["makepkg", "-irs"]]
      ]
  }

My Arch Linux StuffForum EtiquetteCommunity Ethos - Arch is not for everyone

Offline

#203 2017-11-03 01:51:21

GSF1200S
Member
Registered: 2008-12-24
Posts: 472

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

Excellent- that custom command is just what I needed. Thanks for the fix and the info smile

Offline

#204 2017-12-06 16:43:26

Spyhawk
Member
Registered: 2006-07-07
Posts: 480

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

FYI, this makepkg patch by eschwartz should alleviate the need to readd `--pkg` back into makepkg, and it might provide a good alternative to patching makepkg. It's not in master yet but shouldn't take long to be merged.

Offline

#205 2017-12-19 15:23:36

SolarAquarion
Member
Registered: 2014-05-18
Posts: 70

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

Xyne, do you know if it's possible for you to add "package completion" of aur packages and pacman packages into bauerbill

Last edited by SolarAquarion (2017-12-19 15:23:55)

Offline

#206 2017-12-19 16:29:56

Eschwartz
Trusted User/Bug Wrangler
Registered: 2014-08-08
Posts: 1,420

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

It surely is, but most AUR helpers don't try to offer completion for AUR packages as that would involve constantly redownloading a huge file containing the list of package names, and package name completion for AUR packages is kind of pointless.

Package name completion for repository packages should be as simple as hooking into pacman's own completion functions.

Offline

#207 2017-12-25 21:16:01

SolarAquarion
Member
Registered: 2014-05-18
Posts: 70

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

It's more in terms of not wanting to complete "files" after i do something like bauerbill -S ....

Offline

#208 2017-12-25 22:06:27

Eschwartz
Trusted User/Bug Wrangler
Registered: 2014-08-08
Posts: 1,420

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

Hmm, well that should be excluded anyway regardless of whether package names are completed.

Offline

#209 2018-01-08 09:49:12

effeeffe
Member
Registered: 2017-10-18
Posts: 7

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

Hi Xyne, it looks like there is a newline missing between the downloading process of different packages:

  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0==> Making package: whatsapp-desktop 0.4.2-2 (lun  8 gen 2018, 10.32.38, CET)

Offline

#210 2018-01-14 08:12:44

nplatis
Member
From: Greece
Registered: 2011-02-22
Posts: 21

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

Hello,
I started using bauerbill today, and it seems to fail to download .sig files for the repos (indeed, the .sig files do not seem to be where requested, for example http://ftp.otenet.gr/linux/archlinux/mu … lib.db.sig

Anything I am doing wrong?

Offline

#211 2018-01-14 15:20:54

dapolinario
Member
From: Brasil
Registered: 2010-03-18
Posts: 57

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

nplatis wrote:

Hello,
I started using bauerbill today, and it seems to fail to download .sig files for the repos (indeed, the .sig files do not seem to be where requested, for example http://ftp.otenet.gr/linux/archlinux/mu … lib.db.sig

Anything I am doing wrong?

Add this line in your pacman.conf to each repository (core, extra, community):

SigLevel = PackageRequired


Arch Linux: The power in your hands!

Offline

#212 2018-01-14 21:12:34

Eschwartz
Trusted User/Bug Wrangler
Registered: 2014-08-08
Posts: 1,420

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

dapolinario, that is already the default unless you've done something ill-advised like editing the default pacman.conf without having any idea what it all means.

So I desperately help that that advice wasn't actually necessary. wink

Offline

#213 2018-01-14 23:16:11

nplatis
Member
From: Greece
Registered: 2011-02-22
Posts: 21

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

Eschwartz wrote:

dapolinario, that is already the default unless you've done something ill-advised like editing the default pacman.conf without having any idea what it all means.

So I desperately help that that advice wasn't actually necessary. wink

In fact this is not the default.
pacman.conf contains the instruction

SigLevel    = Required DatabaseOptional

and does not contain any relevant instruction for the repos.

My pacman.conf is not touched in this respect.
And notice that I am not able to download .sig files for the repos, not the packages.

Offline

#214 2018-01-15 00:33:27

dapolinario
Member
From: Brasil
Registered: 2010-03-18
Posts: 57

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

Default pacman.conf -> pacman.conf


Arch Linux: The power in your hands!

Offline

#215 2018-01-15 00:48:54

Eschwartz
Trusted User/Bug Wrangler
Registered: 2014-08-08
Posts: 1,420

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

I am aware of the default quite well. wink The difference between "PackageRequired" and "Required DatabaseOptional" is that if the database .sig is available but invalid, this will be considered a fatal error. So the basic behavior defaults to much the same thing.

Making this change would help you, if the repository is lying about having a signature file, and giving you an error page that is not properly marked with an HTTP 404 error status.
Or, if Bauerbill was so broken that it tried to download .sig files and failed. Which would be weird, as Bauerbill would have to be completely broken on a conceptual level and this breakage would be the default behavior for every single Arch user, without exception. The official repos have *never* had .sig files available, and the default pacman.conf has traditionally attempted to find .sig files and forgive their total 404 absence, and anything that failed to reproduce that behavior could only do so if it (i.e. Bauerbill) was only ever used on systems and by users that had a different pacman.conf

I'd think even if Xyne didn't notice that, at least one user somewhere would. yikes

But if you're saying that that is so nevertheless, okay...

Offline

#216 2018-01-15 01:25:27

Xyne
Moderator/TU
Registered: 2008-08-03
Posts: 6,259
Website

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

Eschwartz wrote:

Or, if Bauerbill was so broken that it tried to download .sig files and failed. Which would be weird, as Bauerbill would have to be completely broken on a conceptual level and this breakage would be the default behavior for every single Arch user, without exception.

Bauerbill and Powerpill are conceptually broken on a fundamental level then. The downloading is handled by Aria2 via an intermediate metalink. If the metalink includes signature files that don't exist then Aria2c will exit with an error after the other downloads complete. I am not aware of an option to configure conditional downloads that ignore 404 errors for the signature files. It could check the exit code and verify that only optional files are missing before proceeding but a simpler solution is to just set the correct SigLevel setting for the repo. A repo that randomly offers signatures would be broken with regard to security (an attacker could simply inject an unsigned repo, and the downloader would have to deal with removing old signature files before each database refresh to prevent erroneous mismatches). Regardless of Bauerbill/Powerpill's behavior, PackageRequired is the correct SigLevel setting for the official repos and using it avoids the issue of dealing with optional downloads.

[core]
SigLevel = PackageRequired
Include = /etc/pacman.d/mirrorlist

"completely broken on a conceptual level" lol


My Arch Linux StuffForum EtiquetteCommunity Ethos - Arch is not for everyone

Offline

#217 2018-01-15 01:32:29

Eschwartz
Trusted User/Bug Wrangler
Registered: 2014-08-08
Posts: 1,420

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

So, do you automatically attempt to download the .sig files for people who use the default pacman.conf, and then fail with unrealistic error messages?

Your "simpler solution" is what I call "laziness", or "not being a proper wrapper for pacman". I'd call that pretty broken for something that intends to be a download wrapper around pacman.

If you dislike the idea of pacman providing the ability to mark signatures as optional, I encourage you to file a bugreport or raise a discussion on pacman-dev to tell everyone about how "A repo that randomly offers signatures would be broken with regard to security", rather than being unfaithful to pacman's spec. Maybe then you could fix it for everyone. wink

...

In the meantime, perhaps powerpill should, you know, document the need for non-default pacman.conf
I don't see it anywhere on the project page or the manpage.

Last edited by Eschwartz (2018-01-15 01:50:21)

Offline

#218 2018-01-15 01:57:15

Eschwartz
Trusted User/Bug Wrangler
Registered: 2014-08-08
Posts: 1,420

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

Perhaps aria2 could use an --on-download-error event hook, but it looks like it just reports the first of the failing files. So using the RPC interface to extract more details would probably be the most flexible way of getting proper statuses. Failing signature files could then be cross-referenced with the repositories whose resolved SigLevel include DatabaseOptional. Similar logic can probably be used when wrapping `pacman -U https://...`

This could also allow removing old signature files for failed downloads that correspond to successful database downloads.

Last edited by Eschwartz (2018-01-15 01:59:22)

Offline

Board footer

Powered by FluxBB