powerpill reborn: pacman wrapper for faster downloads

raggerv8 · 2015-12-05 12:01:04

12/05 12:59:36 [ERROR] Checksum error detected. file=/var/cache/pacman/pkg/pm2ml-2015.12-1-any.pkg.tar.xz

Status Legend:
(OK):download completed.(ERR):error occurred.

aria2 will resume download if the transfer is restarted.
If there are any errors, then see the log file. See '-l' option in help/man page for details.
PowerpillError: aria2c exited with 32

andav · 2015-12-05 16:16:00

i have similar error as the user above me.
i upgraded powerpill alone and after it succeeded, when i run: powerpill -Syu, i get this:

Traceback (most recent call last):
File "/usr/lib/python3.5/runpy.py", line 170, in _run_module_as_main
"__main__", mod_spec)
File "/usr/lib/python3.5/runpy.py", line 85, in _run_code
exec(code, run_globals)
File "/usr/lib/python3.5/site-packages/Powerpill.py", line 931, in <module>
sys.exit(run_main())
File "/usr/lib/python3.5/site-packages/Powerpill.py", line 922, in run_main
return main(args)
File "/usr/lib/python3.5/site-packages/Powerpill.py", line 884, in main
configure_logging(pargs)
File "/usr/lib/python3.5/site-packages/Powerpill.py", line 873, in configure_logging
XCPF.configure_logging(level=level)
AttributeError: module 'XCPF' has no attribute 'configure_logging'

now even when i run: pacman -Syu, i get this error:

error: pm2ml: signature from "Xyne. (key #3) <xyne@archlinux.ca>" is invalid
:: File /var/cache/pacman/pkg/pm2ml-2015.12-1-any.pkg.tar.xz is corrupted (invalid or corrupted package (PGP signature)).
Do you want to delete it? [Y/n]

...

Xyne · 2015-12-05 17:29:04

I have recreated all signatures and databases and am currently uploading them. That should solve the pm2ml error.

For the XCPF error, make sure that you have the latest version of all of powerpill's dependencies. I've made a lot of changes in the last few days.

andav · 2015-12-05 18:01:48

Xyne wrote:

I have recreated all signatures and databases and am currently uploading them. That should solve the pm2ml error.
For the XCPF error, make sure that you have the latest version of all of powerpill's dependencies. I've made a lot of changes in the last few days.

everything is working now.
thanks! :-)

txtsd · 2015-12-06 10:21:36

Xyne wrote:

Sorry, I read through your posts too quickly and missed the "unofficial" keyword. Maybe those unofficial repos are on servers that fail to correctly report the last modification time of the remote file and thus powerpill (via aria2c) fails to detect the update. Does "pacman -Syu" (without the additional "-y") work?
If yes, then try playing around with the aria2 options in the powerpill configuration file.
If no, then just use "powerpill -Syyu". It should work.

It happened again.
Neither

pacman -Syu

nor

powerpill -Syyu

make it work.

Edit: Nevermind. Got it to work by getting rid of the Repo specific SigLevels, and using this as global

SigLevel    = PackageRequired DatabaseOptional TrustedOnly
LocalFileSigLevel = Optional

Last edited by txtsd (2015-12-06 12:42:50)

Xyne · 2015-12-06 15:56:39

I should mentioned this here too: for anyone still missing bauerbill, it's back.

mauritiusdadd · 2015-12-07 14:33:09

Hi,
powerpill fails with the following error when trying to do a full system upgrade:

# powerpill -Syu
Traceback (most recent call last):
  File "/usr/lib/python3.5/runpy.py", line 170, in _run_module_as_main
    "__main__", mod_spec)
  File "/usr/lib/python3.5/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/usr/lib/python3.5/site-packages/Powerpill.py", line 914, in <module>
    sys.exit(run_main())
  File "/usr/lib/python3.5/site-packages/Powerpill.py", line 905, in run_main
    return main(args)
  File "/usr/lib/python3.5/site-packages/Powerpill.py", line 884, in main
    refresh_databases(powerpill)
  File "/usr/lib/python3.5/site-packages/Powerpill.py", line 828, in refresh_databases
    powerpill.download(pm2ml_args, dbs=True, force=(powerpill.pargs['refresh'] > 1))
  File "/usr/lib/python3.5/site-packages/Powerpill.py", line 629, in download
    XCGF.copy_file_and_maybe_sig(local_path, output_path, sig=sigs)
  File "/usr/lib/python3.5/site-packages/XCGF.py", line 246, in copy_file_and_maybe_sig
    a = from_path + SIG_EXT
NameError: name 'SIG_EXT' is not defined

it seems that the variable SIG_EXT is not defined/imported in usr/lib/python3.5/site-packages/XCGF.py

Xyne · 2015-12-07 21:21:33

Fixed, thanks.

mauritiusdadd · 2015-12-22 16:31:33

I got the following error:

$powerpill -Syu linux-header linux-ck-broadwell-headers 
Traceback (most recent call last):
  File "/usr/lib/python3.5/runpy.py", line 170, in _run_module_as_main
    "__main__", mod_spec)
  File "/usr/lib/python3.5/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/usr/lib/python3.5/site-packages/Powerpill.py", line 36, in <module>
    import pm2ml
  File "/usr/lib/python3.5/site-packages/pm2ml.py", line 33, in <module>
    import XCPF
  File "/usr/lib/python3.5/site-packages/XCPF.py", line 35, in <module>
    import xdg.BaseDirectory
ImportError: No module named 'xdg'

The issue can be solved by installing python-xdg, maybe you should add it to the package depencies.

Xyne · 2015-12-22 17:04:12

Sorry, I thought I had added it already. Fixed.

deltharac · 2015-12-31 09:44:56

~|master⚡ ⇒ sudo powerpill -Syu
Traceback (most recent call last):
  File "/usr/bin/powerpill", line 5, in <module>
    sys.exit(run_main())
  File "/usr/lib/python3.5/site-packages/Powerpill.py", line 865, in run_main
    return main(args)
  File "/usr/lib/python3.5/site-packages/Powerpill.py", line 830, in main
    pargs = parse_args(args)
  File "/usr/lib/python3.5/site-packages/Powerpill.py", line 138, in parse_args
    argq = deque(XCPF.expand_args(args))
AttributeError: module 'XCPF' has no attribute 'expand_args'

All dependencies are up to date. Getting alot of XCPF attribute errors.

Xyne · 2016-01-02 21:54:22

Update Powerpill. Line 138 in the current version is in the expand_recognized_pacman_short_options function.

txtsd · 2016-01-07 14:15:49

powerpill -U herpderp.tar.xz

If there are dependencies, they are downloaded via pacman, not the configured pacman client like aria2c.

Xyne · 2016-01-09 22:18:48

txtsd wrote:

powerpill -U herpderp.tar.xz
If there are dependencies, they are downloaded via pacman, not the configured pacman client like aria2c.

Noted, but that will have to wait until I refactor argument parsing which is a mess at the moment.

pablox · 2016-02-13 00:53:18

When updating the databases (powerpill -Syy), I get a lot of:

receiving incremental file list
rsync: link_stat "/core/os/x86_64/core.db.sig" (in archlinux) failed: No such file or directory (2)
rsync: link_stat "/extra/os/x86_64/extra.db.sig" (in archlinux) failed: No such file or directory (2)
rsync: link_stat "/community/os/x86_64/community.db.sig" (in archlinux) failed: No such file or directory (2)
rsync: link_stat "/multilib/os/x86_64/multilib.db.sig" (in archlinux) failed: No such file or directory (2)
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1650) [generator=3.1.2]

I've tried to use DatabaseNever in pacman.conf, but the problem persists. What is happening?

Xyne · 2016-02-14 06:21:31

There was a bug in pm2ml that ignored DatabaseNever. It should work now. Please update and test it.

Serin · 2016-03-03 18:00:33

I have the same problem.. updated pm2ml and I'm still getting those errors :<

Xyne · 2016-03-04 23:25:06

I just checked DatabaseNever and it works as expected. Please post your pacman.conf and the output of "pm2ml -ys".

Lone_Wolf · 2016-03-14 14:02:04

Just installed & configured powerpill (my internet connection was upgraded from 17 Mibps to 50 Mibps ) and like it sofar.

I had a minor issue with adding rsync servers :
They needed double quotes around them and seperated by comma's .
Maybe you could add a small example for rsync servers field to powerpill.json man page ?

Xyne · 2016-03-17 00:59:46

Lone_Wolf wrote:

Maybe you could add a small example for rsync servers field to powerpill.json man page ?

done

Thanks for the general feedback too. ~3x speedup

Y guy · 2016-03-25 23:01:29

I used powerpill and bauerbill with a modified Yaourt-gui

tricky install, but after all it worked flawlessly :-)

dapolinario · 2016-04-04 18:03:57

Error using powerpill 2016.4.4-1 (using repository xyne-x86_64):

$ sudo powerpill -Syu
Traceback (most recent call last):
  File "/usr/lib/python3.5/runpy.py", line 170, in _run_module_as_main
    "__main__", mod_spec)
  File "/usr/lib/python3.5/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/usr/lib/python3.5/site-packages/Powerpill.py", line 974, in <module>
    sys.exit(run_main())
  File "/usr/lib/python3.5/site-packages/Powerpill.py", line 965, in run_main
    return main(args)
  File "/usr/lib/python3.5/site-packages/Powerpill.py", line 944, in main
    powerpill.refresh_databases()
  File "/usr/lib/python3.5/site-packages/Powerpill.py", line 782, in refresh_databases
    self.download(pm2ml_args, dbs=True, force=(self.pargs['refresh'] > 1))
  File "/usr/lib/python3.5/site-packages/Powerpill.py", line 582, in download
    self.pm2ml.resolve_targets_from_arguments(pm2ml_pargs)
  File "/usr/lib/python3.5/site-packages/pm2ml.py", line 583, in resolve_targets_from_arguments
    only_needed=pargs.needed,
  File "/usr/lib/python3.5/site-packages/pm2ml.py", line 508, in resolve_targets
    ignored=ignored
  File "/usr/lib/python3.5/site-packages/pm2ml.py", line 331, in partition_pkgs
    aur_pkgs = AUR_AurPkg.AurPkgSet()
AttributeError: 'NoneType' object has no attribute 'AurPkgSet'

Xyne · 2016-04-04 22:57:25

The errors should be fixed. Please update pm2ml and python3-xcpf and let me know if it works.

dapolinario · 2016-04-05 00:03:47

After upgrade, new error:

$ sudo powerpill -Syu
[sudo] senha para dapolinario: 
Traceback (most recent call last):
  File "/usr/lib/python3.5/runpy.py", line 170, in _run_module_as_main
    "__main__", mod_spec)
  File "/usr/lib/python3.5/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/usr/lib/python3.5/site-packages/Powerpill.py", line 36, in <module>
    import pm2ml
  File "/usr/lib/python3.5/site-packages/pm2ml.py", line 34, in <module>
    import XCPF.ArchPkg
  File "/usr/lib/python3.5/site-packages/XCPF/ArchPkg.py", line 180
    'name' : lambda x: raise error,
                           ^
SyntaxError: invalid syntax

Xyne · 2016-04-05 00:09:58

Fixed.

Arch Linux

#201 2015-12-05 12:01:04

Re: powerpill reborn: pacman wrapper for faster downloads

#202 2015-12-05 16:16:00

Re: powerpill reborn: pacman wrapper for faster downloads

#203 2015-12-05 17:29:04

Re: powerpill reborn: pacman wrapper for faster downloads

#204 2015-12-05 18:01:48

Re: powerpill reborn: pacman wrapper for faster downloads

#205 2015-12-06 10:21:36

Re: powerpill reborn: pacman wrapper for faster downloads

#206 2015-12-06 15:56:39

Re: powerpill reborn: pacman wrapper for faster downloads

#207 2015-12-07 14:33:09

Re: powerpill reborn: pacman wrapper for faster downloads

#208 2015-12-07 21:21:33

Re: powerpill reborn: pacman wrapper for faster downloads

#209 2015-12-22 16:31:33

Re: powerpill reborn: pacman wrapper for faster downloads

#210 2015-12-22 17:04:12

Re: powerpill reborn: pacman wrapper for faster downloads

#211 2015-12-31 09:44:56

Re: powerpill reborn: pacman wrapper for faster downloads

#212 2016-01-02 21:54:22

Re: powerpill reborn: pacman wrapper for faster downloads

#213 2016-01-07 14:15:49

Re: powerpill reborn: pacman wrapper for faster downloads

#214 2016-01-09 22:18:48

Re: powerpill reborn: pacman wrapper for faster downloads

#215 2016-02-13 00:53:18

Re: powerpill reborn: pacman wrapper for faster downloads

#216 2016-02-14 06:21:31

Re: powerpill reborn: pacman wrapper for faster downloads

#217 2016-03-03 18:00:33

Re: powerpill reborn: pacman wrapper for faster downloads

#218 2016-03-04 23:25:06

Re: powerpill reborn: pacman wrapper for faster downloads

#219 2016-03-14 14:02:04

Re: powerpill reborn: pacman wrapper for faster downloads

#220 2016-03-17 00:59:46

Re: powerpill reborn: pacman wrapper for faster downloads

#221 2016-03-25 23:01:29

Re: powerpill reborn: pacman wrapper for faster downloads

#222 2016-04-04 18:03:57

Re: powerpill reborn: pacman wrapper for faster downloads

#223 2016-04-04 22:57:25

Re: powerpill reborn: pacman wrapper for faster downloads

#224 2016-04-05 00:03:47

Re: powerpill reborn: pacman wrapper for faster downloads

#225 2016-04-05 00:09:58

Re: powerpill reborn: pacman wrapper for faster downloads

Board footer