powerpill reborn: pacman wrapper for faster downloads

Lockheed · 2014-12-30 23:00:47

I think powerpill became broken with latest (pacman?) update

Traceback (most recent call last):
  File "/usr/bin/powerpill", line 812, in <module>
    sys.exit(run_main())
  File "/usr/bin/powerpill", line 805, in run_main
    return main(args)
  File "/usr/bin/powerpill", line 779, in main
    powerpill.download(pm2ml_args, dbs=True, force=(pargs['y'] > 1))
  File "/usr/bin/powerpill", line 525, in download
    pm2ml.build_download_queue(pm2ml_args, conf=self.pacman_conf)
  File "/usr/lib/python3.4/site-packages/pm2ml.py", line 621, in build_download_queue
    handle = conf.initialize_alpm()
  File "/usr/lib/python3.4/site-packages/pm2ml.py", line 136, in initialize_alpm
    h = pyalpm.Handle(self.options["RootDir"], self.options["DBPath"])
alpm.error: could not create a libalpm handle, pm_errno 18 (database is incorrect version)

raggerv8 · 2014-12-31 00:29:22

Lockheed wrote:

I think powerpill became broken with latest (pacman?) update

Traceback (most recent call last):
  File "/usr/bin/powerpill", line 812, in <module>
    sys.exit(run_main())
  File "/usr/bin/powerpill", line 805, in run_main
    return main(args)
  File "/usr/bin/powerpill", line 779, in main
    powerpill.download(pm2ml_args, dbs=True, force=(pargs['y'] > 1))
  File "/usr/bin/powerpill", line 525, in download
    pm2ml.build_download_queue(pm2ml_args, conf=self.pacman_conf)
  File "/usr/lib/python3.4/site-packages/pm2ml.py", line 621, in build_download_queue
    handle = conf.initialize_alpm()
  File "/usr/lib/python3.4/site-packages/pm2ml.py", line 136, in initialize_alpm
    h = pyalpm.Handle(self.options["RootDir"], self.options["DBPath"])
alpm.error: could not create a libalpm handle, pm_errno 18 (database is incorrect version)

Run

pacman-db-upgrade

Lockheed · 2014-12-31 07:18:18

raggerv8 wrote:

Run

pacman-db-upgrade

Did the trick. Thanks.

TheSaint · 2014-12-31 11:44:03

    powerpill-2014.12.tar.xz ... FAILED (unknown public key 1D1F0DC78F173680)
==> ERROR: One or more PGP signatures could not be verified!

The same for pm2ml.

Lockheed · 2014-12-31 11:46:11

TheSaint wrote:

    powerpill-2014.12.tar.xz ... FAILED (unknown public key 1D1F0DC78F173680)
==> ERROR: One or more PGP signatures could not be verified!

The same for pm2ml.

https://wiki.archlinux.org/index.php/ma … e_checking

karol · 2014-12-31 15:07:01

powerpill is in xyne-any unofficial repo too.

Edit: https://www.archlinux.org/people/trusted-users/#xyne + https://www.archlinux.org/news/gnupg-21 … n-keyring/

Last edited by karol (2014-12-31 15:15:49)

TheSaint · 2015-01-01 05:43:43

This doesn't fix it.

# makepkg -si --skippgpcheck

This allowed me to install.

adambot · 2015-01-02 16:36:11

TheSaint wrote:

This doesn't fix it.
# makepkg -si --skippgpcheck
This allowed me to install.

I created a .makepkg.conf with the following:

SKIPPGPCHECK=1

which allowed yaourt/other wrappers to build programs without issue

TheSaint · 2015-01-02 16:38:20

I used it once. In case will happen again I'll put it in the configuration file.

despairblue · 2015-04-08 14:18:33

@Xyne

Xyne wrote:

@Viper_Scull
You have to set the correct SigLevel in /etc/pacman.conf. The official databases are not signed so you should use "PackageRequired", e.g.
[core]
SigLevel = PackageRequired
Include = /etc/pacman.d/mirrorlist

Why wouldn't the global default option

SigLevel    = Required DatabaseOptional

make the database check optional?

Xyne · 2015-04-13 23:16:26

@despairblue
If they're optional then it will still check for them and generate 404 warnings(/errors?) when they're not found. If you know a priori that there are no database signatures then you should just disable the query.

raggerv8 · 2015-04-23 11:09:07

Heads up! Your website is down which means we can't access your repo.

Edit: It's back up!

Last edited by raggerv8 (2015-04-23 16:38:30)

raggerv8 · 2015-04-28 16:54:59

I just updated my mirros and rsync mirrors, and here is how the rsync section of my powerpill.json looks like

  "rsync": {
    "args": [
      "--no-motd",
      "--progress"
    ],
    "db only": true,
    "path": "/usr/bin/rsync",
    "servers": [
        "rsync://mirror.one.com/archlinux/$repo/os/$archi",
        "rsync://mirror.fluxent.de/archlinux/$repo/os/$arch",
        "rsync://ftp.nluug.nl/archlinux/$repo/os/$arch",
        "rsync://archlinux.honkgong.info/archlinux/$repo/os/$arch",
        "rsync://archlinux.polymorf.fr/archlinux/$repo/os/$arch"
    ]
  }

When I run

powerpill -Syy

I get this:

Status Legend:
(OK):download completed.
receiving incremental file list
rsync: change_dir "/core/os/x86_64i" (in archlinux) failed: No such file or directory (2)
rsync: change_dir "/extra/os/x86_64i" (in archlinux) failed: No such file or directory (2)
rsync: change_dir "/community/os/x86_64i" (in archlinux) failed: No such file or directory (2)
rsync: change_dir "/multilib/os/x86_64i" (in archlinux) failed: No such file or directory (2)
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1637) [Receiver=3.1.1]
receiving incremental file list

Any idea?

Xyne · 2015-04-29 22:16:07

raggerv8 wrote:

I just updated my mirros and rsync mirrors, and here is how the rsync section of my powerpill.json looks like
 
    "servers": [
        "rsync://mirror.one.com/archlinux/$repo/os/$archi",
When I run
powerpill -Syy
I get this:
rsync: change_dir "/core/os/x86_64i" (in archlinux) failed: No such file or directory (2)
...
Any idea?

There's an extra "i" at the end of your first rsync mirror ("$archi").

raggerv8 · 2015-04-30 06:10:01

Xyne wrote:

raggerv8 wrote:
I just updated my mirros and rsync mirrors, and here is how the rsync section of my powerpill.json looks like
 
    "servers": [
        "rsync://mirror.one.com/archlinux/$repo/os/$archi",
When I run
powerpill -Syy
I get this:
rsync: change_dir "/core/os/x86_64i" (in archlinux) failed: No such file or directory (2)
...
Any idea?
There's an extra "i" at the end of your first rsync mirror ("$archi").

Welp, thanks.

raggerv8 · 2015-10-02 17:01:08

Traceback (most recent call last):
  File "/usr/bin/powerpill", line 41, in <module>
    import pm2ml
ImportError: No module named 'pm2ml'

Googleing I found this, and I just updated some python packages. Does the pm2ml package in xyne repo need to be rebuild?

I just build and installed the AUR package instead of the one in the repo, and that solved this issue.

Last edited by raggerv8 (2015-10-02 23:23:07)

Xyne · 2015-10-06 19:27:17

See here.

txtsd · 2015-10-08 05:34:37

@Xyne

Something's up with pm2ml since the last update.

┌[txtsd@dungeon-of-data]─[~]                                                                              [15-10-08 10:57:26]
└─▶ powerpill -Syu                                                                                                            
Traceback (most recent call last):
  File "/usr/bin/powerpill", line 5, in <module>
    sys.exit(run_main())
  File "/usr/lib/python3.5/site-packages/Powerpill.py", line 865, in run_main
    return main(args)
  File "/usr/lib/python3.5/site-packages/Powerpill.py", line 838, in main
    pacman_conf = get_pacman_conf(pargs, powerpill_conf)
  File "/usr/lib/python3.5/site-packages/Powerpill.py", line 320, in get_pacman_conf
    pacman_conf = pm2ml.PacmanConfig(pargs['pacman_config'])
  File "/usr/lib/python3.5/site-packages/pm2ml.py", line 95, in __init__
    self.load_from_file(conf)
  File "/usr/lib/python3.5/site-packages/pm2ml.py", line 105, in load_from_file
    self[section].setdefault(key, []).append(value)
AttributeError: 'set' object has no attribute 'append'

Xyne · 2015-10-08 15:02:18

It should be fixed with todays release of pm2ml.

txtsd · 2015-10-08 15:08:16

Xyne wrote:

It should be fixed with todays release of pm2ml.

Now this happens

...
Download Results:
gid   |stat|avg speed  |path/URI
======+====+===========+=======================================================
dda484|OK  |       0B/s|/var/lib/pacman/sync/core.db
a0633b|OK  |       0B/s|/var/lib/pacman/sync/infinality-bundle.db.sig
f812d4|OK  |       0B/s|/var/lib/pacman/sync/infinality-bundle.db
f6317e|OK  |       0B/s|/var/lib/pacman/sync/infinality-bundle-multilib.db
2ffd39|OK  |       0B/s|/var/lib/pacman/sync/multilib.db
2e375c|OK  |       0B/s|/var/lib/pacman/sync/infinality-bundle-multilib.db.sig
d9be36|OK  |       0B/s|/var/lib/pacman/sync/community.db
ea05ea|ERR |       0B/s|/var/lib/pacman/sync/repo-ck.db.sig
554a33|OK  |       0B/s|/var/lib/pacman/sync/repo-ck.db
851494|OK  |   197KiB/s|/var/lib/pacman/sync/extra.db

Status Legend:
(OK):download completed.(ERR):error occurred.

aria2 will resume download if the transfer is restarted.
If there are any errors, then see the log file. See '-l' option in help/man page for details.
Traceback (most recent call last):
  File "/usr/bin/powerpill", line 5, in <module>
    sys.exit(run_main())
  File "/usr/lib/python3.5/site-packages/Powerpill.py", line 865, in run_main
    return main(args)
  File "/usr/lib/python3.5/site-packages/Powerpill.py", line 856, in main
    download_packages(powerpill)
  File "/usr/lib/python3.5/site-packages/Powerpill.py", line 824, in download_packages
    powerpill.download(pm2ml_args)
  File "/usr/lib/python3.5/site-packages/Powerpill.py", line 563, in download
    pm2ml.resolve_targets_from_arguments(handle, self.pacman_conf, pm2ml_pargs)
  File "/usr/lib/python3.5/site-packages/pm2ml.py", line 1087, in resolve_targets_from_arguments
    only_needed=pargs.needed,
  File "/usr/lib/python3.5/site-packages/pm2ml.py", line 985, in resolve_targets
    ignored = set(ignored) | conf.options['IgnorePkg']
TypeError: unsupported operand type(s) for |: 'set' and 'list'

Xyne · 2015-10-08 15:38:02

It should be degoofed now.

txtsd · 2015-10-08 15:41:57

Xyne wrote:

It should be degoofed now.

Seems to be working fine now

txtsd · 2015-10-13 18:36:17

┌[txtsd@dungeon-of-data]─[~] [1]                                                                           [15-10-14 0:03:37]
└─▶ powerpill --powerpill-clean                                                                                               
Traceback (most recent call last):
  File "/usr/bin/powerpill", line 5, in <module>
    sys.exit(run_main())
  File "/usr/lib/python3.5/site-packages/Powerpill.py", line 865, in run_main
    return main(args)
  File "/usr/lib/python3.5/site-packages/Powerpill.py", line 843, in main
    clean(get_cleaning_targets(pacman_conf))
  File "/usr/lib/python3.5/site-packages/Powerpill.py", line 790, in clean
    lock = XCPF.Lockfile(lockfile)
TypeError: __init__() missing 1 required positional argument: 'name'

Xyne · 2015-10-18 17:48:49

Sorry for the delay. It should be fixed now. Thanks!

txtsd · 2015-10-18 19:26:38

Xyne wrote:

Sorry for the delay. It should be fixed now. Thanks!

Thanks. It works now.

Is this expected behavior though. Shouldn't it ask for sudo?

┌[txtsd@dungeon-of-data]─[~]                                                                               [15-10-19 0:54:21]
└─▶ powerpill --powerpill-clean                                                                                               
ERROR: <class 'XCPF.XcpfError'>: failed to create cache lock file (/var/lib/pacman/sync/db.lck) [[Errno 13] Permission denied: '/var/lib/pacman/sync/db.lck'] [[Errno 13] Permission denied: '/var/lib/pacman/sync/db.lck']

EDIT: It isn't using aria2c anymore. Output is similar to pacman.

Last edited by txtsd (2015-10-19 04:23:20)

Arch Linux

#151 2014-12-30 23:00:47

Re: powerpill reborn: pacman wrapper for faster downloads

#152 2014-12-31 00:29:22

Re: powerpill reborn: pacman wrapper for faster downloads

#153 2014-12-31 07:18:18

Re: powerpill reborn: pacman wrapper for faster downloads

#154 2014-12-31 11:44:03

Re: powerpill reborn: pacman wrapper for faster downloads

#155 2014-12-31 11:46:11

Re: powerpill reborn: pacman wrapper for faster downloads

#156 2014-12-31 15:07:01

Re: powerpill reborn: pacman wrapper for faster downloads

#157 2015-01-01 05:43:43

Re: powerpill reborn: pacman wrapper for faster downloads

#158 2015-01-02 16:36:11

Re: powerpill reborn: pacman wrapper for faster downloads

#159 2015-01-02 16:38:20

Re: powerpill reborn: pacman wrapper for faster downloads

#160 2015-04-08 14:18:33

Re: powerpill reborn: pacman wrapper for faster downloads

#161 2015-04-13 23:16:26

Re: powerpill reborn: pacman wrapper for faster downloads

#162 2015-04-23 11:09:07

Re: powerpill reborn: pacman wrapper for faster downloads

#163 2015-04-28 16:54:59

Re: powerpill reborn: pacman wrapper for faster downloads

#164 2015-04-29 22:16:07

Re: powerpill reborn: pacman wrapper for faster downloads

#165 2015-04-30 06:10:01

Re: powerpill reborn: pacman wrapper for faster downloads

#166 2015-10-02 17:01:08

Re: powerpill reborn: pacman wrapper for faster downloads

#167 2015-10-06 19:27:17

Re: powerpill reborn: pacman wrapper for faster downloads

#168 2015-10-08 05:34:37

Re: powerpill reborn: pacman wrapper for faster downloads

#169 2015-10-08 15:02:18

Re: powerpill reborn: pacman wrapper for faster downloads

#170 2015-10-08 15:08:16

Re: powerpill reborn: pacman wrapper for faster downloads

#171 2015-10-08 15:38:02

Re: powerpill reborn: pacman wrapper for faster downloads

#172 2015-10-08 15:41:57

Re: powerpill reborn: pacman wrapper for faster downloads

#173 2015-10-13 18:36:17

Re: powerpill reborn: pacman wrapper for faster downloads

#174 2015-10-18 17:48:49

Re: powerpill reborn: pacman wrapper for faster downloads

#175 2015-10-18 19:26:38

Re: powerpill reborn: pacman wrapper for faster downloads

Board footer