Powerpill - A wrapper and download accelerator for Pacman

zatricky · 2009-09-01 05:21:29

Its certainly not that I don't want to type sudo - its more a case that in principle I wouldn't want the entirety of powerpill to run as root. Even if it has the facility to "self-promote" to root via sudo.

In this case I feel its inconsistent that powerpill *does* handhold but only some of the time.

If time permits, I'll look into the code and submit a patch to your review.

ozeta · 2009-09-03 07:02:15

hi, i'm having this kind of error with all packages:

[root@dolphin ozeta/]# powerpill -S anypackage
:: The following packages will be downloaded:
  [extra]                                    
    afterstep                                
:: Number of Packages: 1                     
:: Total Download Size: 12.82 MiB            
:: Total Installed Size: 31.95 MiB           
:: Proceed with download? [Y/n]              
aria2: 2009-09-03 08:59:09.062646 ERROR - CUID#8 - Download aborted. URI=ftp://ftp.belnet.be/mirror/archlinux.org/extra/os/x86_64/anypackage-x86_64.pkg.tar.gz                                                                                     
 aria2: Exception: [AbstractCommand.cc:195] URI=ftp://ftp.belnet.be/mirror/archlinux.org/extra/os/x86_64/anypackage-x86_64.pkg.tar.gz                                                                                                               
aria2:   -> [FtpNegotiationCommand.cc:196] The response status is not successful. status=530                                 
aria2: 2009-09-03 08:59:09.064656 ERROR - CUID#10 - Download aborted. URI=ftp://ftp.belnet.be/mirror/archlinux.org/extra/os/x86_64/anypackage-x86_64.pkg.tar.gz                                                                                    
aria2: Exception: [AbstractCommand.cc:195] URI=ftp://ftp.belnet.be/mirror/archlinux.org/extra/os/x86_64/anypackage-x86_64.pkg.tar.gz
 aria2:   -> [FtpNegotiationCommand.cc:196] The response status is not successful. status=530
aria2: 2009-09-03 08:59:11.838710 ERROR - CUID#20 - Download aborted. URI=ftp://ftp.belnet.be/mirror/archlinux.org/extra/os/x86_64/anypackage-x86_64.pkg.tar.gz
progress: 0/1 pkgs  1.21 MiB/12.82 MiB (9%) 602.70 kiB/s  ETA: 19 s 
aria2: Exception: [AbstractCommand.cc:195] URI=ftp://ftp.belnet.be/mirror/archlinux.org/extra/os/x86_64/anypackage-x86_64.pkg.tar.gz
progress: 0/1 pkgs  1.21 MiB/12.82 MiB (9%) 602.70 kiB/s  ETA: 19 s 
aria2:   -> [FtpNegotiationCommand.cc:196] The response status is not successful. status=530

anyway, using pacman goes fine.

what's going on?

EDIT:

ok, don't think about it... the problem is belnet.be having obliviously troubles ..:lol:

Last edited by ozeta (2009-09-03 07:12:35)

Xyne · 2009-09-03 08:05:00

How many mirrors are you using with powerpill? From the output it seems that you are only using 1, which is highly unrecommended.

I should probably change the default reflector settings for powerpill.

ozeta · 2009-09-04 17:56:42

hi, i'm actually using 3 differrent mirrors (uk, be, it + kde-svn), however powerpill continues having this king of trouble, over 2 different pcs and over the 50-70% of packages

Xyne · 2009-09-05 07:33:12

You're main mirror is probably out of sync with the rest of the mirrors. Check its status on GerBra's mirrorcheck page and switch to something that's in sync if it isn't already. Of course you could also use reflector to do that too.

reflector -l 20 -f 5

will find the 5 fastest mirrors among the 20 most up-to-date.

After that , add this line to the options section of powerpill's configuration file:

Reflect = -l 45

Powerpill should have access to as many mirrors as the maximum number of concurrent downloads, which is 45 by default. Take a look through the configuration file and try tweaking different things if you've having problems. I would recommend removing any servers which are consistently out of sync with your main mirror.

ozeta · 2009-09-08 16:11:04

hi, i updated powerpill conf and i don't have more problems with core/extra/community mirrors.

but i still have the same problem with the repo of kde subversion, that has only one mirror, that is http://pkg.eth-os.org/kde (here the 3d http://bbs.archlinux.org/viewtopic.php?id=44507&p=1 ).

how we can fix this?

am i the only with the same problem on eth-os repo?

slightlystoopid · 2009-09-18 14:05:12

it would appear that powerpill is ignoring IgnorePkg

$ sudo powerpill -Su
:: The following packages will be downloaded:
  [extra]
    audacious audacious-plugins
:: Number of Packages: 2
:: Total Download Size: 3.23 MiB
:: Total Installed Size: 10.50 MiB
:: Proceed with download? [Y/n] n
$ sudo pacman -Su
:: Starting full system upgrade...
warning: audacious: ignoring package upgrade (2.0.1-1 => 2.1-1)
warning: audacious-plugins: ignoring package upgrade (2.0.1-1 => 2.1-1)
 local database is up to date

Xyne · 2009-09-18 21:45:42

@slightlystoopid
Thanks for pointing that out.
I started using the output of "pacman -Qu" again to get the list of upgradable packages after the last pacman update because it now prints out a simple list. I used to use the old output but the code to parse it was ugly so I wrote my own code to get a list of upgradable packages. When I switched back to using pacman's output, I didn't check if it displayed ignored packages because it never did before. It seems that's a new "feature".

Anyway, I've updated the code to ignore packages again. It should work with perl-xyne-arch>=0.75.

@ozeta
The next time that you notice an update from http://pkg.eth-os.org/kde, post the output of "powerpill -Su --get-metalink". I suspect that the problem lies with aria2 and not powerpill itself. It might be fixable with some connection settings though.

greenfish · 2009-09-27 12:27:32

Xyne Thank you so much for your powerpill application

sr · 2009-10-12 10:35:32

First of all, thanks for powerpill, Xyne - it's a great little program!

Does anyone else see the recent aria2 update breaking powerpill, apparently because --retry-wait is missing?

:: Proceed with download? [Y/n]
--> Retrieving mirrorlist with reflector...
--> Appending 45 server(s) to the mirrorlists of the following repos: community core extra
/usr/bin/aria2c: unrecognized option '--retry-wait=2'
Exception: [OptionParser.cc:149] Failed to parse command-line options.
aria2: Usage: aria2c [OPTIONS] [URL | TORRENT_FILE | METALINK_FILE]..
(and so on)

I have, on a standard 64bit arch install:

~ % pacman -Qs aria2
local/aria2 1.6.2-1
Download utility that supports HTTP(S), FTP, BitTorrent, and Metalink
local/powerpill 16.1-2
A wrapper for pacman that speeds up package retrieval by using aria2c for
concurrent/segmented downloads.

mxforce · 2009-10-12 10:51:49

sr wrote:

Does anyone else see the recent aria2 update breaking powerpill, apparently because --retry-wait is missing?

Same problem here, same aria2 and powerpill version on 64bit.

insanemal · 2009-10-12 12:03:21

Why didn't i find this like 30 mins ago.... :'(
Going to look for AUR package of aria2c a nice git one or something and try it...

EDIT: :'( there are no aur packages for it

Last edited by insanemal (2009-10-12 12:07:34)

sr · 2009-10-12 13:41:15

The real problem (such as it is) is that aria2 removed this particular setting in 1.6.0:

· The --retry-wait option was removed because it doesn't work properly under the architecture.

We're seeing this just now, because of the update from 1.5.x

Edit: removing this option from the relevant file in perl-xyne-arch still errors out, this time because of the -M option. I have no idea how to fix that

Last edited by sr (2009-10-12 14:03:29)

greenfish · 2009-10-12 16:14:13

lazy question: how does one prevent powerpill from querying you after you've downloaded the package? Example I wish to download "feh" and sure enough powerpill works it's magic but after the packages are saved to your system, powerpill asks you if you wish to install feh to your system. How do I make it so powerpill downloads AND installs feh at the same time without asking me after the packages have been downloaded?

Thank You

Xyne · 2009-10-12 17:40:40

I'm looking into the aria2 problem right now. I hadn't updated to the latest version yet because my paconky list didn't show anything new. Apparently there's a bug in that too (need to rewrite that in Perl).

@greenfish
You could use the --noconfirm option. What's actually happening is that powerpill is just downloading the packages and then invoking pacman, which is why you get asked twice. I think pacman asks you to both confirm the download and then confirm the installation too though.

*edit*
I've removed the "--retry-wait" option. The latest version of aria2c no longer supports piping metalink files so I've worked around that with a temp file for now. I've submitted a bug on their bugtracker so hopefully they will re-implement piping.

You can grab the fixed version from my site if you don't want to wait for your mirror to sync.

Last edited by Xyne (2009-10-12 18:40:38)

insanemal · 2009-10-12 22:23:19

You sir, are a king!
This is the greatest news!

sr · 2009-10-13 03:52:24

@Xyne: thank you for the quick fix

Rulatir · 2009-10-14 22:03:49

Xyne wrote:

You can grab the fixed version from my site if you don't want to wait for your mirror to sync.

Grab? How?

Do you mean xyne-any repo? That repo has 16.1-2 which is the same as in community, and in it still fails to use aria2 because of the --retry-wait problem.

sr · 2009-10-15 03:49:22

This package has the fix:

http://xyne.archlinux.ca/info/perl-xyne-arch

fwiw, I believe the mirrors should be updated by now, I upgraded, no issues, some hours ago. The powerpill package is more or less a commandline wrapper around this one.

hamo · 2009-10-24 12:32:59

I have a problem.
I have the build-in reflector on and it worked all well before but from this morning on,It doesnt work.It always appends 0 mirror....Could you help me? Sorry for my poor English...

Xyne · 2009-10-24 15:12:55

It seems that something has changed. I'll try to figure out what and update the reflector code.

*edit*
GerBra's mirrorcheck page now requires the https protocol (no idea why).

I've updated perl-xyne-arch and made perl-crypt-ssleay an optional dependency for reflector support (e.g. for powerpill).
I've also updated reflector which of course now depends on perl-crypt-ssleay.

You can either update directly from my site or wait for the repos to synchronize.

I'll contact GerBra to find out why the protocol was changed.

Last edited by Xyne (2009-10-24 15:59:40)

MindTooth · 2009-10-24 20:04:59

Thanks for the update Frustrating when I couldn't update mirrorlist with Reflector.

Birger

helpvampire · 2009-11-07 21:16:47

Sometimes when I install stuff with powerpill it downloads all the files and then stops and does not actually install them.

Xyne · 2009-11-07 21:27:13

helpvampire wrote:

Sometimes when I install stuff with powerpill it downloads all the files and then stops and does not actually install them.

Does it display any error messages when that happens?
Do you have to re-download the packages or does it skip directly to the installation process when you run it again?
What changes have you made to the default configuration file?

helpvampire · 2009-11-07 21:55:21

It displays no error messages; the download just gets to 100% and then it stops.

It skips directly to the installation process when I run it again.

I have made no changes to the configuration file.

Last edited by helpvampire (2009-11-07 22:11:08)

Arch Linux

#276 2009-09-01 05:21:29

Re: Powerpill - A wrapper and download accelerator for Pacman

#277 2009-09-03 07:02:15

Re: Powerpill - A wrapper and download accelerator for Pacman

#278 2009-09-03 08:05:00

Re: Powerpill - A wrapper and download accelerator for Pacman

#279 2009-09-04 17:56:42

Re: Powerpill - A wrapper and download accelerator for Pacman

#280 2009-09-05 07:33:12

Re: Powerpill - A wrapper and download accelerator for Pacman

#281 2009-09-08 16:11:04

Re: Powerpill - A wrapper and download accelerator for Pacman

#282 2009-09-18 14:05:12

Re: Powerpill - A wrapper and download accelerator for Pacman

#283 2009-09-18 21:45:42

Re: Powerpill - A wrapper and download accelerator for Pacman

#284 2009-09-27 12:27:32

Re: Powerpill - A wrapper and download accelerator for Pacman

#285 2009-10-12 10:35:32

Re: Powerpill - A wrapper and download accelerator for Pacman

#286 2009-10-12 10:51:49

Re: Powerpill - A wrapper and download accelerator for Pacman

#287 2009-10-12 12:03:21

Re: Powerpill - A wrapper and download accelerator for Pacman

#288 2009-10-12 13:41:15

Re: Powerpill - A wrapper and download accelerator for Pacman

#289 2009-10-12 16:14:13

Re: Powerpill - A wrapper and download accelerator for Pacman

#290 2009-10-12 17:40:40

Re: Powerpill - A wrapper and download accelerator for Pacman

#291 2009-10-12 22:23:19

Re: Powerpill - A wrapper and download accelerator for Pacman

#292 2009-10-13 03:52:24

Re: Powerpill - A wrapper and download accelerator for Pacman

#293 2009-10-14 22:03:49

Re: Powerpill - A wrapper and download accelerator for Pacman

#294 2009-10-15 03:49:22

Re: Powerpill - A wrapper and download accelerator for Pacman

#295 2009-10-24 12:32:59

Re: Powerpill - A wrapper and download accelerator for Pacman

#296 2009-10-24 15:12:55

Re: Powerpill - A wrapper and download accelerator for Pacman

#297 2009-10-24 20:04:59

Re: Powerpill - A wrapper and download accelerator for Pacman

#298 2009-11-07 21:16:47

Re: Powerpill - A wrapper and download accelerator for Pacman

#299 2009-11-07 21:27:13

Re: Powerpill - A wrapper and download accelerator for Pacman

#300 2009-11-07 21:55:21

Re: Powerpill - A wrapper and download accelerator for Pacman

Board footer