Powerpill - A wrapper and download accelerator for Pacman

allbluedream · 2010-01-24 03:23:55

Do you mean that I should save the metalink xml into a file named dl.metalink? I did this and aria2 was not able to download anything.

Xyne · 2010-01-24 03:46:33

So you saved the metalink to "dl.metalink", then ran "aria2c -M dl.metalink" and it didn't work?

Did it spit out any errors? Did you try playing around with different aria2c options from "man aria2c"?

Other than suggesting different options to play with, there isn't anything that I can do because this is entirely an aria2c issue and has nothing to do with the powerpill code.

allbluedream · 2010-01-28 10:58:12

Aria2c is not able to download even if I give it no option at all. Wget can download the same file without encountering any problems. So the good news is that there is no problem with powerpill... Too bad for me that I have to look somewhere else for a solution...

Xyne · 2010-01-28 11:29:09

Sorry that I couldn't help.

I would try the following before giving up completely if I were you:
*)double-check different aria2c options from the man page
*) (re)move any aria2c configuration files
*) re-install aria2
*) build aria2 using the ABS PKGBUILD
*) post a bug/support request on aria2c's sourceforge page (the main devs seems friendly and helpful)

allbluedream · 2010-01-31 02:30:37

Asked on the aria2 forum and it helped:
pending the option "--async-dns=false" and aria2 will work again I'm still not sure what happened to my machine in the first place though.

MindTooth · 2010-02-03 13:39:11

Can't seem to find any info regarding the latest Powerpill update, but doesn't it support multiple downloads at once anymore? Is this now a Bauerbill feature only?

Xyne · 2010-02-03 17:00:17

Of course it still supports multiple downloads. What would be the point of Powerpill if it didn't?

Can you maybe explain what the problem is?

Also, check the output of the metalink by passing the "--get-metalink" option.

*edit*
If you're asking this because of the "successfully downloaed <pkg>" messages that it spits out "one by one", then all you need to do is look at the status line that keeps changing. It will contain information about the currently show download, including how many connections it has (CN:x), and will also say how many other downloads are in progress (y more ...), the other y of which may also have multiple connections open for parallel downloading.

Last edited by Xyne (2010-02-03 17:06:02)

MindTooth · 2010-02-05 11:26:26

I guess that solves it

MethoDiKaL · 2010-02-06 02:44:06

thanks so much for this. i used it to get KDE and it flew. haha. i didnt like KDE so i went for XCFE, but the powerpill is definitely the sh*t. thanks

schivmeister · 2010-02-27 02:04:11

Hello Xyne

I believe we shouldn't let a package be updated if it's newer on the local system, i.e the expected behaviour and output should be something similar to:

warning: $pkgname: local ($pkgver) is newer than $repo ($pkgver)

I also miss version strings in the update output, but that's just me (maybe a pacman feature request; to have -q apply on -u as well so those who don't like it can suppress) =p

And I'd love you extra well if you could somehow manage to wrap aria's output so that it gives me package name (and version), speed and progress on one line a la pacman+libfetch. A --verbose could switch off the wrapper. This may be _impossible_ (and not simple/elegant at all) because I haven't checked it against the sanity scale yet.

And finally, an opinion from the hole:

--> Reflecting... retrieved 0 mirrors.

May best be left suppressed if there is no support (perl-crypt-ssleay) for it installed.

Nevertheless, Powerpill is saving me from a terrible network state (speeds sub 20KB) that urgently needs some acceleration until I am back home not so soon. So, kudos!

Last edited by schivmeister (2010-02-27 02:21:44)

Xyne · 2010-02-27 14:51:27

It doesn't update a package if the local version is newer unless the force flag has been set. It does display the warning messages during the upgrade because the actual installation is handled by pacman. The only possible bauerbill issue would be if bauerbill downloads an older version that is then ignored by pacman during the upgrade.

I'm not sure what you mean about aria2c's output. It does wrap it and it does keep it on one line. If you mean that I should parse aria2c's status line then I don't see the point. The status line does not show any file name and even if it did, it wouldn't make much sense as it doesn't show any of the other ongoing downloads. Older versions of powerpill did parse that line and combine it with information from other system calls to display more information, but the overhead and code complexity it required simply isn't worth it.

The "retrieved 0 mirrors" line serves as a warning. If the user does not wish to use the Reflector module, then the user shouldn't supply the option. Adding checks in powerpill and bauerbill for perl-crypt-ssleay at runtime increases code complexity with no real benefit as the user receives essentially the same information in both cases.

Daenyth · 2010-03-12 19:52:16

I've noticed that powerpill doesn't seem to look for replaces when doing an -Syuw. Is there any public repo or issue tracker for this? (Or any of your software..)?

Xyne · 2010-03-13 00:44:47

Daenyth wrote:

I've noticed that powerpill doesn't seem to look for replaces when doing an -Syuw. Is there any public repo or issue tracker for this? (Or any of your software..)?

Yeah, the forum

Can you give an example of the problem?

Daenyth · 2010-03-13 01:14:58

I ran -Syuw using powerpill, then later on did a pacman -Su, and it prompted me to replace jack-audio-connection-kit with jack, which it had to download, as powerpill didn't

Xyne · 2010-03-13 08:04:58

I've looked at the code and I see a quick fix, but it's too slow.* I need to rethink my approach to the database but it may take a while as I don't have much time right now.

* You can try it by uncommenting the following around line 213 in Pacman.pm:

#     else
#     {
#       my $replacement = $self->get_sync_db_replacement($pkgname);
#       push(@upgradable,$replacement) if defined($replacement);
#     }

chakra-user · 2010-03-20 00:45:28

Hi Xyne,
When doing a powerpill -Syu, it shows output like
[core]
kernel26 kernel26-firmware libarchive

whereas pacman shows as
kernel26-firmware-2.6.32.10-1 kernel26-2.6.32.10-1 libarchive-2.8.3-1

basically pp does not show versions so it is difficult to know the versions and I might not want to update a package if it is making the rounds of bugs forums.

Any solution?

Thanks.

Last edited by chakra-user (2010-03-20 00:46:10)

Xyne · 2010-03-20 02:39:35

@chakra-user
I've included the versions in the download approval dialogue. Install perl-xyne-arch from my repo to test it.

graysky · 2010-06-24 06:26:41

@xyne - I commented out the reflector line in my /etc/powerpill.conf but powerpill seems to still use reflector on my box. Can you explain why?

/etc/powerpill.conf (no commented lines not shown except for the reflector line)

Aria2Args = allow-overwrite=true continue file-allocation=none ftp-pasv=true max-concurrent-downloads=45 max-tries=2 metalink-enable-unique-protocol=false metalink-servers=45 summary-interval=0 timeout=5 file-allocation=none

Aria2Bin = /usr/bin/aria2c
LWPTimeout = 10
PacmanBin = /usr/bin/pacman
PacmanConfig = /etc/pacman.conf
#Reflect = -l 45
RetryLimit = 3
SplitSize = 5

# powerpill -Syu
:: Synchronizing package databases...
 core is up to date
 extra                                451.9K  500.3K/s 00:00:01 [##################################] 100%
 community                            375.9K  521.0K/s 00:00:01 [##################################] 100%

:: The following packages will be downloaded:
   [community]
     perl-xyne-arch-2010.06.24.2-1

:: Number of Packages:               1
:: Total Download Size:       0.08 MiB
:: Total Installed Size:      0.39 MiB

:: Proceed with download? [Y/n] 
--> Reflecting... retrieved 45 mirrors.

On other boxes, when I have the reflect line commented out, this reads 'retrieved 0 mirrors.'

Last edited by graysky (2010-06-24 06:29:47)

Xyne · 2010-06-24 12:38:40

@graysky
I had unintentionally hardcoded the default. You can now uncomment that line to disable Reflector.

Why would you want to disable it?

ngoonee · 2010-06-24 13:49:54

Xyne wrote:

@graysky
I had unintentionally hardcoded the default. You can now uncomment that line to disable Reflector.
Why would you want to disable it?

Ah, that explains why my bauerbill-in-chroot just stopped downloading packages and required installing reflector (where it didn't before). Well, no biggie, hard disc space is cheap.

Xyne · 2010-06-24 14:36:53

ngoonee wrote:

Xyne wrote:
@graysky
I had unintentionally hardcoded the default. You can now uncomment that line to disable Reflector.
Why would you want to disable it?
Ah, that explains why my bauerbill-in-chroot just stopped downloading packages and required installing reflector (where it didn't before). Well, no biggie, hard disc space is cheap.

Huh? Why did you need to install reflector? It's still built into powerpill and enabled by default. The update won't change anything unless you had already manually uncommented that line in the config.

Btw, the reflector package is only 8K installed, and that's probably rounded up. Hard disk space doesn't even enter into it.

graysky · 2010-06-24 21:16:32

Xyne wrote:

@graysky
I had unintentionally hardcoded the default. You can now uncomment that line to disable Reflector.
Why would you want to disable it?

I tried it both commenting out the reflector line and leaving it enabled. In each case, powerpill displays the "--> Reflecting... retrieved 45 mirrors." line. I'd like to disable it to force it to use only the mirrors in my mirrorlist.

ngoonee · 2010-06-24 23:55:54

Xyne wrote:

ngoonee wrote:
Xyne wrote:
@graysky
I had unintentionally hardcoded the default. You can now uncomment that line to disable Reflector.
Why would you want to disable it?
Ah, that explains why my bauerbill-in-chroot just stopped downloading packages and required installing reflector (where it didn't before). Well, no biggie, hard disc space is cheap.
Huh? Why did you need to install reflector? It's still built into powerpill and enabled by default. The update won't change anything unless you had already manually uncommented that line in the config.
Btw, the reflector package is only 8K installed, and that's probably rounded up. Hard disk space doesn't even enter into it.

Hmmm? It wouldn't work for me without reflector installed, is that how its supposed to be?

Xyne · 2010-06-25 08:44:32

@graysky
Did you update to the latest version of perl-xyne-arch after I posted? It takes time for updates to hit the mirrors. Always check the latest version on my site and install it from there if you don't want to wait. I've double-checked it and commenting out "Reflect" in the configuration file does indeed disable Reflector in Powerpill.

@ngoonee

$ pacman -Qi bauerbill
...
Optional Deps  : perl-crypt-ssleay: for reflector support
...

$pacman -Qi reflector
...
Depends On     : perl  perl-xyne-arch  perl-crypt-ssleay
...

Obviously you removed perl-crypt-ssleay when you removed reflector.

greenfish · 2010-06-28 11:37:11

I know this isn't bug related

But i've been using powerpill for about a year now and it's never failed me.

Just wanna say my thanks to Xyne for this wonderful application :):)

Arch Linux

#326 2010-01-24 03:23:55

Re: Powerpill - A wrapper and download accelerator for Pacman

#327 2010-01-24 03:46:33

Re: Powerpill - A wrapper and download accelerator for Pacman

#328 2010-01-28 10:58:12

Re: Powerpill - A wrapper and download accelerator for Pacman

#329 2010-01-28 11:29:09

Re: Powerpill - A wrapper and download accelerator for Pacman

#330 2010-01-31 02:30:37

Re: Powerpill - A wrapper and download accelerator for Pacman

#331 2010-02-03 13:39:11

Re: Powerpill - A wrapper and download accelerator for Pacman

#332 2010-02-03 17:00:17

Re: Powerpill - A wrapper and download accelerator for Pacman

#333 2010-02-05 11:26:26

Re: Powerpill - A wrapper and download accelerator for Pacman

#334 2010-02-06 02:44:06

Re: Powerpill - A wrapper and download accelerator for Pacman

#335 2010-02-27 02:04:11

Re: Powerpill - A wrapper and download accelerator for Pacman

#336 2010-02-27 14:51:27

Re: Powerpill - A wrapper and download accelerator for Pacman

#337 2010-03-12 19:52:16

Re: Powerpill - A wrapper and download accelerator for Pacman

#338 2010-03-13 00:44:47

Re: Powerpill - A wrapper and download accelerator for Pacman

#339 2010-03-13 01:14:58

Re: Powerpill - A wrapper and download accelerator for Pacman

#340 2010-03-13 08:04:58

Re: Powerpill - A wrapper and download accelerator for Pacman

#341 2010-03-20 00:45:28

Re: Powerpill - A wrapper and download accelerator for Pacman

#342 2010-03-20 02:39:35

Re: Powerpill - A wrapper and download accelerator for Pacman

#343 2010-06-24 06:26:41

Re: Powerpill - A wrapper and download accelerator for Pacman

#344 2010-06-24 12:38:40

Re: Powerpill - A wrapper and download accelerator for Pacman

#345 2010-06-24 13:49:54

Re: Powerpill - A wrapper and download accelerator for Pacman

#346 2010-06-24 14:36:53

Re: Powerpill - A wrapper and download accelerator for Pacman

#347 2010-06-24 21:16:32

Re: Powerpill - A wrapper and download accelerator for Pacman

#348 2010-06-24 23:55:54

Re: Powerpill - A wrapper and download accelerator for Pacman

#349 2010-06-25 08:44:32

Re: Powerpill - A wrapper and download accelerator for Pacman

#350 2010-06-28 11:37:11

Re: Powerpill - A wrapper and download accelerator for Pacman

Board footer