pbget: ABS and AUR PKGBUILD etc retriever

Xyne · 2010-12-16 19:37:49

The server bug has been fixed and the SVN download works again.

As I was trying to debug this I made some changes to pbget:
* fixed rsync to include "any" repos, "multilib" for x86_64, and "community-testing" when "--testing" is enabled
* changed http to https for SVN retrieval

TryA · 2010-12-17 04:45:55

SVN is ok, but now rsync-ing packages with --abs only works with [core] packages. For example, an [extra] package:

$ pbget --abs xulrunner
--> adding xulrunner to ABS queue
--> starting rsync...

receiving incremental file list
rsync: change_dir "any/multilib" (in abs) failed: No such file or directory (2)
rsync: change_dir "any/multilib" (in abs) failed: No such file or directory (2)

sent 53 bytes  received 272 bytes  92.86 bytes/sec
total size is 0  speedup is 0.00
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1508) [generator=3.0.7]

Last edited by TryA (2010-12-17 04:46:27)

Xyne · 2010-12-17 05:35:27

Thanks for the feedback. It should be fixed now.

skanky · 2012-03-08 09:52:48

Hello Xyne, been using this for a while and recently started getting this output when updating aur packages:

pbget --aur-only --upgradable
--> searching for foreign packages in the AUR
--> this may take a while if you have many foreign packages
-->   texlive-bibtexextra-doc-{"type":"error","results":"No
-->   results
-->   found"}
...
...
repeated for all packages
...
...
==> WARNING texlive-bibtexextra-doc-{"type":"error","results":"No was not found in the AUR
==> WARNING results was not found in the AUR
==> WARNING found"} was not found in the AUR
==> WARNING texlive-core-doc-{"type":"error","results":"No was not found in the AUR
==> WARNING results was not found in the AUR
...
repeated for all packages

It may or may not return the messages for packages that are upgradable, I can't recall, and it still works for them so there's no functional degradation.
Comparing to your website, I'm at the latest version of both pbget and bash-xyne-common_functions.

Any other information required, let me know.

Xyne · 2012-03-08 23:02:07

I don't what what changed, but I've been meaning to rewrite pbget in Python for a while to leverage python3-AUR and pyalpm. I took this as incentive to do that.

Try the new version (available in my repo, not in the AUR yet) and let me know if everything works as expected.

skanky · 2012-03-09 09:59:08

Thanks for the quick response.

I use your repos anyway, not the aur.

Anyway, I updated, installed python3-aur and tried again.
I now always get an error message saying the aur module is required.
This has persisted across a restart.

Also, as an aside, the manual is missing in the new package (I checked it to see if the options had changed).

$ pbget --aur-only --upgradable
error: this operation requires the AUR module
nothing to do
$ pbget --aur --aur-only --upgradable
error: this operation requires the AUR module
nothing to do
$ pacman -Qi python3-aur
Name           : python3-aur
Version        : 2012.03.08.80748-1
URL            : http://xyne.archlinux.ca/projects/python3-aur
Licences       : GPL
Groups         : None
Provides       : None
Depends On     : python3  python3-xynexdg
Optional Deps  : None
Required By    : None
Conflicts With : python-aur
Replaces       : None
Installed Size : 128.00 KiB
Packager       : Xyne
Architecture   : any
Build Date     : Thu 08 Mar 2012 22:49:08 GMT
Install Date   : Fri 09 Mar 2012 09:43:08 GMT
Install Reason : Explicitly installed
Install Script : No
Description    : A Python 3 module to retrieve and cache data from the AUR.

$ pacman -Qi pbget
Name           : pbget
Version        : 2012.03.08.84357-1
URL            : http://xyne.archlinux.ca/projects/pbget
Licences       : GPL
Groups         : None
Provides       : None
Depends On     : python3
Optional Deps  : pyalpm: checking upgradable packages
                 rsync: ABS tree support
                 python3-aur: AUR support
Required By    : None
Conflicts With : None
Replaces       : None
Installed Size :  36.00 KiB
Packager       : Xyne
Architecture   : any
Build Date     : Thu 08 Mar 2012 23:27:38 GMT
Install Date   : Fri 09 Mar 2012 09:42:28 GMT
Install Reason : Explicitly installed
Install Script : Yes
Description    : Retrieve PKGBUILDs and local source files from Git, ABS and the AUR for makepkg.

$ man pbget
man: can't resolve /usr/share/man/man1/pbget.1.gz: No such file or directory
No manual entry for pbget
$

Xyne · 2012-03-09 16:38:18

python3-aur is an optional dependency. If you want AUR support, install it.

There is no man page because the output of "pbget --help" is essentially identical to what the man page was.

I'll try to make it clearer in the messages that you need the optional dependencies for different tasks.

skanky · 2012-03-09 16:48:01

Xyne wrote:

python3-aur is an optional dependency. If you want AUR support, install it.

It is installed. See the pacman -Qi output for it, above.

Xyne wrote:

There is no man page because the output of "pbget --help" is essentially identical to what the man page was.

Makes sense. However man think's it should be there though as it's giving a can't resolve error (again, above).

Xyne wrote:

I'll try to make it clearer in the messages that you need the optional dependencies for different tasks.

It was clear from both the install listing, and the pacman -Qi output that they are needed, so I don't think you need to do anything else to indicate that.
The problem is it's not working even with the module installed.

Xyne · 2012-03-09 17:06:02

Sorry, I obviously didn't read the output. I'm working on it now, will bump once I figure it out.

Last edited by Xyne (2012-03-09 17:06:13)

skanky · 2012-03-09 17:21:55

Xyne wrote:

Sorry, I obviously didn't read the output. I'm working on it now, will bump once I figure it out.

No problem, let me know if you need any more info.

Xyne · 2012-03-09 17:49:55

Everything should be fixed now. The problem was that I had set default access control lists on one of my directories a few days ago. I didn't realize that it affected some of the packages, so the AUR module (among other things) was not world-readable.

fail

I've rebuilt everything to just to be sure. Let me know if it works now.

Last edited by Xyne (2012-03-09 18:17:15)

skanky · 2012-03-09 18:01:56

No errors, but also no AUR needing updating, so not a full check - though it's all looking good.

Thank you very much, much appreciated.

Xyne · 2012-03-09 18:17:56

Thanks for testing.

ngoonee · 2012-12-20 23:36:29

Any way to get packages from testing without using the abs interface? Office machine can't rsync due to proxy

Xyne · 2012-12-21 15:59:27

Is there a way to access them via the server's git interface?

ngoonee · 2012-12-23 08:39:49

Xyne wrote:

Is there a way to access them via the server's git interface?

No idea, really. I can try and check on Monday

skanky · 2016-02-17 15:50:11

Looks like some recent update has broken pbget?

I'm getting this error:

pbget --upgradable
Traceback (most recent call last):
  File "/usr/lib/python3.5/runpy.py", line 170, in _run_module_as_main
    "__main__", mod_spec)
  File "/usr/lib/python3.5/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/usr/lib/python3.5/site-packages/pbget.py", line 257, in <module>
    main()
  File "/usr/lib/python3.5/site-packages/pbget.py", line 199, in main
    aur_only=pargs.aur_only
  File "/usr/lib/python3.5/site-packages/pbget.py", line 65, in get_upgradable
    handle, conf = pm2ml.handle_and_conf_from_arguments(pargs)
NameError: name 'pargs' is not defined

Not sure when it occurred as I've been away and I've only just noticed that my script that calls it isn't wokring properly.

Xyne · 2016-02-17 22:28:18

That probably slipped in during the refactoring around the beginning of December.

Fixed.

skanky · 2016-02-18 09:07:54

Many thanks.

Xyne · 2016-07-10 20:42:36

The new backend is available for testing here. It is not entirely backwards-compatible so please give it a try now and get ready to migrate your configuration files and scripts. Extension developers are most welcome

This new backend makes it possible to download PKGBUILDs from any third-party source if someone provides an extension

glitsj16 · 2019-11-09 13:09:35

Hi, I've been using pbget for a while now without issues. To see whether or not there's a performance gain when statically linking python I needed to pbget python. It worked, but gave me the version from staging instead of extra. My ~/.cache/XCPF/abs_git/python/repos holds 2 sub-directories: extra-x86_64 and staging-x86_64. Is there a way to exclude repos like staging ?

$ pacman -Q pbget
pbget 2017.7-3

Xyne · 2019-11-18 23:49:12

I've added a new option (--trunk) to check out the latest commit and changed the default to check out the current repo version. I'll push the update when I rebuild all of my packages for Python 3.8 (tonight or tomorrow).

Arch Linux

#26 2010-12-16 19:37:49

Re: pbget: ABS and AUR PKGBUILD etc retriever

#27 2010-12-17 04:45:55

Re: pbget: ABS and AUR PKGBUILD etc retriever

#28 2010-12-17 05:35:27

Re: pbget: ABS and AUR PKGBUILD etc retriever

#29 2012-03-08 09:52:48

Re: pbget: ABS and AUR PKGBUILD etc retriever

#30 2012-03-08 23:02:07

Re: pbget: ABS and AUR PKGBUILD etc retriever

#31 2012-03-09 09:59:08

Re: pbget: ABS and AUR PKGBUILD etc retriever

#32 2012-03-09 16:38:18

Re: pbget: ABS and AUR PKGBUILD etc retriever

#33 2012-03-09 16:48:01

Re: pbget: ABS and AUR PKGBUILD etc retriever

#34 2012-03-09 17:06:02

Re: pbget: ABS and AUR PKGBUILD etc retriever

#35 2012-03-09 17:21:55

Re: pbget: ABS and AUR PKGBUILD etc retriever

#36 2012-03-09 17:49:55

Re: pbget: ABS and AUR PKGBUILD etc retriever

#37 2012-03-09 18:01:56

Re: pbget: ABS and AUR PKGBUILD etc retriever

#38 2012-03-09 18:17:56

Re: pbget: ABS and AUR PKGBUILD etc retriever

#39 2012-12-20 23:36:29

Re: pbget: ABS and AUR PKGBUILD etc retriever

#40 2012-12-21 15:59:27

Re: pbget: ABS and AUR PKGBUILD etc retriever

#41 2012-12-23 08:39:49

Re: pbget: ABS and AUR PKGBUILD etc retriever

#42 2016-02-17 15:50:11

Re: pbget: ABS and AUR PKGBUILD etc retriever

#43 2016-02-17 22:28:18

Re: pbget: ABS and AUR PKGBUILD etc retriever

#44 2016-02-18 09:07:54

Re: pbget: ABS and AUR PKGBUILD etc retriever

#45 2016-07-10 20:42:36

Re: pbget: ABS and AUR PKGBUILD etc retriever

#46 2019-11-09 13:09:35

Re: pbget: ABS and AUR PKGBUILD etc retriever

#47 2019-11-18 23:49:12

Re: pbget: ABS and AUR PKGBUILD etc retriever

Board footer