You are not logged in.

Pages: 1 2 3 4 5 … 11

#51 2016-04-02 19:54:41

Xyne
Administrator/PM
Registered: 2008-08-03
Posts: 6,965
Website

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

@Sir7empest
1. The generated download scripts use pbget to download the PKGBUILDs. I suppose I could add local ABS support to pbget but that will have to wait a while if I do.

2. Bauerbill hooks are only triggered when building specific packages and they are invoked from the download and build scripts. Their purpose is to adjust packages (e.g. by applying patches). If you are asking about Pacman hooks then they should be run "as usual" when pacman is invoked for installation. I haven't read up on them yet so I don't know what you can do with that, but if you just want to run something before each system upgrade then couldn't you just add that to your wrapper script?

@Alad
The problem is that it's one of those "clever" packages that changes dependencies depending on architecture. Bauerbill trusts the AUR to report the correct dependencies but that fails in this case. I don't know how to deal with the problem within Bauerbill but I'm open to suggestions.

My Arch Linux Stuff • Forum Etiquette • Community Ethos - Arch is not for everyone

Offline

#52 2016-04-02 20:43:46

Alad
Wiki Admin/IRC Op
From: Bagelstan
Registered: 2014-05-04
Posts: 2,418
Website

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

Xyne wrote:

The problem is that it's one of those "clever" packages that changes dependencies depending on architecture. Bauerbill trusts the AUR to report the correct dependencies but that fails in this case. I don't know how to deal with the problem within Bauerbill but I'm open to suggestions.

Ideally, aurweb would handle those fields (see https://lists.archlinux.org/pipermail/a … 3012.html), but some hacks exist:

1. Retrieve makedepends + arch from SRCINFO (https://github.com/Kwpolska/pkgbuilder/ … ld.py#L189)
2. Cut off the lib32- prefix if arch equals i686 (https://github.com/rmarquis/pacaur/comm … ad8058f12c)

The first might not fit here, as SRCINFO files are only available after extracting the aur tarball. That said, you can technically retrieve SRCINFO from the web interface, e.g.

https://aur.archlinux.org/cgit/aur.git/ … abxc32-bin

Last edited by Alad (2016-04-02 20:50:06)

Mods are just community members who have the occasionally necessary option to move threads around and edit posts. -- Trilby

Offline

#53 2016-04-02 22:54:20

Spyhawk
Member
Registered: 2006-07-07
Posts: 485

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

@Alad> I guess we'd better send a patch to the AUR team here, the hack I'm using is simply ugly (and that specific commit is buggy too). I never took the time to write anything since I simply don't want to install the whole PHP thing to test my own change. Also I don't really like PHP tongue

Offline

#54 2016-04-02 22:55:47

Xyne
Administrator/PM
Registered: 2008-08-03
Posts: 6,965
Website

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

Parsing SRCINFO directly is the best approach in my opinion. I will update the SRCINFO parser in python3-aur and work that into Bauerbill either directly or indirectly. I need up refactor the AUR.RCP module in python3-aur as well for the latest changes. I'll post an update here when it's ready.

My Arch Linux Stuff • Forum Etiquette • Community Ethos - Arch is not for everyone

Offline

#55 2016-04-03 11:27:44

Spyhawk
Member
Registered: 2006-07-07
Posts: 485

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

FYI: I added a task on the bugtracker, since this was never done and the report on the ML was quickly forgotten.

Offline

#56 2016-04-03 11:34:01

Xyne
Administrator/PM
Registered: 2008-08-03
Posts: 6,965
Website

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

Well, that kicked off a boatload of changes...

I ended up updating AUR.RPC for version 5 of the interface (initially to check if the correct info was available there). That led to scrapping of all the database code in favor of MemoizeDB (something that I've meant to do for a while, which also completes the circle as MemoizeDB was written to generalize the caching ideas in AUR.RPC), which in turn led to a number of changes elsewhere and almost certainly introduced some bugs. I then added SRCINFO awareness to AurBuildablePkg in Bauerbill to get access to architecture-specific data while waiting for the RPC interface to catch up.

So, with this update Bauerbill should correctly determine the dependency graph for each architecture. It will even check for checkdeps now (I'll make it optional later). Everything seems to work but given the range of changes I expect some bugs in the next few days. I have uploaded the changes to my repo but I will wait a bit before pushing them to AUR. Please update the full dep tree for Bauerbill and let me know if it works as expected.

My Arch Linux Stuff • Forum Etiquette • Community Ethos - Arch is not for everyone

Offline

#57 2016-04-03 13:23:59

Alad
Wiki Admin/IRC Op
From: Bagelstan
Registered: 2014-05-04
Posts: 2,418
Website

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

On x86_64, I currently have:

bauerbill --aur -S microchip-mplabxc32-bin 
Traceback (most recent call last):
  File "/usr/lib/python3.5/runpy.py", line 170, in _run_module_as_main
    "__main__", mod_spec)
  File "/usr/lib/python3.5/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/usr/lib/python3.5/site-packages/Bauerbill.py", line 1597, in <module>
    run_main()
  File "/usr/lib/python3.5/site-packages/Bauerbill.py", line 1580, in run_main
    return main(args)
  File "/usr/lib/python3.5/site-packages/Bauerbill.py", line 1459, in main
    retriever = AUR.SRCINFO.AurSrcinfo()
AttributeError: module 'AUR.SRCINFO' has no attribute 'AurSrcinfo'

Same on i686, but additionally:

WARNING: multinfo query (lib32-gcc-libs): no results
ERROR: Unresolved dependencies: gcc-multilib lib32-gcc-libs lib32-libx11

Last edited by Alad (2016-04-03 13:27:25)

Mods are just community members who have the occasionally necessary option to move threads around and edit posts. -- Trilby

Offline

#58 2016-04-03 18:44:19

Xyne
Administrator/PM
Registered: 2008-08-03
Posts: 6,965
Website

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

fixed, sorry

My Arch Linux Stuff • Forum Etiquette • Community Ethos - Arch is not for everyone

Offline

#59 2016-04-03 18:53:00

Alad
Wiki Admin/IRC Op
From: Bagelstan
Registered: 2014-05-04
Posts: 2,418
Website

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

Now I have the following:

bauerbill --aur -S microchip-mplabxc32-bin
Traceback (most recent call last):
  File "/usr/lib/python3.5/site-packages/MemoizeDB.py", line 292, in db_select_many
    results = c.execute(query, keys)
sqlite3.OperationalError: no such table: info

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/lib/python3.5/runpy.py", line 170, in _run_module_as_main
    "__main__", mod_spec)
  File "/usr/lib/python3.5/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/usr/lib/python3.5/site-packages/Bauerbill.py", line 1597, in <module>
    run_main()
  File "/usr/lib/python3.5/site-packages/Bauerbill.py", line 1580, in run_main
    return main(args)
  File "/usr/lib/python3.5/site-packages/Bauerbill.py", line 1441, in main
    handle, pacman_conf, pm2ml_pargs, aur=aur
  File "/usr/lib/python3.5/site-packages/pm2ml.py", line 1168, in resolve_targets_from_arguments
    only_needed=pargs.needed,
  File "/usr/lib/python3.5/site-packages/pm2ml.py", line 1073, in resolve_targets
    ignored=ignored
  File "/usr/lib/python3.5/site-packages/pm2ml.py", line 391, in partition_pkgs
    aur.info(XCPF.get_required_version_strings(ver_reqs, maybe_aur))
  File "/usr/lib/python3.5/site-packages/pm2ml.py", line 509, in addmany
    for pkg in pkgs:
  File "/usr/lib/python3.5/site-packages/AUR/RPC.py", line 372, in get
    for pkg in self._get(*args, **kwargs):
  File "/usr/lib/python3.5/site-packages/AUR/RPC.py", line 407, in _get
    for pkg in self.mdb.get_nth_field_many(table, format_rpc_args(names)):
  File "/usr/lib/python3.5/site-packages/MemoizeDB.py", line 515, in get_nth_field_many
    for vs in self.get_many(table, keys):
  File "/usr/lib/python3.5/site-packages/MemoizeDB.py", line 478, in get_many
    table, keys, list_keys=True
  File "/usr/lib/python3.5/site-packages/MemoizeDB.py", line 477, in <genexpr>
    key for key in self.get_cached_data_many(
  File "/usr/lib/python3.5/site-packages/MemoizeDB.py", line 428, in get_cached_data_many
    for key, values in zip(keys, self.db_select_many(table, keys, cols=cols)):
  File "/usr/lib/python3.5/site-packages/MemoizeDB.py", line 326, in db_select_many
    raise MDBError('query failed', error=e)
MemoizeDB.MDBError: MDBError: query failed [no such table: info]

Thanks for your work on this. smile

Mods are just community members who have the occasionally necessary option to move threads around and edit posts. -- Trilby

Offline

#60 2016-04-03 19:20:18

Xyne
Administrator/PM
Registered: 2008-08-03
Posts: 6,965
Website

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

Can you post the output of

pacman -Q bauerbill powerpill pm2ml python3-aur python3-xcpf python3-xcgf
bauerbill --debug --aur -S microchip-mplabxc32-bin

My Arch Linux Stuff • Forum Etiquette • Community Ethos - Arch is not for everyone

Offline

#61 2016-04-03 19:42:38

Alad
Wiki Admin/IRC Op
From: Bagelstan
Registered: 2014-05-04
Posts: 2,418
Website

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

After another -Syu, it works on x86_64:

bauerbill 2016.4-1
powerpill 2016.3.17-1
pm2ml 2016.4-1
python3-aur 2016.4.3.2-1
python3-xcpf 2016.4.3-1
python3-xcgf 2016.4-1
DEBUG: created table "search_by_name_desc"
DEBUG: created table "search_by_name"
DEBUG: created table "info"
DEBUG: created table "search_by_maintainer"
DEBUG: retrieving https://aur.archlinux.org/rpc.php?v=5&type=info&arg%5B%5D=microchip-mplabxc32-bin
DEBUG: {
  "resultcount": 1,
  "results": [
    {
      "Depends": [
        "lib32-gcc-libs"
      ],
      "Description": "Microchip's MPLAB XC32 C compiler toolchain for all of their 32bit microcontrollers",
      "FirstSubmitted": 1332621462,
      "ID": 264262,
      "Keywords": [],
      "LastModified": 1452502574,
      "License": [
        "custom"
      ],
      "Maintainer": "greyltc",
      "MakeDepends": [
        "sdx",
        "tclkit",
        "lib32-tclkit"
      ],
      "Name": "microchip-mplabxc32-bin",
      "NumVotes": 8,
      "OutOfDate": null,
      "PackageBase": "microchip-mplabxc32-bin",
      "PackageBaseID": 57912,
      "Popularity": 0.000649,
      "URL": "http://www.microchip.com/xc32",
      "URLPath": "/cgit/aur.git/snapshot/microchip-mplabxc32-bin.tar.gz",
      "Version": "1.40-4"
    }
  ],
  "type": "multiinfo",
  "version": 5
}
DEBUG: retrieving https://aur.archlinux.org/rpc.php?v=5&type=info&arg%5B%5D=sdx&arg%5B%5D=lib32-tclkit&arg%5B%5D=tclkit
DEBUG: {
  "resultcount": 3,
  "results": [
    {
      "Conflicts": [
        "tclkit"
      ],
      "Depends": [
        "lib32-libx11",
        "gcc-multilib"
      ],
      "Description": "single-file executable that provides a complete Tcl and Tk runtime (32 bits version)",
      "FirstSubmitted": 1438714734,
      "ID": 266766,
      "Keywords": [],
      "LastModified": 1453217211,
      "License": [
        "custom"
      ],
      "Maintainer": "mickael9",
      "MakeDepends": [
        "upx",
        "ucl"
      ],
      "Name": "lib32-tclkit",
      "NumVotes": 4,
      "OutOfDate": null,
      "PackageBase": "lib32-tclkit",
      "PackageBaseID": 96728,
      "Popularity": 0.458184,
      "Provides": [
        "tclkit"
      ],
      "URL": "https://github.com/patthoyts/kitgen",
      "URLPath": "/cgit/aur.git/snapshot/lib32-tclkit.tar.gz",
      "Version": "8.6.4-4"
    },
    {
      "Depends": [
        "tclkit"
      ],
      "Description": "A utility for making and unpacking starkits.",
      "FirstSubmitted": 1358950073,
      "ID": 287994,
      "Keywords": [],
      "LastModified": 1458931963,
      "License": [
        "MIT"
      ],
      "Maintainer": "zashi",
      "Name": "sdx",
      "NumVotes": 5,
      "OutOfDate": null,
      "PackageBase": "sdx",
      "PackageBaseID": 66548,
      "Popularity": 0.156259,
      "URL": "http://equi4.com/starkit/sdx.html",
      "URLPath": "/cgit/aur.git/snapshot/sdx.tar.gz",
      "Version": "20080224-4"
    },
    {
      "Description": "single-file executable that provides a complete Tcl and Tk runtime",
      "FirstSubmitted": 1197763834,
      "ID": 263398,
      "Keywords": [],
      "LastModified": 1452259490,
      "License": [
        "custom"
      ],
      "Maintainer": "greyltc",
      "MakeDepends": [
        "upx",
        "ucl"
      ],
      "Name": "tclkit",
      "NumVotes": 14,
      "OutOfDate": null,
      "PackageBase": "tclkit",
      "PackageBaseID": 14293,
      "Popularity": 0.215271,
      "URL": "https://github.com/patthoyts/kitgen",
      "URLPath": "/cgit/aur.git/snapshot/tclkit.tar.gz",
      "Version": "8.6.4-5"
    }
  ],
  "type": "multiinfo",
  "version": 5
}
DEBUG: created table "srcinfo"
DEBUG: retrieving data from https://aur.archlinux.org/cgit/aur.git/plain/.SRCINFO?h=lib32-tclkit
DEBUG: retrieving data from https://aur.archlinux.org/cgit/aur.git/plain/.SRCINFO?h=microchip-mplabxc32-bin
DEBUG: retrieving data from https://aur.archlinux.org/cgit/aur.git/plain/.SRCINFO?h=sdx
DEBUG: retrieving data from https://aur.archlinux.org/cgit/aur.git/plain/.SRCINFO?h=tclkit
INFO: created build/download.sh
created build/download.sh
INFO: created build/build.sh
created build/build.sh
INFO: created build/clean.sh
created build/clean.sh

On i686, I get a traceback:

bauerbill 2016.4-1
powerpill 2016.3.17-1
pm2ml 2016.4-1
python3-aur 2016.4.3.2-1
python3-xcpf 2016.4.3-1
python3-xcgf 2016.4-1
DEBUG: created table "info"
DEBUG: created table "search_by_name"
DEBUG: created table "search_by_maintainer"
DEBUG: created table "search_by_name_desc"
DEBUG: retrieving https://aur.archlinux.org/rpc.php?v=5&type=info&arg%5B%5D=microchip-mplabxc32-bin
DEBUG: {
  "resultcount": 1,
  "results": [
    {
      "Depends": [
        "lib32-gcc-libs"
      ],
      "Description": "Microchip's MPLAB XC32 C compiler toolchain for all of their 32bit microcontrollers",
      "FirstSubmitted": 1332621462,
      "ID": 264262,
      "Keywords": [],
      "LastModified": 1452502574,
      "License": [
        "custom"
      ],
      "Maintainer": "greyltc",
      "MakeDepends": [
        "sdx",
        "tclkit",
        "lib32-tclkit"
      ],
      "Name": "microchip-mplabxc32-bin",
      "NumVotes": 8,
      "OutOfDate": null,
      "PackageBase": "microchip-mplabxc32-bin",
      "PackageBaseID": 57912,
      "Popularity": 0.000649,
      "URL": "http://www.microchip.com/xc32",
      "URLPath": "/cgit/aur.git/snapshot/microchip-mplabxc32-bin.tar.gz",
      "Version": "1.40-4"
    }
  ],
  "type": "multiinfo",
  "version": 5
}
DEBUG: retrieving https://aur.archlinux.org/rpc.php?v=5&type=info&arg%5B%5D=tclkit&arg%5B%5D=sdx&arg%5B%5D=lib32-gcc-libs&arg%5B%5D=lib32-tclkit
DEBUG: {
  "resultcount": 3,
  "results": [
    {
      "Conflicts": [
        "tclkit"
      ],
      "Depends": [
        "lib32-libx11",
        "gcc-multilib"
      ],
      "Description": "single-file executable that provides a complete Tcl and Tk runtime (32 bits version)",
      "FirstSubmitted": 1438714734,
      "ID": 266766,
      "Keywords": [],
      "LastModified": 1453217211,
      "License": [
        "custom"
      ],
      "Maintainer": "mickael9",
      "MakeDepends": [
        "upx",
        "ucl"
      ],
      "Name": "lib32-tclkit",
      "NumVotes": 4,
      "OutOfDate": null,
      "PackageBase": "lib32-tclkit",
      "PackageBaseID": 96728,
      "Popularity": 0.458184,
      "Provides": [
        "tclkit"
      ],
      "URL": "https://github.com/patthoyts/kitgen",
      "URLPath": "/cgit/aur.git/snapshot/lib32-tclkit.tar.gz",
      "Version": "8.6.4-4"
    },
    {
      "Depends": [
        "tclkit"
      ],
      "Description": "A utility for making and unpacking starkits.",
      "FirstSubmitted": 1358950073,
      "ID": 287994,
      "Keywords": [],
      "LastModified": 1458931963,
      "License": [
        "MIT"
      ],
      "Maintainer": "zashi",
      "Name": "sdx",
      "NumVotes": 5,
      "OutOfDate": null,
      "PackageBase": "sdx",
      "PackageBaseID": 66548,
      "Popularity": 0.156259,
      "URL": "http://equi4.com/starkit/sdx.html",
      "URLPath": "/cgit/aur.git/snapshot/sdx.tar.gz",
      "Version": "20080224-4"
    },
    {
      "Description": "single-file executable that provides a complete Tcl and Tk runtime",
      "FirstSubmitted": 1197763834,
      "ID": 263398,
      "Keywords": [],
      "LastModified": 1452259490,
      "License": [
        "custom"
      ],
      "Maintainer": "greyltc",
      "MakeDepends": [
        "upx",
        "ucl"
      ],
      "Name": "tclkit",
      "NumVotes": 14,
      "OutOfDate": null,
      "PackageBase": "tclkit",
      "PackageBaseID": 14293,
      "Popularity": 0.215271,
      "URL": "https://github.com/patthoyts/kitgen",
      "URLPath": "/cgit/aur.git/snapshot/tclkit.tar.gz",
      "Version": "8.6.4-5"
    }
  ],
  "type": "multiinfo",
  "version": 5
}
DEBUG: retrieving https://aur.archlinux.org/rpc.php?v=5&type=info&arg%5B%5D=gcc-multilib&arg%5B%5D=lib32-libx11
DEBUG: {
  "resultcount": 0,
  "results": [],
  "type": "multiinfo",
  "version": 5
}
INFO: no results found
Traceback (most recent call last):
  File "/usr/lib/python3.5/runpy.py", line 170, in _run_module_as_main
    "__main__", mod_spec)
  File "/usr/lib/python3.5/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/usr/lib/python3.5/site-packages/Bauerbill.py", line 1597, in <module>
    run_main()
  File "/usr/lib/python3.5/site-packages/Bauerbill.py", line 1580, in run_main
    return main(args)
  File "/usr/lib/python3.5/site-packages/Bauerbill.py", line 1441, in main
    handle, pacman_conf, pm2ml_pargs, aur=aur
  File "/usr/lib/python3.5/site-packages/pm2ml.py", line 1168, in resolve_targets_from_arguments
    only_needed=pargs.needed,
  File "/usr/lib/python3.5/site-packages/pm2ml.py", line 1096, in resolve_targets
    ignoredgroups=ignoredgroups,
  File "/usr/lib/python3.5/site-packages/pm2ml.py", line 468, in resolve_aur_dependencies
    ver_reqs, sync_pkgs, aur_pkgs, unknown_pkgs = partition_pkgs(h, aur, deps)
  File "/usr/lib/python3.5/site-packages/pm2ml.py", line 391, in partition_pkgs
    aur.info(XCPF.get_required_version_strings(ver_reqs, maybe_aur))
  File "/usr/lib/python3.5/site-packages/pm2ml.py", line 509, in addmany
    for pkg in pkgs:
  File "/usr/lib/python3.5/site-packages/AUR/RPC.py", line 370, in get
    for pkg in self._get(*args, **kwargs):
  File "/usr/lib/python3.5/site-packages/AUR/RPC.py", line 405, in _get
    for pkg in self.mdb.get_nth_field_many(table, format_rpc_args(names)):
  File "/usr/lib/python3.5/site-packages/MemoizeDB.py", line 515, in get_nth_field_many
    for vs in self.get_many(table, keys):
  File "/usr/lib/python3.5/site-packages/MemoizeDB.py", line 486, in get_many
    for key, values in func(uncached_keys):
  File "/usr/lib/python3.5/site-packages/AUR/RPC.py", line 224, in rpc_info
    for pkg in aur_query('info', args):
  File "/usr/lib/python3.5/site-packages/AUR/RPC.py", line 253, in _aur_query_wrapper
    for r in _aur_query(typ, url):
TypeError: 'NoneType' object is not iterable

Last edited by Alad (2016-04-03 19:43:16)

Mods are just community members who have the occasionally necessary option to move threads around and edit posts. -- Trilby

Offline

#62 2016-04-04 03:54:46

Alad
Wiki Admin/IRC Op
From: Bagelstan
Registered: 2014-05-04
Posts: 2,418
Website

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

With the latest updates, it works on both x86_64 and i686. big_smile

One more thing: on x86_64, bauerbill seems to both build x86_64 and i686 make/depends. This doesn't matter besides having an extra package to build, but I wonder if it's expected or not.

Mods are just community members who have the occasionally necessary option to move threads around and edit posts. -- Trilby

Offline

#63 2016-04-04 05:02:36

Xyne
Administrator/PM
Registered: 2008-08-03
Posts: 6,965
Website

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

Thanks for posting everything.

The SRCINFO support was hacked in and needed to be moved deeper into the backend to ensure that all utilities (e.g. pm2ml, which is used for target and dependency resolution) can access the arch-specific data. That required some shuffling and refactoring and I cleaned up a lot of other code while I was at it. Expect more bugs, but it seems to work now.

edit

Alad wrote:

One more thing: on x86_64, bauerbill seems to both build x86_64 and i686 make/depends. This doesn't matter besides having an extra package to build, but I wonder if it's expected or not.

That's unexpected. Either there's an error in the code that determines the Arch-specific deps/makedeps, or there's an error in the package metadata. Which package is it? microchip-mplabxc32-bin?

edit 2
Nvm, I see it. It's pulling in tclkit from makedepends_i686 on x86_64...

edit 3
It's not a bauerbill error: microchip-mplabxc32-bin makedepends on sdx, which in turn directly depends on tclkit on all architectures.

Last edited by Xyne (2016-04-04 05:20:42)

My Arch Linux Stuff • Forum Etiquette • Community Ethos - Arch is not for everyone

Offline

#64 2016-04-04 13:37:57

Alad
Wiki Admin/IRC Op
From: Bagelstan
Registered: 2014-05-04
Posts: 2,418
Website

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

Xyne wrote:

edit 3
It's not a bauerbill error: microchip-mplabxc32-bin makedepends on sdx, which in turn directly depends on tclkit on all architectures.

Ah, thanks for clearing that up. I've complemented the table on the wiki. smile

Mods are just community members who have the occasionally necessary option to move threads around and edit posts. -- Trilby

Offline

#65 2016-04-05 00:11:32

Xyne
Administrator/PM
Registered: 2008-08-03
Posts: 6,965
Website

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

Alad wrote:

Ah, thanks for clearing that up. I've complemented the table on the wiki. smile

I want a fully green row so I've updated pbget to clone AUR Git repos big_smile

My Arch Linux Stuff • Forum Etiquette • Community Ethos - Arch is not for everyone

Offline

#66 2016-04-05 00:43:28

Rasi
Member
From: Germany
Registered: 2007-08-14
Posts: 1,914
Website

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

carnager@caprica ~/Rips > bb-wrapper -Syu --aur-only
Traceback (most recent call last):
  File "/usr/lib/python3.5/runpy.py", line 170, in _run_module_as_main
    "__main__", mod_spec)
  File "/usr/lib/python3.5/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/usr/lib/python3.5/site-packages/Bauerbill.py", line 1112, in <module>
    run_main()
  File "/usr/lib/python3.5/site-packages/Bauerbill.py", line 1095, in run_main
    return main(args)
  File "/usr/lib/python3.5/site-packages/Bauerbill.py", line 1048, in main
    bb.refresh()
  File "/usr/lib/python3.5/site-packages/Bauerbill.py", line 462, in refresh
    if pargs['aur']:
NameError: name 'pargs' is not defined

He hoped and prayed that there wasn't an afterlife. Then he realized there was a contradiction involved here and merely hoped that there wasn't an afterlife.

Douglas Adams

Offline

#67 2016-04-05 00:55:50

Alad
Wiki Admin/IRC Op
From: Bagelstan
Registered: 2014-05-04
Posts: 2,418
Website

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

Xyne wrote:

I want a fully green row so I've updated pbget to clone AUR Git repos big_smile

Nice addition, updated. smile

I've been trying the wiki test-cases with the new bauerbill version (on i686), and have the following results:

aws-cli

It appears it's still downloading the tarballs by default, and it fails on python-botocore with the default bauerbill.json:

loading packages...
resolving dependencies...
looking for conflicting packages...

Packages (1) python-bcdoc-0.14.0-2

Total Installed Size:  0.18 MiB

:: Proceed with installation? [Y/n] checking keyring...
checking package integrity...
loading package files...
checking for file conflicts...
checking available disk space...
:: Processing package changes...
installing python-bcdoc...
~/build
~/build/python-s3transfer ~/build
==> Making package: python-s3transfer 0.0.1-1 (Sun Mar 27 13:04:02 CEST 2016)
==> Checking runtime dependencies...
==> Installing missing dependencies...
error: target not found: python-botocore>=1.3.0
error: target not found: python-botocore<2.0.0
==> ERROR: 'pacman' failed to install missing dependencies.

Log: https://ptpb.pw/22Ol
build.sh: https://ptpb.pw/ROd4
clean.sh: https://ptpb.pw/aofn
download.sh: https://ptpb.pw/JjZs

edit: with --debug: https://ptpb.pw/FukH

python-nikola

Traceback (most recent call last):
  File "/usr/lib/python3.5/runpy.py", line 170, in _run_module_as_main
    "__main__", mod_spec)
  File "/usr/lib/python3.5/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/usr/lib/python3.5/site-packages/Bauerbill.py", line 1112, in <module>
    run_main()
  File "/usr/lib/python3.5/site-packages/Bauerbill.py", line 1095, in run_main
    return main(args)
  File "/usr/lib/python3.5/site-packages/Bauerbill.py", line 1067, in main
    sync_pkgs, sync_deps, build_pkgs, build_deps = bb.get_sync_and_build_targets()
  File "/usr/lib/python3.5/site-packages/Bauerbill.py", line 523, in get_sync_and_build_targets
    pm2ml_pargs,
  File "/usr/lib/python3.5/site-packages/pm2ml.py", line 594, in resolve_targets_from_arguments
    only_needed=pargs.needed,
  File "/usr/lib/python3.5/site-packages/pm2ml.py", line 536, in resolve_targets
    ignoredgroups=ignoredgroups,
  File "/usr/lib/python3.5/site-packages/pm2ml.py", line 459, in resolve_aur_dependencies
    deps = set(d for d in iterate(self.buildable_pkgs(aur_pkgs)) if d not in seen)
  File "/usr/lib/python3.5/site-packages/pm2ml.py", line 459, in <genexpr>
    deps = set(d for d in iterate(self.buildable_pkgs(aur_pkgs)) if d not in seen)
  File "/usr/lib/python3.5/site-packages/pm2ml.py", line 410, in iterate_over_all_uninstalled_deps
    for d in iterate_over_all_deps(pkgs):
  File "/usr/lib/python3.5/site-packages/pm2ml.py", line 105, in iterate_over_all_deps
    for d in pkg.alldeps():
  File "/usr/lib/python3.5/site-packages/XCPF/ArchPkg.py", line 360, in alldeps
    for d in self.deps():
  File "/usr/lib/python3.5/site-packages/AUR/AurPkg.py", line 119, in with_arch_deps
    for d in srcinfo[f]:
TypeError: 'NoneType' object is not subscriptable

For plasma-meta-git, it catches all 105 dependencies (though it took 34s at the first try), but I'll try building it at a later time. tongue

Last edited by Alad (2016-04-05 01:07:41)

Mods are just community members who have the occasionally necessary option to move threads around and edit posts. -- Trilby

Offline

#68 2016-04-05 01:41:43

Xyne
Administrator/PM
Registered: 2008-08-03
Posts: 6,965
Website

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

@Rasi
That should be fixed now.

@Alad
aws-cli works here on x86_64, but it missed a different dep the first time I ran it. Try clearing out the cached data in ~/.cache/AUR and test again. The error for python-nikola was due to trying to retrieve SRCINFO by pkgname instead of pkgbase. That too has been fixed. I haven't tried building either but the generated scripts look ok.

As for still downloading the tarballs, did you update pbget first?

My Arch Linux Stuff • Forum Etiquette • Community Ethos - Arch is not for everyone

Offline

#69 2016-04-05 02:03:05

Alad
Wiki Admin/IRC Op
From: Bagelstan
Registered: 2014-05-04
Posts: 2,418
Website

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

python-nikola builds fine now, but I sometimes have strange messages when installed dependencies are removed:

error: failed to prepare transaction (could not satisfy dependencies)
:: python2-cloudpickle: removing python2-setuptools breaks dependency 'python2-setuptools'
error: failed to prepare transaction (could not satisfy dependencies)
:: python-doit: removing python-pyinotify breaks dependency 'python-pyinotify'
checking dependencies...
error: failed to prepare transaction (could not satisfy dependencies)
:: python-nikola: removing python-pygments breaks dependency 'python-pygments'
:: python-nikola: removing python-pillow breaks dependency 'python-pillow'
:: python-nikola: removing python-docutils breaks dependency 'python-docutils'
:: python-nikola: removing python-mako breaks dependency 'python-mako'
:: python-nikola: removing python-unidecode breaks dependency 'python-unidecode'
:: python-nikola: removing python-lxml breaks dependency 'python-lxml'
:: python-nikola: removing python-dateutil breaks dependency 'python-dateutil'
:: python-nikola: removing python-logbook breaks dependency 'python-logbook'
:: python-nikola: removing python-blinker breaks dependency 'python-blinker'

Log: https://ptpb.pw/nqx0

For aws-cli, I've removed the .cache/AUR folder, but have the same errors as above. Is there more information I can provide?

Regarding the tarballs, I did indeed update pbget:

bauerbill 2016.4.5.1-1
pbget 2016.4.4.1-1
pm2ml 2016.4.5.2-1
powerpill 2016.4.5-1
python3-aur 2016.4.5.2-1
python3-colorsysplus 2015.12-1
python3-memoizedb 2016.4.4-1
python3-xcgf 2016.4.5-1
python3-xcpf 2016.4.5-1
reflector 2015.12-2

Last edited by Alad (2016-04-05 02:40:49)

Mods are just community members who have the occasionally necessary option to move threads around and edit posts. -- Trilby

Offline

#70 2016-04-05 12:39:08

Xyne
Administrator/PM
Registered: 2008-08-03
Posts: 6,965
Website

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

The dependency removal error messages are a bug/limitation in makepkg. It tracks the deps and makedeps that it installs to build the package but it doesn't distinguish between them and tries to remove everything at the end. It reports errors for the deps because they are needed after installing the built package. Blame Allan wink

Bauerbill's cleanup script does essentially the same thing using "pacman -Runs" to try to remove all non-target packages installed by the build script. Pacman correctly determines which packages are necessary and silently(?) skips those.

The aws-cli error was due to incorrect handling of SRCINFO. It should be fixed now.

My Arch Linux Stuff • Forum Etiquette • Community Ethos - Arch is not for everyone

Offline

#71 2016-04-05 13:47:04

Alad
Wiki Admin/IRC Op
From: Bagelstan
Registered: 2014-05-04
Posts: 2,418
Website

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

Xyne wrote:

Blame Allan

Ok, fair enough. wink

Xyne wrote:

The aws-cli error was due to incorrect handling of SRCINFO. It should be fixed now.

git works now, but aws-cli still fails intermittently due to missing dependencies, e.g.

ERROR: Unresolved dependencies: python-guzzle-sphinx-theme
ERROR: Unresolved dependencies: python-behave

(I've first removed ~/.cache/AUR)

Last edited by Alad (2016-04-05 14:11:04)

Mods are just community members who have the occasionally necessary option to move threads around and edit posts. -- Trilby

Offline

#72 2016-04-05 16:02:07

Xyne
Administrator/PM
Registered: 2008-08-03
Posts: 6,965
Website

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

That was a difficult bug to track down but it should be fixed now. Thanks for the extensive testing and reports. smile

My Arch Linux Stuff • Forum Etiquette • Community Ethos - Arch is not for everyone

Offline

#73 2016-04-07 11:45:10

markusk
Member
Registered: 2016-04-07
Posts: 5

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

Hi

had this error for some days ... would be nice if you could take a look.


Installed versions:
bauerbill 2016.4.5.2-1
powerpill 2016.4.5.1-1

bauerbill -Syu --aur                                                                                                                       
Traceback (most recent call last):
  File "/usr/lib/python3.5/runpy.py", line 170, in _run_module_as_main
    "__main__", mod_spec)
  File "/usr/lib/python3.5/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/usr/lib/python3.5/site-packages/Bauerbill.py", line 1124, in <module>
    run_main()
  File "/usr/lib/python3.5/site-packages/Bauerbill.py", line 1107, in run_main
    return main(args)
  File "/usr/lib/python3.5/site-packages/Bauerbill.py", line 1059, in main
    bb.refresh()
  File "/usr/lib/python3.5/site-packages/Bauerbill.py", line 471, in refresh
    Powerpill.refresh_databases(powerpill)
AttributeError: module 'Powerpill' has no attribute 'refresh_databases'

Offline

#74 2016-04-07 17:26:07

Xyne
Administrator/PM
Registered: 2008-08-03
Posts: 6,965
Website

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

Fixed in bauerbill 2016.4.7. Thanks for the report.

My Arch Linux Stuff • Forum Etiquette • Community Ethos - Arch is not for everyone

Offline

#75 2016-04-08 00:39:24

markusk
Member
Registered: 2016-04-07
Posts: 5

Re: Bauerbill reborn: pacman/powerpill+AUR+ABS+configurability

Xyne wrote:

Fixed in bauerbill 2016.4.7. Thanks for the report.


now i get

Installed :
powerpill 2016.4.5.1-1
bauerbill 2016.4.7-1


Ouput
bauerbill -Suy       

Traceback (most recent call last):
  File "/usr/lib/python3.5/runpy.py", line 170, in _run_module_as_main
    "__main__", mod_spec)
  File "/usr/lib/python3.5/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/usr/lib/python3.5/site-packages/Bauerbill.py", line 1124, in <module>
    run_main()
  File "/usr/lib/python3.5/site-packages/Bauerbill.py", line 1107, in run_main
    return main(args)
  File "/usr/lib/python3.5/site-packages/Bauerbill.py", line 1059, in main
    bb.refresh()
  File "/usr/lib/python3.5/site-packages/Bauerbill.py", line 471, in refresh
    self.powerpill.refresh_databases(powerpill)
NameError: name 'powerpill' is not defined

Offline

Pages: 1 2 3 4 5 … 11

Board footer

Powered by FluxBB