Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

Xyne · 2010-02-04 04:31:54

Um, that's a new feature... you know, to, um, let Arch users see what's going on under the hood. *cough*

Sorry, leftover debugging from the previous update. It's fixed now.

Last edited by Xyne (2010-02-04 06:01:41)

polymetr · 2010-02-04 08:04:12

Xyne wrote:

*) added "Autopatch" option: when trusting a PKGBUILD, it will automatically apply patches found in PatchDir

Have we a possibility to apply a patches to source packages file or only to PKGBUILD?
Is it in plans?

patching file /var/bauerbill/build/build/community/slrn/PKGBUILD
--> patched /var/bauerbill/build/build/community/slrn/PKGBUILD
--> sourcing /var/bauerbill/build/build/community/slrn/PKGBUILD (trusting ABS)
--> resolving openssl... installed
--> resolving slang... installed
--> resolving uudeview... installed
--> detected SRCDEST in /etc/makepkg.conf
--> detected PKGDEST in /etc/makepkg.conf
--> Determining sizes of source files...
--> Building slrn...
==> Making package: slrn 0.9.9p1-5 i686 (Thu Feb 4 10:01:44 EET 2010)
==> Checking Runtime Dependencies...
==> Checking Buildtime Dependencies...
==> Retrieving Sources...
-> Using cached copy of slrn-0.9.9p1.tar.gz
==> ERROR: slrn-0.9.9_p1-minimal_multipart.patch was not found in the build directory and is not a URL.

schuay · 2010-02-04 08:05:09

Xyne wrote:

@schuay
That looks like it's unrelated to bauebill. Post your aliases so I can inspect them.
Just to be sure though, which versions of my packages are you using?

I don't think so, if you take a look at my previous post I also called bauerbill explicitely, without any aliases. Maybe one of the command line switches is no longer valid? It used to work a few days ago.

~]$ pacman -Q bauerbill
bauerbill 0.2-1

~]$ sudo bauerbill --rebase --aur --build-as me --reflect -Syu

Edit: OK, changing the above to

'sudo bauerbill --rebase --aur --build-as me --reflect "" -Syu'

works (notice the "" after --reflect). Haven't read up on reflector so I don't know if it makes sense to call it without arguments..

Last edited by schuay (2010-02-04 08:12:00)

peti · 2010-02-04 10:44:01

After using bauerbill for a while, I have to say that I really like it. Thanks a lot, Xyne, for writing this great tool and for supporting it so actively.

While I'm at it, I have a question about security: I tried to configure bauerbill to perform builds as user "nobody", but it turned out that this won't work, because some part of the process complains about nobody's lack of a password. Of course, nobody doesn't have a password, because that user is not supposed to log in. I don't see why that would be a problem for bauerbill? Ultimately, I ended up runnung builds under my own user, which is fine, but not really optimal, IMHO.

Also, I noticed that bauerbill does most of the things it does as user 'root', and only switches to the unpriviledged user when building packages. Wouldn't it be better to do things the other way round? I.e., to run bauerbill under an unprivileged user id, and to have it use sudo(1) to perform those operations that need special privileges as root, and only those? Yourt worked this way, and that seemed to work fine. For instance, I don't see why downloads with aria2c would have to be run as 'root', but currently they are.

sr · 2010-02-04 13:32:33

Sorry if someone's asked this before, but is it possible to use bauerbill with xargs?

At the moment, it seems to just go into infinite loops of printing the view/backup/... line if I do something like

echo xcursor-premium | xargs sudo bauerbill -S

If the answer's no, that's perfectly fine (I can rewrite that part of the script), but I was wondering if I'd missed a trick somewhere.

Xyne · 2010-02-04 17:27:19

@polymetr
Yes, I intend to extend patching to all builds in the build directory.

I don't understand what you wanted to show with your output.

@schuay
Sorry, I hadn't noticed the "--reflect" option in your example. It's a parametric option and you need to pass it a string of reflector arguments (or an empty string to turn it off).

@peti
I'll look into the "nobody" issue. Please post the actual output of bauerbill "complaining" so that I can see what the problem is.

It does more than just build packages as non-root. It drops root privileges for taurball extractions, sourcing PKGBUILDs (even that that's safe with the parser it uses), and a few other things by changing the euid and egid of the process.

It runs aria2c as root to enable it to write to the default cache. The same applies to the pkgd step, I will probably change this to detect the required privileges for the given cache. It also uses root to set permissions on some directories but I'm in the process or rethinking some of that.

It can't work exactly as yaourt because it doesn't invoke other applications for everything that it does, which yaourt, as a bash script, does. The way I've done it avoids making sudo a dependency as well.

Feel free to look through the code and suggest changes. The functions "&unsu()" and "$self->drop_root_privileges_or_exit()" will show you where it's regaining and dropping root privileges.

@sr
I don't know exactly how xargs works but I can look into it. I suspect that it won't work with bauerbill though because I think it usurps STDIN completely. It'll probably be better to rewrite the script using a "bauerbill $(your code)" construction.

slysir · 2010-02-04 18:58:06

I have been banging on bauerbill & friends for the last 4 days and basically its been working good. Caught a couple glitches:
>>bauerbill -Qu
CPAN/perl-xml-namespacesupport 1.09-4 -> 1.10
CPAN/perl-xml-libxml 1.69-2 -> 1.70
CPAN/perl-datetime-timezone 1.09-1 -> 1.10

>>bauerbill -Syu
--> Getting trusted user package lists...
--> Searching for upgradable repo packages...
--> Searching for upgradable AUR packages...
--> Searching for upgradable CPAN packages...
--> Loading CPAN taurball data...
--> resolving perl-xml-namespacesupport>=1.07... installed
--> resolving perl-xml-sax>=0.11... installed
--> resolving perl-extutils-makemaker... installed (provided by perl)
--> resolving perl-class-singleton>=1.03... installed
--> resolving perl-cwd>=3... found on CPAN (PathTools -> perl-pathtools)
--> resolving perl-params-validate>=0.72... installed
--> resolving perl-pod-man>=1.14... found on CPAN (podlators -> perl-podlators)
--> resolving perl-module-build... installed (provided by perl)
error: unable to remove /tmp/bauerbill/pacpan/META.yml/PathTools (Permission denied)

>>ls META.yml/*
META.yml/DateTime-TimeZone:
1.10

META.yml/XML-LibXML:
1.70

META.yml/XML-NamespaceSupport:
1.10

As you can see PathTools has been removed and the pkgs are still there.

Xyne · 2010-02-04 21:26:39

@peti
I see the same password change requirement here when trying to use "nobody" as the builder. I see the exact same thing when I directly try to su into nobody though, so it's not a bauerbill-related issue.

You can always create a restricted user for building if you don't want to use your own.

@slyir
That came up in the pacpan thread too. Remove /tmp/bauerbill and then try again. I changed some of the permission handling recently and it maybe be due to vestigial permissions. If the problem persists then I'll look into it.

slysir · 2010-02-04 22:03:42

Same result after removing /tmp/bauerbill

Xyne · 2010-02-04 22:17:16

Update to the latest versions of perl-xyne-arch and perl-xyne-common on my site and let me know if that works.

*edit*
Try removing /tmp/bauerbill again if it doesn't.

Last edited by Xyne (2010-02-04 22:17:40)

slysir · 2010-02-04 22:59:35

[2010-02-04 17:49] upgraded perl-xyne-common (1.0.10-1 -> 1.0.11-1)
[2010-02-04 17:49] upgraded perl-xyne-arch (1.2.8-1 -> 1.2.9-1)

>>bauerbill -Syu
--> Getting trusted user package lists...
--> Searching for upgradable repo packages...
--> Searching for upgradable AUR packages...
--> Searching for upgradable CPAN packages...
--> Loading CPAN taurball data...
--> resolving perl-xml-namespacesupport>=1.07... installed
--> resolving perl-xml-sax>=0.11... installed
--> resolving perl-extutils-makemaker... installed (provided by perl)
--> resolving perl-class-singleton>=1.03... installed
--> resolving perl-cwd>=3... found on CPAN (PathTools -> perl-pathtools)
--> resolving perl-params-validate>=0.72... installed
--> resolving perl-pod-man>=1.14... found on CPAN (podlators -> perl-podlators)
--> resolving perl-module-build... installed (provided by perl)
error: failed to create /tmp/bauerbill/pacpan/META.yml/PathTools (No such file or directory)

17:56 >>ls /tmp/bauerbill/pacpan/META.yml
DateTime-TimeZone XML-LibXML XML-NamespaceSupport

Xyne · 2010-02-04 23:46:29

Try it again with the latest versions.

If it doesn't work, post the output of this script, before and after removing /tmp/bauerbill:

#!/usr/bin/perl
use strict;
use warnings;

use Xyne::Arch::CPAN;
use File::Basename qw/basename dirname/;
use LWP::Simple;


my $cpan = Xyne::Arch::CPAN->new();
$cpan->maybe_load_database;
&mirror_meta_yaml($cpan,'PathTools');

sub mirror_meta_yaml
{
  my ($self,$distribution) = @_;
  my $meta_url = $self->get_meta_yaml_url($distribution);
  my $fpath = $self->get_meta_yaml_fpath($distribution);
  my $dpath = dirname($fpath);
  if (-d $dpath)
  {
    print "$dpath exists... cleaning up...\n";
    if (opendir(my $dh,$dpath))
    {
      my $filename = basename($fpath);
      foreach my $i (readdir($dh))
      {
        next if $i eq '.' or $i eq '..';
        unlink &join_paths($dpath,$i) if $i ne $filename;
      }
      closedir($dh);
    }
  }
  else
  {
    print "creating $dpath...\n";
    my $e = mkdir_p($dpath);
    if ($e)
    {
      print STDERR "error: failed to create $dpath ($e)\n";
      exit(1);
    }
  }
  my $e = &mirror($meta_url,$fpath);
  # If the file has changed, the corresponding checksums may have also changed
  # so we flag the checksums file to make sure that it's mirrored upon next access.
  if ($e != 304)
  {
    my ($a,$f) = $self->get_author_path_and_filename($distribution);
    my $fp = $self->get_checksums_fpath($a).'.check';
    if (not -f $fp)
    {
      my $fh;
      open($fh,'>',$fp) and close($fh);
    }
  }
  return ($e,$distribution);
}

sub mkdir_p
{
  my ($path) = @_;
  my $start = '';
  my $e;
  foreach my $step (split /\/+/,$path)
  {
    next if not $step;
    $start .= '/' . $step;
    print "checking $start... ";
    if (-d $start)
    {
      print "exists\n";
    }
    else
    {
      print "creating... ";
      if (mkdir $start)
      {
        print "success\n";
      }
      else
      {
        $e = $!;
        print "failed: $!\n";
      }
    }
    if (not -d $start)
    {
      print "giving up\n";
      return $e;
    }
  }
}

Also post the output of

 ls -l /tmp | grep bauerbill; ls -lR /tmp/bauerbill

so I can see how the permissions are set.

slysir · 2010-02-05 00:06:39

[2010-02-04 18:54] upgraded perl-xyne-arch (1.2.9-1 -> 1.2.10-1)

>>bauerbill -Syyu
--> Rebasing...
--> updated [core] +0 ^0 -0

--> updated [extra] +0 ^0 -0

--> updated [xyne-any] +0 ^0 -0

--> Getting trusted user package lists...
--> Searching for upgradable repo packages...
--> Searching for upgradable AUR packages...
--> Searching for upgradable CPAN packages...
--> Loading CPAN taurball data...
--> resolving perl-xml-namespacesupport>=1.07... installed
--> resolving perl-xml-sax>=0.11... installed
--> resolving perl-extutils-makemaker... installed (provided by perl)
--> resolving perl-class-singleton>=1.03... installed
--> resolving perl-cwd>=3... found on CPAN (PathTools -> perl-pathtools)
--> resolving perl-params-validate>=0.72... installed
--> resolving perl-pod-man>=1.14... found on CPAN (podlators -> perl-podlators)
--> resolving perl-module-build... installed (provided by perl)
--> resolving perl-carp... found on CPAN (perl -> perl)
--> resolving perl-file-basename... found on CPAN (perl -> perl)
--> resolving perl-file-path... installed (provided by perl)
--> resolving perl-scalar-util... found in AUR
--> resolving perl-test... installed (provided by perl)
WARNING: about to source /tmp/bauerbill/build/AUR/perl-scalar-util/PKGBUILD
error: unable to edit /tmp/bauerbill/build/AUR/perl-scalar-util/PKGBUILD (permission denied)

...............................................................................
>> ls -l /tmp | grep bauerbill; ls -lR /tmp/bauerbill
drwxrwxrwx 5 root root 4096 2010-02-04 18:55 bauerbill
/tmp/bauerbill:
total 12
drwxr-xr-x 4 root root 4096 2010-02-04 18:55 build
drwxrwxrwx 4 root root 4096 2010-02-04 18:55 pacpan
drwxr-xr-x 3 mike users 4096 2010-02-04 18:55 taurballs

/tmp/bauerbill/build:
total 8
drwxr-xr-x 3 mike users 4096 2010-02-04 18:55 AUR
drwxr-xr-x 7 root root 4096 2010-02-04 18:55 CPAN

/tmp/bauerbill/build/AUR:
total 4
drwxr-xr-x 2 root root 4096 2009-05-22 14:50 perl-scalar-util

/tmp/bauerbill/build/AUR/perl-scalar-util:
total 4
-rw-r--r-- 1 root root 1560 2009-05-22 14:50 PKGBUILD

/tmp/bauerbill/build/CPAN:
total 20
drwxr-xr-x 2 mike users 4096 2010-02-04 18:55 perl
drwxr-xr-x 2 mike users 4096 2010-02-04 18:55 perl-datetime-timezone
drwxr-xr-x 2 mike users 4096 2010-02-04 18:55 perl-pathtools
drwxr-xr-x 2 mike users 4096 2010-02-04 18:55 perl-xml-libxml
drwxr-xr-x 2 mike users 4096 2010-02-04 18:55 perl-xml-namespacesupport

/tmp/bauerbill/build/CPAN/perl:
total 4
-rw-r--r-- 1 mike users 4044 2010-02-04 18:55 PKGBUILD

/tmp/bauerbill/build/CPAN/perl-datetime-timezone:
total 20
-rw-r--r-- 1 mike users 18378 2010-02-04 18:55 PKGBUILD

/tmp/bauerbill/build/CPAN/perl-pathtools:
total 4
-rw-r--r-- 1 mike users 1697 2010-02-04 18:55 PKGBUILD

/tmp/bauerbill/build/CPAN/perl-xml-libxml:
total 4
-rw-r--r-- 1 mike users 1842 2010-02-04 18:55 PKGBUILD

/tmp/bauerbill/build/CPAN/perl-xml-namespacesupport:
total 4
-rw-r--r-- 1 mike users 1340 2010-02-04 18:55 PKGBUILD

/tmp/bauerbill/pacpan:
total 7408
-rw-rw-rw- 1 root root 3358471 2010-02-04 17:32 01modules.index.html
-rw-rw-rw- 1 root root 861651 2010-02-04 18:46 02packages.details.txt.gz
drwxr-xr-x 5 mike users 4096 2010-02-04 18:55 CHECKSUMS
-rw-rw-rw- 1 root root 3352867 2010-02-04 18:55 CPAN_database
drwxr-xr-x 7 mike users 4096 2010-02-04 18:55 META.yml

/tmp/bauerbill/pacpan/CHECKSUMS:
total 12
drwxr-xr-x 4 mike users 4096 2010-02-04 18:55 D
drwxr-xr-x 4 mike users 4096 2010-02-04 18:55 P
drwxr-xr-x 3 mike users 4096 2010-02-04 18:55 S

/tmp/bauerbill/pacpan/CHECKSUMS/D:
total 8
drwxr-xr-x 3 mike users 4096 2010-02-04 18:55 DA
drwxr-xr-x 3 mike users 4096 2010-02-04 18:55 DR

/tmp/bauerbill/pacpan/CHECKSUMS/D/DA:
total 4
drwxr-xr-x 2 mike users 4096 2010-02-04 18:55 DAPM

/tmp/bauerbill/pacpan/CHECKSUMS/D/DA/DAPM:
total 4
-rw-r--r-- 1 mike users 2813 2009-08-24 10:23 CHECKSUMS

/tmp/bauerbill/pacpan/CHECKSUMS/D/DR:
total 4
drwxr-xr-x 2 mike users 4096 2010-02-04 18:55 DROLSKY

/tmp/bauerbill/pacpan/CHECKSUMS/D/DR/DROLSKY:
total 308
-rw-r--r-- 1 mike users 312055 2010-01-29 22:17 CHECKSUMS

/tmp/bauerbill/pacpan/CHECKSUMS/P:
total 8
drwxr-xr-x 3 mike users 4096 2010-02-04 18:55 PA
drwxr-xr-x 3 mike users 4096 2010-02-04 18:55 PE

/tmp/bauerbill/pacpan/CHECKSUMS/P/PA:
total 4
drwxr-xr-x 2 mike users 4096 2010-02-04 18:55 PAJAS

/tmp/bauerbill/pacpan/CHECKSUMS/P/PA/PAJAS:
total 24
-rw-r--r-- 1 mike users 22988 2009-10-08 15:31 CHECKSUMS

/tmp/bauerbill/pacpan/CHECKSUMS/P/PE:
total 4
drwxr-xr-x 2 mike users 4096 2010-02-04 18:55 PERIGRIN

/tmp/bauerbill/pacpan/CHECKSUMS/P/PE/PERIGRIN:
total 32
-rw-r--r-- 1 mike users 28852 2010-01-30 20:31 CHECKSUMS

/tmp/bauerbill/pacpan/CHECKSUMS/S:
total 4
drwxr-xr-x 3 mike users 4096 2010-02-04 18:55 SM

/tmp/bauerbill/pacpan/CHECKSUMS/S/SM:
total 4
drwxr-xr-x 2 mike users 4096 2010-02-04 18:55 SMUELLER

/tmp/bauerbill/pacpan/CHECKSUMS/S/SM/SMUELLER:
total 96
-rw-r--r-- 1 mike users 98249 2010-02-04 12:29 CHECKSUMS

/tmp/bauerbill/pacpan/META.yml:
total 20
drwxr-xr-x 2 mike users 4096 2010-02-04 18:55 DateTime-TimeZone
drwxr-xr-x 2 mike users 4096 2010-02-04 18:55 PathTools
drwxr-xr-x 2 mike users 4096 2010-02-04 18:55 perl
drwxr-xr-x 2 mike users 4096 2010-02-04 18:55 XML-LibXML
drwxr-xr-x 2 mike users 4096 2010-02-04 18:55 XML-NamespaceSupport

/tmp/bauerbill/pacpan/META.yml/DateTime-TimeZone:
total 40
-rw-r--r-- 1 mike users 38170 2010-01-25 13:35 1.10

/tmp/bauerbill/pacpan/META.yml/PathTools:
total 4
-rw-r--r-- 1 mike users 578 2009-11-01 11:35 3.31

/tmp/bauerbill/pacpan/META.yml/perl:
total 16
-rw-r--r-- 1 mike users 15384 2009-08-23 15:35 5.10.1

/tmp/bauerbill/pacpan/META.yml/XML-LibXML:
total 4
-rw-r--r-- 1 mike users 594 2009-10-07 09:35 1.70

/tmp/bauerbill/pacpan/META.yml/XML-NamespaceSupport:
total 4
-rw-r--r-- 1 mike users 316 2009-06-12 13:35 1.10

/tmp/bauerbill/taurballs:
total 4
drwxr-xr-x 2 root root 4096 2010-02-04 18:55 AUR

/tmp/bauerbill/taurballs/AUR:
total 4
-rw-r--r-- 1 root root 888 2009-05-22 14:50 perl-scalar-util.tar.gz
18:58 >> /tmp

..........................................................................................
>sudo ./testbauerbill.sh
/tmp/bauerbill/pacpan/META.yml/PathTools exists... cleaning up...

then >>rm -r /tmp/bauerbill

>sudo ./testbauerbill.sh
creating /tmp/bauerbill/pacpan/META.yml/PathTools...
checking /tmp... exists
checking /tmp/bauerbill... exists
checking /tmp/bauerbill/pacpan... exists
checking /tmp/bauerbill/pacpan/META.yml... creating... success
checking /tmp/bauerbill/pacpan/META.yml/PathTools... creating... success

Xyne · 2010-02-05 00:59:18

Please use the code tags when you post code. It makes it much easier to read and takes up less space on the page.

I've made some more changes. Make sure that you remove /tmp/bauerbill again before running it. If it doesn't work this time I'll have to thoroughly review the permissions scheme.

skottish · 2010-02-05 01:59:13

Xyne wrote:

Um, that's a new feature... you know, to, um, let Arch users see what's going on under the hood. *cough*
Sorry, leftover debugging from the previous update. It's fixed now.

Thanks. All is well on my end.

slysir · 2010-02-05 02:45:38

Xyne wrote:

Please use the code tags when you post code. It makes it much easier to read and takes up less space on the page.
I've made some more changes. Make sure that you remove /tmp/bauerbill again before running it. If it doesn't work this time I'll have to thoroughly review the permissions scheme.

[2010-02-04 21:12] upgraded perl-xyne-arch (1.2.10-1 -> 1.2.11-1)

>>bauerbill -Syyu
--> Rebasing...
--> updated [core] +0 ^0 -0

--> updated [extra] +0 ^0 -0

--> updated [xyne-any] +0 ^0 -0

--> updated [community] +0 ^0 -0

--> Getting trusted user package lists...
--> Searching for upgradable repo packages...
--> Searching for upgradable AUR packages...
--> Searching for upgradable CPAN packages...
--> Loading CPAN taurball data...
--> resolving perl-xml-namespacesupport>=1.07... installed
--> resolving perl-xml-sax>=0.11... installed
--> resolving perl-extutils-makemaker... installed (provided by perl)
--> resolving perl-class-singleton>=1.03... installed
--> resolving perl-cwd>=3... found on CPAN (PathTools -> perl-pathtools)
--> resolving perl-params-validate>=0.72... installed
--> resolving perl-pod-man>=1.14... found on CPAN (podlators -> perl-podlators)
--> resolving perl-module-build... installed (provided by perl)
--> resolving perl-carp... found on CPAN (perl -> perl)
--> resolving perl-file-basename... found on CPAN (perl -> perl)
--> resolving perl-file-path... installed (provided by perl)
--> resolving perl-scalar-util... found in AUR
--> resolving perl-test... installed (provided by perl)
WARNING: about to source /tmp/bauerbill/build/AUR/perl-scalar-util/PKGBUILD
error: unable to edit /tmp/bauerbill/build/AUR/perl-scalar-util/PKGBUILD (permission denied)

then listing /tmp/bauerbill

 >>ls -l /tmp | grep bauerbill; ls -lR /tmp/bauerbill
drwxrwxrwx 5 root root  4096 2010-02-04 21:13 bauerbill
/tmp/bauerbill:
total 12
drwxr-xr-x 4 root root  4096 2010-02-04 21:13 build
drwxrwxrwx 4 root root  4096 2010-02-04 21:13 pacpan
drwxr-xr-x 3 mike users 4096 2010-02-04 21:13 taurballs

/tmp/bauerbill/build:
total 8
drwxr-xr-x 3 mike users 4096 2010-02-04 21:13 AUR
drwxr-xr-x 7 root root  4096 2010-02-04 21:13 CPAN

/tmp/bauerbill/build/AUR:
total 4
drwxr-xr-x 2 root root 4096 2009-05-22 14:50 perl-scalar-util

/tmp/bauerbill/build/AUR/perl-scalar-util:
total 4
-rw-r--r-- 1 root root 1560 2009-05-22 14:50 PKGBUILD

/tmp/bauerbill/build/CPAN:
total 20
drwxr-xr-x 2 mike users 4096 2010-02-04 21:13 perl
drwxr-xr-x 2 mike users 4096 2010-02-04 21:13 perl-datetime-timezone
drwxr-xr-x 2 mike users 4096 2010-02-04 21:13 perl-pathtools
drwxr-xr-x 2 mike users 4096 2010-02-04 21:13 perl-xml-libxml
drwxr-xr-x 2 mike users 4096 2010-02-04 21:13 perl-xml-namespacesupport

/tmp/bauerbill/build/CPAN/perl:
total 4
-rw-r--r-- 1 mike users 4044 2010-02-04 21:13 PKGBUILD

/tmp/bauerbill/build/CPAN/perl-datetime-timezone:
total 20
-rw-r--r-- 1 mike users 18378 2010-02-04 21:13 PKGBUILD

/tmp/bauerbill/build/CPAN/perl-pathtools:
total 4
-rw-r--r-- 1 mike users 1697 2010-02-04 21:13 PKGBUILD

/tmp/bauerbill/build/CPAN/perl-xml-libxml:
total 4
-rw-r--r-- 1 mike users 1842 2010-02-04 21:13 PKGBUILD

/tmp/bauerbill/build/CPAN/perl-xml-namespacesupport:
total 4
-rw-r--r-- 1 mike users 1340 2010-02-04 21:13 PKGBUILD

/tmp/bauerbill/pacpan:
total 7408
-rw-rw-rw- 1 root root  3358456 2010-02-04 20:49 01modules.index.html
-rw-rw-rw- 1 root root   861668 2010-02-04 19:43 02packages.details.txt.gz
drwxr-xr-x 5 mike users    4096 2010-02-04 21:13 CHECKSUMS
-rw-rw-rw- 1 root root  3352867 2010-02-04 21:12 CPAN_database
drwxr-xr-x 7 mike users    4096 2010-02-04 21:13 META.yml

/tmp/bauerbill/pacpan/CHECKSUMS:
total 12
drwxr-xr-x 4 mike users 4096 2010-02-04 21:13 D
drwxr-xr-x 4 mike users 4096 2010-02-04 21:13 P
drwxr-xr-x 3 mike users 4096 2010-02-04 21:13 S

/tmp/bauerbill/pacpan/CHECKSUMS/D:
total 8
drwxr-xr-x 3 mike users 4096 2010-02-04 21:13 DA
drwxr-xr-x 3 mike users 4096 2010-02-04 21:13 DR

/tmp/bauerbill/pacpan/CHECKSUMS/D/DA:
total 4
drwxr-xr-x 2 mike users 4096 2010-02-04 21:13 DAPM

/tmp/bauerbill/pacpan/CHECKSUMS/D/DA/DAPM:
total 4
-rw-r--r-- 1 mike users 2813 2009-08-24 10:23 CHECKSUMS

/tmp/bauerbill/pacpan/CHECKSUMS/D/DR:
total 4
drwxr-xr-x 2 mike users 4096 2010-02-04 21:13 DROLSKY

/tmp/bauerbill/pacpan/CHECKSUMS/D/DR/DROLSKY:
total 308
-rw-r--r-- 1 mike users 312055 2010-01-29 22:17 CHECKSUMS

/tmp/bauerbill/pacpan/CHECKSUMS/P:
total 8
drwxr-xr-x 3 mike users 4096 2010-02-04 21:13 PA
drwxr-xr-x 3 mike users 4096 2010-02-04 21:13 PE

/tmp/bauerbill/pacpan/CHECKSUMS/P/PA:
total 4
drwxr-xr-x 2 mike users 4096 2010-02-04 21:13 PAJAS

/tmp/bauerbill/pacpan/CHECKSUMS/P/PA/PAJAS:
total 24
-rw-r--r-- 1 mike users 22988 2009-10-08 08:31 CHECKSUMS

/tmp/bauerbill/pacpan/CHECKSUMS/P/PE:
total 4
drwxr-xr-x 2 mike users 4096 2010-02-04 21:13 PERIGRIN

/tmp/bauerbill/pacpan/CHECKSUMS/P/PE/PERIGRIN:
total 32
-rw-r--r-- 1 mike users 28852 2010-01-30 20:31 CHECKSUMS

/tmp/bauerbill/pacpan/CHECKSUMS/S:
total 4
drwxr-xr-x 3 mike users 4096 2010-02-04 21:13 SM

/tmp/bauerbill/pacpan/CHECKSUMS/S/SM:
total 4
drwxr-xr-x 2 mike users 4096 2010-02-04 21:13 SMUELLER

/tmp/bauerbill/pacpan/CHECKSUMS/S/SM/SMUELLER:
total 96
-rw-r--r-- 1 mike users 98249 2010-02-04 12:29 CHECKSUMS

/tmp/bauerbill/pacpan/META.yml:
total 20
drwxr-xr-x 2 mike users 4096 2010-02-04 21:13 DateTime-TimeZone
drwxr-xr-x 2 mike users 4096 2010-02-04 21:13 PathTools
drwxr-xr-x 2 mike users 4096 2010-02-04 21:13 perl
drwxr-xr-x 2 mike users 4096 2010-02-04 21:13 XML-LibXML
drwxr-xr-x 2 mike users 4096 2010-02-04 21:13 XML-NamespaceSupport

/tmp/bauerbill/pacpan/META.yml/DateTime-TimeZone:
total 40
-rw-r--r-- 1 mike users 38170 2010-01-25 13:35 1.10

/tmp/bauerbill/pacpan/META.yml/PathTools:
total 4
-rw-r--r-- 1 mike users 578 2009-11-01 11:35 3.31

/tmp/bauerbill/pacpan/META.yml/perl:
total 16
-rw-r--r-- 1 mike users 15384 2009-08-23 15:35 5.10.1

/tmp/bauerbill/pacpan/META.yml/XML-LibXML:
total 4
-rw-r--r-- 1 mike users 594 2009-10-07 09:35 1.70

/tmp/bauerbill/pacpan/META.yml/XML-NamespaceSupport:
total 4
-rw-r--r-- 1 mike users 316 2009-06-12 13:35 1.10

/tmp/bauerbill/taurballs:
total 4
drwxr-xr-x 2 mike users 4096 2010-02-04 21:13 AUR

/tmp/bauerbill/taurballs/AUR:
total 4
-rw-r--r-- 1 mike users 888 2009-05-22 14:50 perl-scalar-util.tar.gz

and runnin the test script before and after removing /tmp/bauerbill

 >sudo ./testbauerbill.sh
/tmp/bauerbill/pacpan/META.yml/PathTools exists... cleaning up...
>rm -r bauerbill

21:26 >sudo ./testbauerbill.sh
creating /tmp/bauerbill/pacpan/META.yml/PathTools...
checking /tmp... exists
checking /tmp/bauerbill... exists
checking /tmp/bauerbill/pacpan... exists
checking /tmp/bauerbill/pacpan/META.yml... creating... success
checking /tmp/bauerbill/pacpan/META.yml/PathTools... creating... success

Xyne · 2010-02-05 02:57:26

Those directories should be be owned by root. Can you just confirm that you first tried "rm -fr /tmp/bauerbill"?

slysir · 2010-02-05 03:02:19

Xyne wrote:

Those directories should be be owned by root. Can you just confirm that you first tried "rm -fr /tmp/bauerbill"?

  >>rm -r /tmp/bauerbill
22:00 >>rm -r /tmp/bauerbill
rm: cannot remove `/tmp/bauerbill': No such file or directory
22:00 >>bauerbill -Syyu
--> Rebasing...
--> updated [core] +0 ^0 -0

--> updated [extra] +0 ^0 -0

--> updated [xyne-any] +0 ^0 -0

--> updated [community] +0 ^0 -0

--> Getting trusted user package lists...
--> Searching for upgradable repo packages...
--> Searching for upgradable AUR packages...
--> Searching for upgradable CPAN packages...
--> Loading CPAN taurball data...
--> resolving perl-xml-namespacesupport>=1.07... installed
--> resolving perl-xml-sax>=0.11... installed
--> resolving perl-extutils-makemaker... installed (provided by perl)
--> resolving perl-class-singleton>=1.03... installed
--> resolving perl-cwd>=3... found on CPAN (PathTools -> perl-pathtools)
--> resolving perl-params-validate>=0.72... installed
--> resolving perl-pod-man>=1.14... found on CPAN (podlators -> perl-podlators)
--> resolving perl-module-build... installed (provided by perl)
--> resolving perl-carp... found on CPAN (perl -> perl)
--> resolving perl-file-basename... found on CPAN (perl -> perl)
--> resolving perl-file-path... installed (provided by perl)
--> resolving perl-scalar-util... found in AUR
--> resolving perl-test... installed (provided by perl)
WARNING: about to source /tmp/bauerbill/build/AUR/perl-scalar-util/PKGBUILD
error: unable to edit /tmp/bauerbill/build/AUR/perl-scalar-util/PKGBUILD (permission denied)

Same results as before.

Xyne · 2010-02-05 03:37:14

*sigh*

Run it as a regular user for now. I'll post again once I've looked into more, but I have a few other things to do so I might not get to it for a while.

xyrico · 2010-02-05 06:11:22

I'm having the same problem as above. I'm posting a log of following the steps recommended above in case it can be of any help.

[root@Tortillicus stan]# bauerbill -Syyu
:: Synchronizing package databases...
 testing                   46.3K   70.2K/s 00:00:01 [#####################] 100%
 community-testing          1.5K  719.0K/s 00:00:00 [#####################] 100%
 core                      36.3K   92.9K/s 00:00:00 [#####################] 100%
 extra                    445.8K   61.5K/s 00:00:07 [#####################] 100%
 xyne-any                   5.3K   97.3K/s 00:00:00 [#####################] 100%
 community                363.7K   60.5K/s 00:00:06 [#####################] 100%
--> Searching for upgradable repo packages...
--> Searching for upgradable AUR packages...
--> Loading AUR taurball data...
WARNING: about to source /tmp/bauerbill/build/AUR/utorrent/PKGBUILD
error: unable to edit /tmp/bauerbill/build/AUR/utorrent/PKGBUILD (permission denied)
[root@Tortillicus stan]# ls -l /tmp | grep bauerbill; ls -lR /tmp/bauerbill
drwxr-xr-x 4 root root  4096 Feb  4 22:01 bauerbill
/tmp/bauerbill:
total 8
drwxr-xr-x 3 root root  4096 Feb  4 22:01 build
drwxr-xr-x 3 stan users 4096 Feb  4 22:01 taurballs

/tmp/bauerbill/build:
total 4
drwxr-xr-x 3 stan users 4096 Feb  4 22:01 AUR

/tmp/bauerbill/build/AUR:
total 4
drwxr-xr-x 2 root root 4096 Dec 31  1969 utorrent

/tmp/bauerbill/build/AUR/utorrent:
total 32
-rw-r--r-- 1 root root 4963 Jan  1  1970 icons.tar.gz
-rw-r--r-- 1 root root 1615 Jan  1  1970 PKGBUILD
-rw-r--r-- 1 root root 1745 Jan  1  1970 settings.dat
-rw-r--r-- 1 root root  398 Jan  1  1970 utorrent
-rw-r--r-- 1 root root  184 Jan  1  1970 utorrent.desktop
-rw-r--r-- 1 root root 4688 Jan  1  1970 wine-executor.c

/tmp/bauerbill/taurballs:
total 4
drwxr-xr-x 2 root root 4096 Feb  4 22:01 AUR

/tmp/bauerbill/taurballs/AUR:
total 12
-rw-r--r-- 1 root root 9148 Feb  4 08:57 utorrent.tar.gz
[root@Tortillicus stan]# ./bbcheck
creating /tmp/bauerbill/pacpan/META.yml/PathTools...
checking /tmp... exists
checking /tmp/bauerbill... exists
checking /tmp/bauerbill/pacpan... exists
checking /tmp/bauerbill/pacpan/META.yml... creating... success
checking /tmp/bauerbill/pacpan/META.yml/PathTools... creating... success
[root@Tortillicus stan]# rm -rfv /tmp/bauerbill
removed `/tmp/bauerbill/taurballs/AUR/utorrent.tar.gz'
removed directory: `/tmp/bauerbill/taurballs/AUR'
removed directory: `/tmp/bauerbill/taurballs'
removed `/tmp/bauerbill/build/AUR/utorrent/settings.dat'
removed `/tmp/bauerbill/build/AUR/utorrent/icons.tar.gz'
removed `/tmp/bauerbill/build/AUR/utorrent/PKGBUILD'
removed `/tmp/bauerbill/build/AUR/utorrent/utorrent'
removed `/tmp/bauerbill/build/AUR/utorrent/utorrent.desktop'
removed `/tmp/bauerbill/build/AUR/utorrent/wine-executor.c'
removed directory: `/tmp/bauerbill/build/AUR/utorrent'
removed directory: `/tmp/bauerbill/build/AUR'
removed directory: `/tmp/bauerbill/build'
removed `/tmp/bauerbill/pacpan/02packages.details.txt.gz'
removed `/tmp/bauerbill/pacpan/01modules.index.html'
removed `/tmp/bauerbill/pacpan/META.yml/PathTools/3.31'
removed directory: `/tmp/bauerbill/pacpan/META.yml/PathTools'
removed directory: `/tmp/bauerbill/pacpan/META.yml'
removed `/tmp/bauerbill/pacpan/CPAN_database'
removed directory: `/tmp/bauerbill/pacpan'
removed directory: `/tmp/bauerbill'
[root@Tortillicus stan]# ./bbcheck
creating /tmp/bauerbill/pacpan/META.yml/PathTools...
checking /tmp... exists
checking /tmp/bauerbill... exists
checking /tmp/bauerbill/pacpan... exists
checking /tmp/bauerbill/pacpan/META.yml... creating... success
checking /tmp/bauerbill/pacpan/META.yml/PathTools... creating... success
[root@Tortillicus stan]# bauerbill -Syyu
:: Synchronizing package databases...
 testing                   46.3K  110.8K/s 00:00:00 [#####################] 100%
 community-testing          1.5K  806.6K/s 00:00:00 [#####################] 100%
 core                      36.3K  137.4K/s 00:00:00 [#####################] 100%
 extra                    445.8K   58.8K/s 00:00:08 [#####################] 100%
 xyne-any                   5.3K   81.5K/s 00:00:00 [#####################] 100%
 community                363.7K   62.2K/s 00:00:06 [#####################] 100%
--> Searching for upgradable repo packages...
--> Searching for upgradable AUR packages...
--> Loading AUR taurball data...
WARNING: about to source /tmp/bauerbill/build/AUR/utorrent/PKGBUILD
error: unable to edit /tmp/bauerbill/build/AUR/utorrent/PKGBUILD (permission denied)
[root@Tortillicus stan]#

Xyne · 2010-02-05 11:34:50

Ok, this should be fixed now (I've also cleaned up permission handling in general).

@slysir & xyrico
Please confirm that the latest versions of perl-xyne-arch and perl-xyne-common work as expected.

I'm sorry that it took so long to debug... I had been testing code with sudo but needed to run as true root to see them.

polymetr · 2010-02-05 12:15:20

I can confirm a bug with ( unable to edit PKGBUILD (permission denied)) went away.

One question. Have we a possibility to update all AUR packages which are compiled
from git, svn, mercurial source? As it is in yaourt -

 yaourt -Syu --devel

There is just a check:

for PKG in $(pacman -Qq | grep "\-\(svn\|cvs\|hg\|git\|bzr\|darcs\)"); do

slysir · 2010-02-05 12:29:09

Xyne wrote:

Ok, this should be fixed now (I've also cleaned up permission handling in general).
@slysir & xyrico
Please confirm that the latest versions of perl-xyne-arch and perl-xyne-common work as expected.
I'm sorry that it took so long to debug... I had been testing code with sudo but needed to run as true root to see them.

[2010-02-05 07:16] upgraded perl-xyne-arch (1.2.11-1 -> 1.2.12-1)
[2010-02-05 07:16] upgraded perl-xyne-common (1.0.11-1 -> 1.0.12-1)

7:13 >>rm -r bauerbill
7:14 >>rm -r bauerbill
rm: cannot remove `bauerbill': No such file or directory

7:18 >>rm /var/lib/pacman/db.lck
7:18 >>l /var/lib/pacman/db.lck
ls: cannot access /var/lib/pacman/db.lck: No such file or directory

Running as root or user gives the same error:

sudo bauerbill -Syyu
--> Rebasing...
--> updated [core] +0 ^0 -0

--> updated [extra] +0 ^0 -0

--> updated [xyne-any] +0 ^0 -0


^ community/apvlv 0.0.9.2-1 -> 0.0.9.3-1
^ community/dina-font 2.89-3 -> 2.89-5
+ community/exim 4.69-3
^ community/freetds 0.82-2 -> 0.82-3
^ community/gyachi 1.2.2b-2 -> 1.2.3-1
^ community/jogl 1.1.1-5 -> 1.1.1-6
^ community/leafnode 1.11.7-2 -> 1.11.7-3
+ community/libcuefile 453-1
+ community/libreplaygain 453-1
^ community/musepack-tools 1.15v-1 -> 435-1
^ community/ngspice 19-1 -> 20-1
^ community/python-scipy 0.7.1-3 -> 0.7.1-4
^ community/quassel 0.5.1-1 -> 0.5.2-1
+ community/stunnel 4.31-1
^ community/torcs 1.3.1-3 -> 1.3.1-4
+ community/torcs-data 1.3.1-3
^ community/vala 0.7.9-1 -> 0.7.10-1
--> updated [community] +5 ^12 -0

error: failed to unlock database (Permission denied)

Xyne · 2010-02-05 14:02:34

@polymetr
I've added "--devel". Thanks for posting the regex code snippet.

@slysir
At least it's a different error

I forgot about the logging function. That's the second time I've done that too (due to the way it's nested). Everything should work now.

polymetr · 2010-02-05 14:35:32

@Xyne
Thanks.
@slysir
I had same error:

--> updated [arch-games] +0 ^11 -0
error: failed to unlock database

sudo rm /var/lib/pacman/db.lck

Arch Linux

#326 2010-02-04 04:31:54

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#327 2010-02-04 08:04:12

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#328 2010-02-04 08:05:09

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#329 2010-02-04 10:44:01

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#330 2010-02-04 13:32:33

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#331 2010-02-04 17:27:19

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#332 2010-02-04 18:58:06

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#333 2010-02-04 21:26:39

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#334 2010-02-04 22:03:42

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#335 2010-02-04 22:17:16

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#336 2010-02-04 22:59:35

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#337 2010-02-04 23:46:29

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#338 2010-02-05 00:06:39

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#339 2010-02-05 00:59:18

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#340 2010-02-05 01:59:13

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#341 2010-02-05 02:45:38

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#342 2010-02-05 02:57:26

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#343 2010-02-05 03:02:19

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#344 2010-02-05 03:37:14

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#345 2010-02-05 06:11:22

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#346 2010-02-05 11:34:50

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#347 2010-02-05 12:15:20

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#348 2010-02-05 12:29:09

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#349 2010-02-05 14:02:34

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

#350 2010-02-05 14:35:32

Re: Bauerbill: Powerpill + ABS, AUR, CPAN and Hackage support + more

Board footer