[ANNOUNCE] pacboy: automatic repository creation

timgws · 2009-02-02 08:28:07

EDIT: The name is now pacboy.

Hey everyone.

Just wanted to share with you a new piece of software that I am writing that will allow repositories to be created and managed for Arch Linux repositories.

This software, called "pkgman" which is written in PHP and Bash will allow new packages to be compiled, uploaded, verified and offered for download.

pkgman will allow for many really cool things, as you will learn as you read on

pkgman works by having a slightly modified makepkg script, that will log the whole makepkg process. The log file that is outputted will then be md5sum'd, with the md5 hash being stored in the .pkginfo file.

Once makepkg has been completed, the user then runs the bash script 'pkgman-push', which will upload the following three files: PKGINFO, the log file, the built package and a PGP signature.

Once pkgman-push has completed the upload of the three files, the pkgman server will verify the integrity of all four files. If all the files are found to be valid, then the new package will go into a stage of having to be 'signed off' by a specified number of users. Once it has been signed off, the repository database is recreated, the old package deleted and the new one will take it's place.

Now here comes the *really* cool part. Packages are actually never really deleted off the database. Because of this, a user can specify a repository from any point in the past. For example, say if I want to stick with the [core] repository from 2nd Feb 2009, all I would need to do is find what the UNIX time is for that time (in this case, 1233562755) and stick that in my repository path like this:

[core]
Server = http://pkgman.local/repo/core/+1233562755/

When this is done, all packages offered by pacman will only be the packages from that particular point in time. Of course, this would only work on the actual pkgman website, and not on any of the mirrors (unless if Arch does take this up we are lucky to find a mirror that will want to mirror many past packages)

On the pkgman administration site, the admin specifies which users are 'trusted'. Only 'trusted' users can upload packages to the pkgman database.

For the weary user, they can install the view-build-log package, and then view the build log for a specified package(s). For example

view-build-log pacman

will ask pacman what the currently installed version of pacman is, what repository it is from, and then download the build log that matches that version.

Also, on the administration server, the admin can create new architectures, and specify which users have push permissions to what architectures. Only one install of pkgman is required for multiple architectures and multiple repositories.

pkgman will be able to provide dependency tracking, so that for example, a package can not be uploaded to core if it depends on a package in extra.

I will upload some screenshots when I get home from work.

Last edited by timgws (2009-02-02 22:43:46)

Duologic · 2009-02-02 08:44:32

Great stuff, will certainly try it out some time.
If it works well, I would recommend you to the Archlinux-Team.

timgws · 2009-02-02 10:38:28

A screenshot of the repository overview. Notice how on the bottom it lists the different repositories, and shows how they are linked to each other. At the moment, a new repository can only depend on one repository (for example, you can't have a 'bob' repository that depends on both 'james' and 'extra')... I hope to add this feature soon.

This image shows me searching for the package 'bash'. Notice how it shows the current version in the repository, along with information provided by my pkgdesc.

rebugger · 2009-02-02 10:49:18

Nice idea and webgui
But wait a second.... windows screenshot? oO

timgws · 2009-02-02 10:54:38

rebugger wrote:

Nice idea and webgui
But wait a second.... windows screenshot? oO

Har! Yes, the main reason is because I took the screenshots at work Sorry, next time to make you happy I will do it on my Arch install

Mikko777 · 2009-02-02 11:38:45

Look: http://aur.archlinux.org/packages.php?ID=17100

Unless you are donvla the pkgman name is taken

timgws · 2009-02-02 11:45:22

Oh damn, and I registered the domain name and all -.-"

rson451 · 2009-02-02 12:05:17

Just contact donvla and see what he has to say.

dolby · 2009-02-02 12:19:30

pacboy was recently freed though. you can have that one if you want

Last edited by dolby (2009-02-02 15:14:23)

timgws · 2009-02-02 22:43:15

Heh! Well, this time I have google'd the name to make sure, and the new name of the project is pacboy =)

Last edited by timgws (2009-02-02 22:43:25)

Duologic · 2009-02-02 23:39:51

what about the domain name then? (just curious what you plan to do with it)

timgws · 2009-02-03 00:47:02

I am going to give it to donvla.

pyther · 2009-02-03 13:06:39

Shouldn't this be under Community Contributions?

ibendiben · 2009-02-03 13:10:36

There was a repman, automatic repository creation in far past. Created by another Tim:
http://bbs.archlinux.org/viewtopic.php?id=24449
Maybe he still has something useful for you?

skottish · 2009-02-04 23:38:34

Moving to Community Contributions.

timgws · 2009-02-16 01:08:40

Last night I finished the ability to import external repository databases (such as current/extra from Arch) and link the internal repositories to external repositories for dependencies.

Not long before there is a release

Arch Linux

#1 2009-02-02 08:28:07

[ANNOUNCE] pacboy: automatic repository creation

#2 2009-02-02 08:44:32

Re: [ANNOUNCE] pacboy: automatic repository creation

#3 2009-02-02 10:38:28

Re: [ANNOUNCE] pacboy: automatic repository creation

#4 2009-02-02 10:49:18

Re: [ANNOUNCE] pacboy: automatic repository creation

#5 2009-02-02 10:54:38

Re: [ANNOUNCE] pacboy: automatic repository creation

#6 2009-02-02 11:38:45

Re: [ANNOUNCE] pacboy: automatic repository creation

#7 2009-02-02 11:45:22

Re: [ANNOUNCE] pacboy: automatic repository creation

#8 2009-02-02 12:05:17

Re: [ANNOUNCE] pacboy: automatic repository creation

#9 2009-02-02 12:19:30

Re: [ANNOUNCE] pacboy: automatic repository creation

#10 2009-02-02 22:43:15

Re: [ANNOUNCE] pacboy: automatic repository creation

#11 2009-02-02 23:39:51

Re: [ANNOUNCE] pacboy: automatic repository creation

#12 2009-02-03 00:47:02

Re: [ANNOUNCE] pacboy: automatic repository creation

#13 2009-02-03 13:06:39

Re: [ANNOUNCE] pacboy: automatic repository creation

#14 2009-02-03 13:10:36

Re: [ANNOUNCE] pacboy: automatic repository creation

#15 2009-02-04 23:38:34

Re: [ANNOUNCE] pacboy: automatic repository creation

#16 2009-02-16 01:08:40

Re: [ANNOUNCE] pacboy: automatic repository creation

Board footer