Backup of AUR?

test1000 · 2009-02-20 12:56:08

AUR has been down twice for me in a little while. Do we have any backup of the AUR, it would be nice not to lose 12200+ packages

Vintendo · 2009-02-20 13:41:07

A good point, is the server properly backed up, because the wiki has a lot of useful information and it would be a shame if there would be a gentoo-wiki like fiasco. I still miss that wiki...

jordz · 2009-02-20 13:53:13

Some time ago, the whole arch server was down and I remember there was something on the MLs about backing up the wiki/AUR. But no idea if somebody is mirroring it or something

test1000 · 2009-02-20 14:14:45

ok. so there's aur-sync in the aur, a third-party utility that backups all of aur to /var/abs/unsupported. I don't think depending on some random user for backup of the aur is a good thing though. It should be built in, but ill run it so the aur can be saved if something happens. It will probably take hours/days to run though

Last edited by test1000 (2009-02-20 14:16:08)

Ranguvar · 2009-02-20 15:08:56

IMHO the AUR will need mirrors in the near future as it gets bigger and bigger, so that will handle the backup issue

test1000 · 2009-02-20 18:41:19

ok so i mirrored aur. it didn't take so long.. about an hour on a 400-450kbps connection. i hope we will get mirrors though

cactus · 2009-02-21 00:41:39

the aur was down because of a change in dns.

toofishes · 2009-02-21 00:50:22

test1000 wrote:

ok. so there's aur-sync in the aur, a third-party utility that backups all of aur to /var/abs/unsupported. I don't think depending on some random user for backup of the aur is a good thing though. It should be built in, but ill run it so the aur can be saved if something happens. It will probably take hours/days to run though

Yes, just what we need, 80 users hammering HTTP pulling down the entire AUR...

There are much more efficient ways of getting the whole thing, from a tarball to possible rsync access. If these are really wanted, please open (but search first!) for a feature request asking for something like this, rather than doing something manually like this.

test1000 · 2009-02-21 02:10:01

no problem.

Xyne · 2009-02-21 02:12:56

I would recommend rsync. I think it would scale much better tarballing the whole AUR.

fukawi2 · 2009-02-21 20:40:47

How big is the AUR in byte terms?

haxit · 2009-02-21 21:30:46

fukawi2 wrote:

How big is the AUR in byte terms?

I am intrested in this also. I will mirror it to my computer onto my external hd.

test1000 · 2009-02-22 21:39:50

it's 516Kb. I don't think you need to mirror it to any external hd.. all that will do is reduce your write speed and drag out the time spent requesting from the server

fukawi2 · 2009-02-22 21:50:41

516Kb? Geez, I'm happy to mirror that via rsync or something to my VPS. I think I can spare that amount of space Plus it's got gigabit network connectivity AFAIK.

haxit · 2009-02-22 22:10:18

fukawi2 wrote:

516Kb? Geez, I'm happy to mirror that via rsync or something to my VPS. I think I can spare that amount of space Plus it's got gigabit network connectivity AFAIK.

It is not 516kb....

fukawi2 · 2009-02-22 22:29:35

I thought that was a bit small... Any advances on 516Kb?

pressh · 2009-02-22 22:40:53

unsupported is ~368M, but please recall what toofishes said

toofishes wrote:

Yes, just what we need, 80 users hammering HTTP pulling down the entire AUR...
There are much more efficient ways of getting the whole thing, from a tarball to possible rsync access. If these are really wanted, please open (but search first!) for a feature request asking for something like this, rather than doing something manually like this.

Last edited by pressh (2009-02-22 22:41:45)

stefanwilkens · 2009-02-23 00:02:50

those seem like values easy to backup by sysadmins tbh I'm more concerned about the repos than the aur, lol

fukawi2 · 2009-02-23 01:39:54

stefanwilkens wrote:

tbh I'm more concerned about the repos than the aur, lol

The repos are mirrored by dozens of ISP's and mirroring services around the globe... I reckon they're pretty safe.

The AUR has no 'official' mirroring though -- I'm happy to host a backup of the AUR if the admins want to make arrangements to allow me to rsync it or something. Not sure if I could truely mirror it due to bandwidth (only got 200gb/month on my VPS, but I can spare ~368mb of disk space)

test1000 · 2009-02-23 03:02:44

lol

louipc · 2009-02-23 03:28:28

test1000 wrote:

AUR has been down twice for me in a little while. Do we have any backup of the AUR, it would be nice not to lose 12200+ packages

Just because the site is down doesn't mean the packages are in any danger.
And if people do start pulling down the whole collection willy, nilly there'll be no point in Arch hosting the AUR any more. The source code is available, you can host your own AUR then.

dolby · 2009-02-23 07:59:38

Dropping in just to add a different note

Besides the AUR code, i dont think there is something worth preserving there.
Packages with actual use will get uploaded again after a potential crash as people probably have backups in their hard drives.

Arch Linux

#1 2009-02-20 12:56:08

Backup of AUR?

#2 2009-02-20 13:41:07

Re: Backup of AUR?

#3 2009-02-20 13:53:13

Re: Backup of AUR?

#4 2009-02-20 14:14:45

Re: Backup of AUR?

#5 2009-02-20 15:08:56

Re: Backup of AUR?

#6 2009-02-20 18:41:19

Re: Backup of AUR?

#7 2009-02-21 00:41:39

Re: Backup of AUR?

#8 2009-02-21 00:50:22

Re: Backup of AUR?

#9 2009-02-21 02:10:01

Re: Backup of AUR?

#10 2009-02-21 02:12:56

Re: Backup of AUR?

#11 2009-02-21 20:40:47

Re: Backup of AUR?

#12 2009-02-21 21:30:46

Re: Backup of AUR?

#13 2009-02-22 21:39:50

Re: Backup of AUR?

#14 2009-02-22 21:50:41

Re: Backup of AUR?

#15 2009-02-22 22:10:18

Re: Backup of AUR?

#16 2009-02-22 22:29:35

Re: Backup of AUR?

#17 2009-02-22 22:40:53

Re: Backup of AUR?

#18 2009-02-23 00:02:50

Re: Backup of AUR?

#19 2009-02-23 01:39:54

Re: Backup of AUR?

#20 2009-02-23 03:02:44

Re: Backup of AUR?

#21 2009-02-23 03:28:28

Re: Backup of AUR?

#22 2009-02-23 07:59:38

Re: Backup of AUR?

Board footer