Is it possible to rsync the official databases?

Xyne · 2009-02-11 20:19:02

It seems unnecessary that every time the database is updated, all of the database files get overwritten with new ones from the tarball. Aside from unnecessary IO, doesn't it increase the overall bandwidth cost for the servers? Even uncompressed, I would expect the amount of data that would need to be transferred per average sync interval to be less than the entire database.

Is there any way to implement an rsync-based system like ABS uses to sync the ABS tree? Is there any glaringly obvious reason why this is a bad idea (tbh I haven't given it very much thought).

If not, is there any other way to access the official databases in uncompressed format? (ftp/http/svn/etc)

Allan · 2009-02-11 21:19:59

As far as I know, this is not possible. Currently it uses libdownload/libfetch to get files (by default) and there is no uncompress database available.

Xyne · 2009-02-15 23:36:06

Thanks Allan (I somehow missed your reply despite having subscribed to this thread).

I ended up using the compressed db.tar.gz files to do what I wanted (for rebase).

Last edited by Xyne (2009-02-15 23:36:25)

Arch Linux

#1 2009-02-11 20:19:02

Is it possible to rsync the official databases?

#2 2009-02-11 21:19:59

Re: Is it possible to rsync the official databases?

#3 2009-02-15 23:36:06

Re: Is it possible to rsync the official databases?

Board footer