You are not logged in.

#1 2021-08-01 06:49:32

voltagex
Member
Registered: 2021-07-11
Posts: 8

Requesting rsync access to archive.archlinux.org

Who runs archive.archlinux.org? I'd like to pull a complete file listing (yes, I know this will be large) to be able to track when certain packages were uploaded, and find older versions. I'd publish any research openly.

At the moment, I get

rsync --list-only rsync://archive.archlinux.org/archive

@ERROR: access denied to archive from UNKNOWN ([my IPv6 address])

Offline

#2 2021-08-01 09:16:15

V1del
Forum Moderator
Registered: 2012-10-16
Posts: 21,420

Re: Requesting rsync access to archive.archlinux.org

It's on archive.org and you can probably use their ia client: https://wiki.archlinux.org/title/Arch_L … al_Archive

Offline

#3 2021-08-01 09:37:45

voltagex
Member
Registered: 2021-07-11
Posts: 8

Re: Requesting rsync access to archive.archlinux.org

Okay, thanks - it'd still be interesting to know what the process for getting rsync access is.

I think grabbing the full dataset would be thousands of requests to archive.org.

Offline

#4 2021-08-01 10:00:19

progandy
Member
Registered: 2012-05-17
Posts: 5,184

Re: Requesting rsync access to archive.archlinux.org

It is impossible to pull a complete file listing from archive.archlinux.org. Packages older than ~2-3 years have been removed and are only available on archive.org.

For archive.org you'll need at least one request per package.

Last edited by progandy (2021-08-01 10:02:56)


| alias CUTF='LANG=en_XX.UTF-8@POSIX ' |

Offline

#5 2021-08-01 11:19:51

voltagex
Member
Registered: 2021-07-11
Posts: 8

Re: Requesting rsync access to archive.archlinux.org

progandy wrote:

It is impossible to pull a complete file listing from archive.archlinux.org. Packages older than ~2-3 years have been removed and are only available on archive.org.

For archive.org you'll need at least one request per package.


Yep, understood.

Offline

Board footer

Powered by FluxBB