ftp.archlinux.org having problems?

mmccaskill · 2006-09-27 20:17:53

It could just be my internet connection at work, but for the last few hours I've been getting timeouts. Is there a problem with the FTP?

colnago · 2006-09-27 20:19:54

Yeah, I am having problems too.

jskier · 2006-09-27 20:34:23

It's definitely messed up.

apeiro · 2006-09-28 20:40:05

You guys are swamping the main FTP servers (over 100 connections right now).

Mirrors!

Snarkout · 2006-09-29 02:24:20

apeiro wrote:

You guys are swamping the main FTP servers (over 100 connections right now).
Mirrors!

What's involved with hosting a mirror? What kind of pipe does one usually require? Box specs? I imagine there's someplace to find all this info - someone want to whoop some knowledge on me?

soloport · 2006-09-29 22:18:59

Another question: If we are to use a mirror, how does one measure how good a mirror is? Which are the good, the bad and the ugly ones? Was using a mirror for a while. Then noticed some packages were days to weeks out of date. So, will have to conduct a little survey this weekend and switch again. Will measure download speed and up-to-date-ness (and report back, of course). Any other metrics to measure? Thanks.

scarecrow · 2006-09-30 00:11:52

I use ftp.ntua.gr which is fast (VERY fast) for my region, and normally less than one day behind...

Snowman · 2006-09-30 02:54:14

I'm currently using http://mirror.cs.vt.edu (up-to-date and fast) since ftp.nethat.com started giving me problems.

soloport · 2006-10-01 05:36:48

Checked out as many mirrors as I could find (front page of archlinux.org, searching forums a little and looking at the list in the wiki). Must explain at this point that 'rsync' is all that was looked at, so many sites were immediately "disqualified". Some of the remaining sites either showed no sign of hosting an Arch mirror or were so disorganized in their presentation of published directories that I simply couldn't find where they were mirroring Arch.

One interesting note: All remaining mirrors seemed to do a very fine job of keeping up-to-date. The following test was used (today is 2006/09/30):

$ rsync cle.linux.org.tw::pub/pub/ArchLinux/current/os/i686/ | grep 'openssl'
-rw-rw-r--     2240779 2006/09/29 01:45:53 openssl-0.9.8d-1.pkg.tar.gz

The results of downloading the above file are as follows (target is 8Mbps cable modem in the NW of US):

**** mirror.pacific.net.au ****
sent 124 bytes  received 398 bytes  208.80 bytes/sec
total size is 2240779  speedup is 4292.68

**** gd.tuwien.ac.at ****
sent 126 bytes  received 1072 bytes  479.20 bytes/sec
total size is 2240779  speedup is 1870.43

**** ftp.belnet.be ****
sent 128 bytes  received 798 bytes  370.40 bytes/sec
total size is 2240779  speedup is 2419.85

**** ftp.sh.cvut.cz ****
sent 114 bytes  received 962 bytes  430.40 bytes/sec
total size is 2240779  speedup is 2082.51

**** mir1.archlinuxfr.org ****
sent 124 bytes  received 103 bytes  64.86 bytes/sec
total size is 2240779  speedup is 9871.27

**** ftp.hosteurope.de ****
sent 124 bytes  received 250 bytes  149.60 bytes/sec
total size is 2240779  speedup is 5991.39

**** ftp.heanet.ie ****
sent 138 bytes  received 124 bytes  104.80 bytes/sec
total size is 2240779  speedup is 8552.59

**** mi.mirror.garr.it ****
sent 130 bytes  received 468 bytes  239.20 bytes/sec
total size is 2240779  speedup is 3747.12

**** mirror.icis.pcz.pl ****
sent 130 bytes  received 371 bytes  200.40 bytes/sec
total size is 2240779  speedup is 4472.61

**** darkstar.ist.utl.pt ****
sent 122 bytes  received 538 bytes  188.57 bytes/sec
total size is 2240779  speedup is 3395.12

**** ftp.iasi.roedu.net ****
sent 134 bytes  received 828 bytes  274.86 bytes/sec
total size is 2240779  speedup is 2329.29

**** cle.linux.org.tw ****
sent 122 bytes  received 106 bytes  91.20 bytes/sec
total size is 2240779  speedup is 9827.98

**** ftp.ibiblio.org ****
sent 138 bytes  received 951 bytes  726.00 bytes/sec
total size is 2240779  speedup is 2057.65

Ok, so I realize this isn't the greatest test (i.e. one file doesn't say much), but it's a start. I promise to do more analysis, soon, FWIW.

The hardest part was figuring out everyone's idea of where to put Arch (pub/, mirror/, linux/, archlinux/)

#!/bin/bash
echo "**** mirror.pacific.net.au ****"
rsync -avz mirror.pacific.net.au::archlinux/current/os/i686/openssl-0.9.8d-1.pkg.tar.gz .
echo "**** gd.tuwien.ac.at ****"
rsync -avz gd.tuwien.ac.at::linux/archlinux/current/os/i686/openssl-0.9.8d-1.pkg.tar.gz .
echo "**** ftp.belnet.be ****"
rsync -avz ftp.belnet.be::packages/archlinux/current/os/i686/openssl-0.9.8d-1.pkg.tar.gz .
echo "**** ftp.sh.cvut.cz ****"
rsync -avz ftp.sh.cvut.cz::arch/current/os/i686/openssl-0.9.8d-1.pkg.tar.gz .
echo "**** mir1.archlinuxfr.org ****"
rsync -avz mir1.archlinuxfr.org::archlinux/current/os/i686/openssl-0.9.8d-1.pkg.tar.gz .
echo "**** ftp.hosteurope.de ****"
rsync -avz ftp.hosteurope.de::archlinux/current/os/i686/openssl-0.9.8d-1.pkg.tar.gz .
echo "**** ftp.heanet.ie ****"
rsync -avz ftp.heanet.ie::mirrors/ftp.archlinux.org/current/os/i686/openssl-0.9.8d-1.pkg.tar.gz .
echo "**** mi.mirror.garr.it ****"
rsync -avz mi.mirror.garr.it::archlinux/current/os/i686/openssl-0.9.8d-1.pkg.tar.gz .
echo "**** mirror.icis.pcz.pl ****"
rsync -avz mirror.icis.pcz.pl::archlinux/current/os/i686/openssl-0.9.8d-1.pkg.tar.gz .
echo "**** darkstar.ist.utl.pt ****"
rsync -avz darkstar.ist.utl.pt::pub/archlinux/current/os/i686/openssl-0.9.8d-1.pkg.tar.gz .
echo "**** ftp.iasi.roedu.net ****"
rsync -avz ftp.iasi.roedu.net::mirrors/archlinux.org/current/os/i686/openssl-0.9.8d-1.pkg.tar.gz .
echo "**** cle.linux.org.tw ****"
rsync -avz cle.linux.org.tw::pub/pub/ArchLinux/current/os/i686/openssl-0.9.8d-1.pkg.tar.gz .
echo "**** ftp.ibiblio.org ****"
rsync -avz ftp.ibiblio.org::pub/linux/distributions/archlinux/current/os/i686/openssl-0.9.8d-1.pkg.tar.gz .

Snarkout · 2006-10-01 06:19:45

Snarkout wrote:

apeiro wrote:
You guys are swamping the main FTP servers (over 100 connections right now).
Mirrors!
What's involved with hosting a mirror? What kind of pipe does one usually require? Box specs? I imagine there's someplace to find all this info - someone want to whoop some knowledge on me?

OK, I guess I'll ask on the mailing list.

Arch Linux

#1 2006-09-27 20:17:53

ftp.archlinux.org having problems?

#2 2006-09-27 20:19:54

Re: ftp.archlinux.org having problems?

#3 2006-09-27 20:34:23

Re: ftp.archlinux.org having problems?

#4 2006-09-28 20:40:05

Re: ftp.archlinux.org having problems?

#5 2006-09-29 02:24:20

Re: ftp.archlinux.org having problems?

#6 2006-09-29 22:18:59

Re: ftp.archlinux.org having problems?

#7 2006-09-30 00:11:52

Re: ftp.archlinux.org having problems?

#8 2006-09-30 02:54:14

Re: ftp.archlinux.org having problems?

#9 2006-10-01 05:36:48

Re: ftp.archlinux.org having problems?

#10 2006-10-01 06:19:45

Re: ftp.archlinux.org having problems?

Board footer