Mirrors down?

midian · 2024-01-18 14:59:44

I wanted to sort mirrors with reflector --verbose but it only returned 3 asian domains...

What's happening to arch mirrors today? https://archlinux.org/mirrors/status/#errorlog

Trilby · 2024-01-18 15:12:05

I don't see anything notable on the mirror status page.

What was the actual reflector command used?

midian · 2024-01-18 15:19:19

Trilby wrote:

I don't see anything notable on the mirror status page.
What was the actual reflector command used?

Just "reflector --verbose", it returns:

Server = rsync://rsync.archlinux.nautile.nc/archlinux/$repo/os/$arch
Server = [url]https://mirror.cyberbits.asia/archlinux/$repo/os/$arch[/url]
Server = rsync://rsync.cyberbits.asia/archlinux/$repo/os/$arch

I see a bunch of Name or service not known / Connection timed out errors on the status page...

Last edited by midian (2024-01-18 15:37:55)

d.ALT · 2024-01-18 15:31:51

Mmm... As for now, only 3 mirrors have 100% completion on Successfully Syncing Mirrors list.

https://mirror.cyberbits.asia/archlinux/ 	https 	Thailand 	100.0% 	0:02 	0.66 	0.23 	0.9 	details
rsync://rsync.cyberbits.asia/archlinux/ 	rsync 	Thailand 	100.0% 	0:02 	5.03 	2.67 	7.7 	details
rsync://rsync.archlinux.nautile.nc/archlinux/ 	rsync 	New Caledonia 	100.0% 	1:57 	13.93 	8.68 	24.6 	details

hobnobs · 2024-01-18 16:14:35

Yeah, having reflector problems as well.

xerxes_ · 2024-01-18 17:18:02

"Mirrors apocalypse"? : https://www.snopes.com/fact-check/nasa- … pocalypse/

Trilby · 2024-01-18 17:35:08

Sorry I misunderstood. I read the OP as only three among Asian domains were working, not that only three were working total, and they happened to be Asian domains. Indeed very few mirrors are "complete" at the moment. I gather this would most likely be an error on the top tier mirror(s) perhaps providing a database listing a package without the corresponding package file making it to the server.

(edit: though all the mirrors having *different* sub-100% completion statuses wouldn't seem to fit my hypothesis.)

Last edited by Trilby (2024-01-18 17:38:23)

moson · 2024-01-19 16:07:49

Trilby wrote:

Indeed very few mirrors are "complete" at the moment. I gather this would most likely be an error on the top tier mirror(s) perhaps providing a database listing a package without the corresponding package file making it to the server.

Actually the meaning of "Completion %" is somewhat misleading.
It's not about a mirror being fully synced and having all packages available/up-to-date.

Completion %: The number of mirror checks that have successfully connected and disconnected from the given URL. If this is below 100%, the mirror may be unreliable.

So it's simply an indication of availability rather than being related to the content.

I guess there was some issue with one of the boxes that do perform these connections checks.
Such that it was falsely logging errors although the mirrors were ok.

arnuld · 2024-01-24 02:51:48

I am too having same problems with mirrors from last one week. Pacman has been timing out with many. I use mirrors from Germany,United Kingdom,United States,Switzerland,Singapore

[arnuld@arch64 ~ ]$ sudo systemctl status reflector.service
● reflector.service - Refresh Pacman mirrorlist with Reflector.
     Loaded: loaded (/usr/lib/systemd/system/reflector.service; enabled; preset: disabled)
     Active: activating (start) since Wed 2024-01-24 08:13:24 IST; 6min ago
TriggeredBy: ● reflector.timer
       Docs: https://wiki.archlinux.org/index.php/Reflector
   Main PID: 12726 (reflector)
      Tasks: 1 (limit: 19081)
     Memory: 22.8M (peak: 28.1M)
        CPU: 680ms
     CGroup: /system.slice/reflector.service
             └─12726 /usr/bin/python /usr/bin/reflector @/etc/xdg/reflector/reflector.conf

Jan 24 08:13:24 arch64 systemd[1]: Starting Refresh Pacman mirrorlist with Reflector....
Jan 24 08:15:18 arch64 reflector[12726]: [2024-01-24 08:15:18] WARNING: failed to rate http(s) download (https://archlinux.thaller.ws/extra/os/x86_64/extra.db): Download timed out after 30 second(s).
Jan 24 08:15:57 arch64 reflector[12726]: [2024-01-24 08:15:57] WARNING: failed to rate http(s) download (https://mirror.pseudoform.org/extra/os/x86_64/extra.db): Download timed out after 30 second(s).
Jan 24 08:16:29 arch64 reflector[12726]: [2024-01-24 08:16:29] WARNING: failed to rate http(s) download (https://archlinux.uk.mirror.allworldit.com/archlinux/extra/os/x86_64/extra.db): Download timed out after 30 second(s).
Jan 24 08:17:14 arch64 reflector[12726]: [2024-01-24 08:17:14] WARNING: failed to rate http(s) download (https://america.mirror.pkgbuild.com/extra/os/x86_64/extra.db): Download timed out after 30 second(s).
Jan 24 08:17:50 arch64 reflector[12726]: [2024-01-24 08:17:50] WARNING: failed to rate http(s) download (https://mirror.dal10.us.leaseweb.net/archlinux/extra/os/x86_64/extra.db): Download timed out after 30 second(s).
Jan 24 08:18:22 arch64 reflector[12726]: [2024-01-24 08:18:22] WARNING: failed to rate http(s) download (https://mirror.mia11.us.leaseweb.net/archlinux/extra/os/x86_64/extra.db): Download timed out after 30 second(s).
Jan 24 08:18:54 arch64 reflector[12726]: [2024-01-24 08:18:54] WARNING: failed to rate http(s) download (https://mirrors.niyawe.de/archlinux/extra/os/x86_64/extra.db): Download timed out after 30 second(s).

[arnuld@arch64 ~ ]$ sudo pacman -Syu
:: Synchronizing package databases...
 core is up to date
 extra is up to date
:: Starting full system upgrade...
error: could not parse package description file 'unlambda-0.1.4.2-9/desc' from db 'extra'
error: could not read db 'extra' (Truncated input file (needed 1536 bytes, only 0 available))
error: could not parse package description file 'unlambda-0.1.4.2-9/desc' from db 'extra'
error: could not read db 'extra' (Truncated input file (needed 1536 bytes, only 0 available))
error: could not parse package description file 'unlambda-0.1.4.2-9/desc' from db 'extra'
error: could not read db 'extra' (Truncated input file (needed 1536 bytes, only 0 available))
error: could not parse package description file 'unlambda-0.1.4.2-9/desc' from db 'extra'
error: could not read db 'extra' (Truncated input file (needed 1536 bytes, only 0 available))
error: could not parse package description file 'unlambda-0.1.4.2-9/desc' from db 'extra'
error: could not read db 'extra' (Truncated input file (needed 1536 bytes, only 0 available))
error: could not parse package description file 'unlambda-0.1.4.2-9/desc' from db 'extra'
error: could not read db 'extra' (Truncated input file (needed 1536 bytes, only 0 available))

seth · 2024-01-24 09:43:13

First mirror works fine.
There's either a general issue w/ your network or Modi cut the landlines

Can you

wget -O /dev/null 'https://archlinux.thaller.ws/extra/os/x86_64/extra.db'

at a usable speed?

arnuld · 2024-01-24 18:08:07

I waited for a few hours and pacman -Syu is working fine now.

Regarding wget -O /dev/null 'https://archlinux.thaller.ws/extra/os/x86_64/extra.db'. Right now this is working good too. I will check it when I get same problem again.

Last edited by arnuld (2024-01-24 18:09:04)

arnuld · 2024-01-24 18:23:16

seth wrote:

First mirror works fine.
There's either a general issue w/ your network or Modi cut the landlines
Can you
wget -O /dev/null 'https://archlinux.thaller.ws/extra/os/x86_64/extra.db'
at a usable speed?

The thing is, from last 1 year, I have seen Arch servers to be very slow. Pacman used to download packages at full speed but now it has reduced to 1/10th of it. When I run reflector script from wiki, it is slower too.

[arnuld@arch64 pacman.d ]$ sudo ./reflector.bash
[2024-01-24 23:47:30] INFO: rating 25 mirror(s) by download speed
[2024-01-24 23:47:30] INFO: Server                                                   Rate       Time
[2024-01-24 23:47:40] INFO: http://arch.mirror.constant.com/                 933.18 KiB/s     9.09 s
[2024-01-24 23:48:10] WARNING: failed to rate http(s) download (http://archlinux.thaller.ws/extra/os/x86_64/extra.db): Download timed out after 30 second(s).
[2024-01-24 23:48:10] INFO: http://archlinux.thaller.ws/                       0.00 KiB/s     0.00 s
[2024-01-24 23:48:41] WARNING: failed to rate http(s) download (https://archlinux.thaller.ws/extra/os/x86_64/extra.db): Download timed out after 30 second(s).
[2024-01-24 23:48:41] INFO: https://archlinux.thaller.ws/                      0.00 KiB/s     0.00 s
[2024-01-24 23:49:12] WARNING: failed to rate http(s) download (http://mirror.moson.org/arch/extra/os/x86_64/extra.db): Download timed out after 30 second(s).
[2024-01-24 23:49:12] INFO: http://mirror.moson.org/arch/                      0.00 KiB/s     0.00 s
[2024-01-24 23:49:44] WARNING: failed to rate http(s) download (https://mirror.moson.org/arch/extra/os/x86_64/extra.db): Download timed out after 30 second(s).
[2024-01-24 23:49:44] INFO: https://mirror.moson.org/arch/                     0.00 KiB/s     0.00 s
[2024-01-24 23:50:15] WARNING: failed to rate http(s) download (https://mirror.f4st.host/archlinux/extra/os/x86_64/extra.db): Download timed out after 30 second(s).
[2024-01-24 23:50:15] INFO: https://mirror.f4st.host/archlinux/                0.00 KiB/s     0.00 s
[2024-01-24 23:50:47] WARNING: failed to rate http(s) download (https://mirror.sunred.org/archlinux/extra/os/x86_64/extra.db): Download timed out after 30 second(s).
[2024-01-24 23:50:47] INFO: https://mirror.sunred.org/archlinux/               0.00 KiB/s     0.00 s
[2024-01-24 23:51:18] WARNING: failed to rate http(s) download (http://mirror.ubrco.de/archlinux/extra/os/x86_64/extra.db): Download timed out after 30 second(s).
[2024-01-24 23:51:18] INFO: http://mirror.ubrco.de/archlinux/                  0.00 KiB/s     0.00 s
[2024-01-24 23:51:50] WARNING: failed to rate http(s) download (https://mirror.ubrco.de/archlinux/extra/os/x86_64/extra.db): Download timed out after 30 second(s).
[2024-01-24 23:51:50] INFO: https://mirror.ubrco.de/archlinux/                 0.00 KiB/s     0.00 s
[2024-01-24 23:52:22] WARNING: failed to rate http(s) download (https://mirror.pseudoform.org/extra/os/x86_64/extra.db): Download timed out after 30 second(s).
[2024-01-24 23:52:22] INFO: https://mirror.pseudoform.org/                     0.00 KiB/s     0.00 s
[2024-01-24 23:52:27] INFO: https://de.arch.mirror.kescher.at/              2668.17 KiB/s     3.18 s

Here is my reflector.conf

[arnuld@arch64 ~ ]$ cat /etc/pacman.d/reflector.bash
reflector --verbose \
	  --download-timeout 30 \
	  --ipv4 \
	  --ipv6 \
	  --latest 25 \
	  --fastest 5 \
	  --protocol http,https \
	  --country "Germany,United States,United Kingdom,Switzerland,Singapore" \
	  --sort rate \
	  --save /etc/pacman.d/mirrorlist

Here is the output you wanted:

[arnuld@arch64 ~ ]$ wget -O /dev/null 'https://archlinux.thaller.ws/extra/os/x86_64/extra.db'
--2024-01-24 23:53:36--  https://archlinux.thaller.ws/extra/os/x86_64/extra.db
Loaded CA certificate '/etc/ssl/certs/ca-certificates.crt'
Resolving archlinux.thaller.ws (archlinux.thaller.ws)... 2a01:4f8:272:5154::, 162.55.244.107
Connecting to archlinux.thaller.ws (archlinux.thaller.ws)|2a01:4f8:272:5154::|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 8689530 (8.3M) [application/octet-stream]
Saving to: ‘/dev/null’

/dev/null                                                                9%[===============>                                                                                                                                                           ] 804.00K  17.7KB/s    eta 4m 8s

Last edited by arnuld (2024-01-24 18:24:44)

seth · 2024-01-24 20:34:05

17.7KB/s is ludicrous, Modi jokes aside, could be lousy peering by your ISP.
What if you don't filter for country?

arnuld · 2024-01-25 18:50:15

seth wrote:

17.7KB/s is ludicrous, Modi jokes aside, could be lousy peering by your ISP.

What do you exactly mean by *lousy peering*?

seth wrote:

What if you don't filter for country?

I removed the --country line and ran the script. Absolutely no difference at all

Last edited by arnuld (2024-01-25 18:51:42)

seth · 2024-01-25 19:49:27

https://en.wikipedia.org/wiki/Peering - tl;dr, if your ISP is unwilling to pay freeway tolls and sends you on an offroad detour.

Can you tes the LAN speed, eg. using iperf or a local http/ftp server?

Arch Linux

#1 2024-01-18 14:59:44

Mirrors down?

#2 2024-01-18 15:12:05

Re: Mirrors down?

#3 2024-01-18 15:19:19

Re: Mirrors down?

#4 2024-01-18 15:31:51

Re: Mirrors down?

#5 2024-01-18 16:14:35

Re: Mirrors down?

#6 2024-01-18 17:18:02

Re: Mirrors down?

#7 2024-01-18 17:35:08

Re: Mirrors down?

#8 2024-01-19 16:07:49

Re: Mirrors down?

#9 2024-01-24 02:51:48

Re: Mirrors down?

#10 2024-01-24 09:43:13

Re: Mirrors down?

#11 2024-01-24 18:08:07

Re: Mirrors down?

#12 2024-01-24 18:23:16

Re: Mirrors down?

#13 2024-01-24 20:34:05

Re: Mirrors down?

#14 2024-01-25 18:50:15

Re: Mirrors down?

#15 2024-01-25 19:49:27

Re: Mirrors down?

Board footer