[SOLVED] How to use reflector and not get download timed out error.

LinuxLover471 · 2025-02-24 07:18:08

Hi, I noticed that my download speeds were mediocre, so I decided to increase it by using reflector. I looked on the wiki and looked at a few examples and tweaked the commands to my liking, but whenever I use the command I get

[2025-02-24 12:42:46] WARNING: failed to rate http(s) download (https://"mirror"): Download timed out after 5 second(s).

I used

sudo reflector -country India --latest 5 --protocol https --sort rate --save /etc/pacman.d/mirrorlist

But after this, or whatever modification I make, the command always fails.

Is there any way so that reflector removes any mirrors that don't work and save the ones that work with the highest speeds?

Thanks,
LL

Last edited by LinuxLover471 (2025-08-05 03:38:11)

Lone_Wolf · 2025-02-24 11:47:43

Look closely at the command you posted, it misses one - in a critical spot .

LinuxLover471 · 2025-02-24 13:11:42

Lone_Wolf wrote:

Look closely at the command you posted, it misses one - in a critical spot .

Thanks for your suggestion, but it seems like after doing this I still got the same output, sorry for posting the command in a wrong way.

Here is the output after I fixed it-

[ak@ak-G31M-ES2L ~]$ sudo reflector --country India --latest 5 --protocol https --sort rate --save /etc/pacman.d/mirrorlist
[2025-02-24 18:40:54] WARNING: failed to rate http(s) download (https://in.arch.niranjan.co/extra/os/x86_64/extra.db): Download timed out after 5 second(s).
[2025-02-24 18:41:05] WARNING: failed to rate http(s) download (https://mirror.albony.in/archlinux/extra/os/x86_64/extra.db): Download timed out after 5 second(s).
[2025-02-24 18:41:11] WARNING: failed to rate http(s) download (https://mirror.maa.albony.in/archlinux/extra/os/x86_64/extra.db): Download timed out after 5 second(s).
[2025-02-24 18:41:16] WARNING: failed to rate http(s) download (https://mirror.nag.albony.in/archlinux/extra/os/x86_64/extra.db): Download timed out after 5 second(s).
[2025-02-24 18:41:24] WARNING: failed to rate http(s) download (https://mirror.sahil.world/archlinux/extra/os/x86_64/extra.db): Download timed out after 5 second(s).
[ak@ak-G31M-ES2L ~]$

Thanks,
LL

Last edited by LinuxLover471 (2025-02-24 13:13:25)

schard · 2025-02-24 13:23:56

So where's your problem?

LinuxLover471 wrote:

Is there any way so that reflector removes any mirrors that don't work and save the ones that work with the highest speeds?

reflector could not rate the respective mirrors because they were too slow and hence issues the respective warnings.
The top 5 latest mirrors should be listed in /etc/pacman.d/mirrorlist nonetheless.

Edit: That being said, you probably don't want the 5 latest mirrors, since you sort by rating, but the top 5 rated ones instead.
So you might want to use -n 5 instead of --latest 5.

Last edited by schard (2025-02-24 13:27:19)

LinuxLover471 · 2025-02-24 13:36:16

schard wrote:

So where's your problem?
LinuxLover471 wrote:
Is there any way so that reflector removes any mirrors that don't work and save the ones that work with the highest speeds?
reflector could not rate the respective mirrors because they were too slow and hence issues the respective warnings.
The top 5 latest mirrors should be listed in /etc/pacman.d/mirrorlist nonetheless.
Edit: That being said, you probably don't want the 5 latest mirrors, since you sort by rating, but the top 5 rated ones instead.
So you might want to use -n 5 instead of --latest 5.

Hi, I did try -n instead of --latest but I tried with 10 and it reported with only 9 mirrors, I think this is the max amount of mirrors my country has. But the error still persists even if I try using --download-timeout 10 option.-

[ak@ak-G31M-ES2L ~]$ sudo reflector --country India --n 10 --p https --sort rate
[2025-02-24 19:02:25] WARNING: failed to rate http(s) download (https://in.mirrors.cicku.me/archlinux/extra/os/x86_64/extra.db): Download timed out after 5 second(s).
[2025-02-24 19:02:31] WARNING: failed to rate http(s) download (https://mirror.albony.in/archlinux/extra/os/x86_64/extra.db): Download timed out after 5 second(s).
[2025-02-24 19:02:37] WARNING: failed to rate http(s) download (https://mirror.maa.albony.in/archlinux/extra/os/x86_64/extra.db): Download timed out after 5 second(s).
^C[ak@ak-G31M-ES2L ~]$ sudo reflector --country India -n 10 --p https --sort rate
[2025-02-24 19:02:48] WARNING: failed to rate http(s) download (https://in.mirrors.cicku.me/archlinux/extra/os/x86_64/extra.db): Download timed out after 5 second(s).
[2025-02-24 19:02:55] WARNING: failed to rate http(s) download (https://mirror.albony.in/archlinux/extra/os/x86_64/extra.db): Download timed out after 5 second(s).
[2025-02-24 19:03:00] WARNING: failed to rate http(s) download (https://mirror.maa.albony.in/archlinux/extra/os/x86_64/extra.db): Download timed out after 5 second(s).
[2025-02-24 19:03:06] WARNING: failed to rate http(s) download (https://mirror.nag.albony.in/archlinux/extra/os/x86_64/extra.db): Download timed out after 5 second(s).
[2025-02-24 19:03:12] WARNING: failed to rate http(s) download (https://mirror.sahil.world/archlinux/extra/os/x86_64/extra.db): Download timed out after 5 second(s).
[2025-02-24 19:03:17] WARNING: failed to rate http(s) download (https://mirrors.nxtgen.com/archlinux-mirror/extra/os/x86_64/extra.db): Download timed out after 5 second(s).
[2025-02-24 19:03:23] WARNING: failed to rate http(s) download (https://mirrors.abhy.me/archlinux/extra/os/x86_64/extra.db): Download timed out after 5 second(s).
[2025-02-24 19:03:30] WARNING: failed to rate http(s) download (https://in.arch.niranjan.co/extra/os/x86_64/extra.db): Download timed out after 5 second(s).
[2025-02-24 19:03:36] WARNING: failed to rate http(s) download (https://mirrors.saswata.cc/archlinux/extra/os/x86_64/extra.db): Download timed out after 5 second(s).
################################################################################
################# Arch Linux mirrorlist generated by Reflector #################
################################################################################

# With:       reflector --country India -n 10 --p https --sort rate
# When:       2025-02-24 13:33:36 UTC
# From:       https://archlinux.org/mirrors/status/json/
# Retrieved:  2025-02-24 13:32:19 UTC
# Last Check: 2025-02-24 13:16:26 UTC

Server = https://in.mirrors.cicku.me/archlinux/$repo/os/$arch
Server = https://mirror.albony.in/archlinux/$repo/os/$arch
Server = https://mirror.maa.albony.in/archlinux/$repo/os/$arch
Server = https://mirror.nag.albony.in/archlinux/$repo/os/$arch
Server = https://mirror.sahil.world/archlinux/$repo/os/$arch
Server = https://mirrors.nxtgen.com/archlinux-mirror/$repo/os/$arch
Server = https://mirrors.abhy.me/archlinux/$repo/os/$arch
Server = https://in.arch.niranjan.co/$repo/os/$arch
Server = https://mirrors.saswata.cc/archlinux/$repo/os/$arch

Thanks,
LL

Last edited by LinuxLover471 (2025-02-24 13:37:06)

schard · 2025-02-24 13:58:59

There are no errors. The mirrors in question are too slow to be rated within the given timeout.
The top mirrors are correctly written to your mirror lists file.
In your case it appears that unfortunately all mirrors are too slow to download the database within five seconds.
You can try to increase the download timeouts, but this won't make the mirrors any faster for you.
Not limiting yourself to a certain country might increase your chance of fining a mirror with acceptable speed.

seth · 2025-02-24 14:30:59

curl -vL 'https://in.mirrors.cicku.me/archlinux/extra/os/x86_64/extra.db' > /dev/null

The mirror respond fine for me…

LinuxLover471 · 2025-02-25 06:54:43

seth wrote:

curl -vL 'https://in.mirrors.cicku.me/archlinux/extra/os/x86_64/extra.db' > /dev/null

The mirror respond fine for me…

I also tried the command, and it is transmitting data!

Also even after removing the country flag, it is still timing out and increasing the timer has no effect.

Thanks,
LL

seth · 2025-02-25 08:57:45

and it is transmitting data!

The idea was for your to post the output and also how long does it take to download the file (or until the download actually starts)?

LinuxLover471 · 2025-02-25 09:32:47

seth wrote:

and it is transmitting data!
The idea was for your to post the output and also how long does it take to download the file (or until the download actually starts)?

Sorry, here is the output-

[ak@ak-G31M-ES2L ~]$ curl -vL 'https://in.mirrors.cicku.me/archlinux/extra/os/x86_64/extra.db' > /dev/null
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0* Host in.mirrors.cicku.me:443 was resolved.
* IPv6: 2606:4700:78::90:0:83, 2606:4700:78::90:0:80, 2606:4700:78::90:0:82, 2606:4700:78::90:0:81
* IPv4: 172.65.90.8, 172.65.90.9, 172.65.90.11, 172.65.90.10
*   Trying [2606:4700:78::90:0:83]:443...
* ALPN: curl offers h2,http/1.1
} [5 bytes data]
* TLSv1.3 (OUT), TLS handshake, Client hello (1):
} [512 bytes data]
*  CAfile: /etc/ssl/certs/ca-certificates.crt
*  CApath: none
{ [5 bytes data]
* TLSv1.3 (IN), TLS handshake, Server hello (2):
{ [122 bytes data]
* TLSv1.3 (IN), TLS change cipher, Change cipher spec (1):
{ [1 bytes data]
* TLSv1.3 (IN), TLS handshake, Encrypted Extensions (8):
{ [19 bytes data]
* TLSv1.3 (IN), TLS handshake, Certificate (11):
{ [2755 bytes data]
* TLSv1.3 (IN), TLS handshake, CERT verify (15):
{ [79 bytes data]
* TLSv1.3 (IN), TLS handshake, Finished (20):
{ [52 bytes data]
* TLSv1.3 (OUT), TLS change cipher, Change cipher spec (1):
} [1 bytes data]
* TLSv1.3 (OUT), TLS handshake, Finished (20):
} [52 bytes data]
* SSL connection using TLSv1.3 / TLS_AES_256_GCM_SHA384 / x25519 / id-ecPublicKey
* ALPN: server accepted h2
* Server certificate:
*  subject: CN=mirrors.cicku.me
*  start date: Feb  1 15:55:54 2025 GMT
*  expire date: May  2 15:57:30 2025 GMT
*  subjectAltName: host "in.mirrors.cicku.me" matched cert's "*.mirrors.cicku.me"
*  issuer: C=US; O=CLOUDFLARE, INC.; CN=Cloudflare TLS Issuing ECC CA 1
*  SSL certificate verify ok.
*   Certificate level 0: Public key type EC/prime256v1 (256/128 Bits/secBits), signed using ecdsa-with-SHA256
*   Certificate level 1: Public key type EC/prime256v1 (256/128 Bits/secBits), signed using ecdsa-with-SHA384
*   Certificate level 2: Public key type EC/secp384r1 (384/192 Bits/secBits), signed using sha256WithRSAEncryption
*   Certificate level 3: Public key type RSA (2048/112 Bits/secBits), signed using sha1WithRSAEncryption
* Connected to in.mirrors.cicku.me (2606:4700:78::90:0:83) port 443
* using HTTP/2
* [HTTP/2] [1] OPENED stream for https://in.mirrors.cicku.me/archlinux/extra/os/x86_64/extra.db
* [HTTP/2] [1] [:method: GET]
* [HTTP/2] [1] [:scheme: https]
* [HTTP/2] [1] [:authority: in.mirrors.cicku.me]
* [HTTP/2] [1] [:path: /archlinux/extra/os/x86_64/extra.db]
* [HTTP/2] [1] [user-agent: curl/8.12.1]
* [HTTP/2] [1] [accept: */*]
} [5 bytes data]
> GET /archlinux/extra/os/x86_64/extra.db HTTP/2
> Host: in.mirrors.cicku.me
> User-Agent: curl/8.12.1
> Accept: */*
> 
* Request completely sent off
{ [5 bytes data]
* TLSv1.3 (IN), TLS handshake, Newsession Ticket (4):
{ [238 bytes data]
* TLSv1.3 (IN), TLS handshake, Newsession Ticket (4):
{ [238 bytes data]
< HTTP/2 200 
< date: Tue, 25 Feb 2025 09:31:44 GMT
< content-type: application/octet-stream
< content-length: 8024295
< cf-ray: 9176af220ee48f8e-KNU
< cf-cache-status: HIT
< accept-ranges: bytes
< cache-control: public, max-age=3600
< expires: Tue, 25 Feb 2025 10:31:44 GMT
< last-modified: Tue, 25 Feb 2025 08:50:49 GMT
< vary: Accept-Encoding
< set-cookie: __cf_bm=71vz6cztX7bO5voEfV0U3u4mo8Uk9DgyYEDK8yciVUU-1740475904-1.0.1.1-pEXkF5TJavGVW0grw7IN7kvL714R0cBgJ_Ya4AYn6EKlRleG93l9LaKKKPqp6HtHwAr.lPedZjNJg4Jfy5hlwkrWFOxf7zI8c8gdPb1UW_o; path=/; expires=Tue, 25-Feb-25 10:01:44 GMT; domain=.mirrors.cicku.me; HttpOnly; Secure; SameSite=None
< expect-ct: max-age=86400, enforce
< referrer-policy: same-origin
< x-content-type-options: nosniff
< x-frame-options: SAMEORIGIN
< x-xss-protection: 1; mode=block
< server: cloudflare
< alt-svc: h3=":443"; ma=86400
< 
} [5 bytes data]
100 7836k  100 7836k    0     0   478k      0  0:00:16  0:00:16 --:--:--  501k
* Connection #0 to host in.mirrors.cicku.me left intact

seth · 2025-02-25 09:44:48

Downloads at 500kB/s what takes 16s - to what value did you raise the timeout?
Try "… --connection-timeout 20 --download-timeout 30"

LinuxLover471 · 2025-02-25 09:59:19

seth wrote:

Downloads at 500kB/s what takes 16s - to what value did you raise the timeout?
Try "… --connection-timeout 20 --download-timeout 30"

Turns out I had used 15 seconds timeout, guess I should have more patience.

Seems like my wifi is not working properly, will create a new post.

Also turning it up to 20 seconds did fix this issue!
Thanks a lot,
LL

Arch Linux

#1 2025-02-24 07:18:08

[SOLVED] How to use reflector and not get download timed out error.

#2 2025-02-24 11:47:43

Re: [SOLVED] How to use reflector and not get download timed out error.

#3 2025-02-24 13:11:42

Re: [SOLVED] How to use reflector and not get download timed out error.

#4 2025-02-24 13:23:56

Re: [SOLVED] How to use reflector and not get download timed out error.

#5 2025-02-24 13:36:16

Re: [SOLVED] How to use reflector and not get download timed out error.

#6 2025-02-24 13:58:59

Re: [SOLVED] How to use reflector and not get download timed out error.

#7 2025-02-24 14:30:59

Re: [SOLVED] How to use reflector and not get download timed out error.

#8 2025-02-25 06:54:43

Re: [SOLVED] How to use reflector and not get download timed out error.

#9 2025-02-25 08:57:45

Re: [SOLVED] How to use reflector and not get download timed out error.

#10 2025-02-25 09:32:47

Re: [SOLVED] How to use reflector and not get download timed out error.

#11 2025-02-25 09:44:48

Re: [SOLVED] How to use reflector and not get download timed out error.

#12 2025-02-25 09:59:19

Re: [SOLVED] How to use reflector and not get download timed out error.

Board footer