Download speed within terminal is extremely slow

Cemafaci · 2023-06-30 22:29:29

Good day everyone.
I landed up here with same issue, briefly summed up : slow pacman, slow wget in terminal (1 MB/s). Whereas torrents are fast as should be (30 MB/s).
Initially I was thinking it is due to the flash memory I have on my mele quieter 3, however today I have installed nvme (samsung 960 EVO) and rsynced arch from that native flash drive there
wget -O /dev/null gives slow speed as well (around 1 MB/s). I was trying to download arch iso file from mirrors.
My notebook gives me 30 MB/s wget exactly same link.
Bet I could reinstall arch, however I am curious what is the issue. (Tried disabling fail2ban and iptables - no luck, tried to install NetworkManager and disable dhcpcd - no luck)
ip a: ip r

1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: enp1s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP group default qlen 1000
link/ether 00:ce:39:d1:24:32 brd ff:ff:ff:ff:ff:ff
inet 192.168.0.200/24 brd 192.168.0.255 scope global noprefixroute enp1s0
valid_lft forever preferred_lft forever
inet6 fe80::1823:b5ef:4a77:895b/64 scope link
valid_lft forever preferred_lft forever
3: wlp0s20f3: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default qlen 1000
link/ether 80:38:fb:09:21:6c brd ff:ff:ff:ff:ff:ff
default via 192.168.0.1 dev enp1s0 proto dhcp src 192.168.0.200 metric 1002
192.168.0.0/24 dev enp1s0 proto dhcp scope link src 192.168.0.200 metric 1002

$ pacman -Qi linux-firmware
Name : linux-firmware
Version : 20230625.ee91452d-2
Description : Firmware files for Linux
Architecture : any
URL : https://git.kernel.org/?p=linux/kernel/ … ;a=summary
Licenses : GPL2 GPL3 custom
Groups : None
Provides : None
Depends On : linux-firmware-whence
Optional Deps : None
Required By : None
Optional For : linux
Conflicts With : None
Replaces : None
Installed Size : 173.42 MiB
Packager : Laurent Carlier <lordheavym@archlinux.org>
Build Date : Fri Jun 30 15:16:10 2023
Install Date : Fri Jun 30 20:33:34 2023
Install Reason : Explicitly installed
Install Script : No
Validated By : Signature

Last edited by Cemafaci (2023-06-30 22:35:39)

seth · 2023-07-01 06:46:54

Don't test random mirrors (they might fluctuate), terminate your torrent client(s) to rule out interference from there and post the actual wget output(s)

wget -v --show-progress -O /dev/null "http://speedtest.frankfurt.linode.com/100MB-frankfurt.bin" # default behavior
wget -v -4 --show-progress -O /dev/null "http://speedtest.frankfurt.linode.com/100MB-frankfurt.bin" # only IPv4
wget -v -6 --show-progress -O /dev/null "http://speedtest.frankfurt.linode.com/100MB-frankfurt.bin" # only IPv6
wget -v  --no-proxy --show-progress -O /dev/null "http://speedtest.frankfurt.linode.com/100MB-frankfurt.bin" # bad proxy?

Cemafaci · 2023-07-01 09:00:36

Thank you for help!
I run all the commands on home server (mele quieter 3) and on laptop. Laptop and server are in the same network, except the fact laptop sits on the wifi.
Laptop gives above 10 MB/s, server gives something aroung 500 KB/s
There is no difference which command I use , IPv6 not available.

I think the issue is now narrowed (for server - for clarity ):
Here is the wireless output for wget -v --show-progress -O /dev/null "http://speedtest.frankfurt.linode.com/1 … nkfurt.bin" # default behavior

Resolving speedtest.frankfurt.linode.com (speedtest.frankfurt.linode.com)... 139.162.130.8, 2a01:7e01::f03c:91ff:fe26:8794
Connecting to speedtest.frankfurt.linode.com (speedtest.frankfurt.linode.com)|139.162.130.8|:80... connected.
100.00M 14.0MB/s in 7.6s

Here is the wired output for wget -v --show-progress -O /dev/null "http://speedtest.frankfurt.linode.com/1 … nkfurt.bin" # default behavior

Resolving speedtest.frankfurt.linode.com (speedtest.frankfurt.linode.com)... 139.162.130.8, 2a01:7e01::f03c:91ff:fe26:8794
Connecting to speedtest.frankfurt.linode.com (speedtest.frankfurt.linode.com)|139.162.130.8|:80... connected.
100.00M 456KB/s in 3m 25s

As I mentioned, torrents are running just fine (during the tests the qbittorent was switched off)

*Wired laptop gives me following performance, which is king of surprising for me, as I have not expected any significant difference in between wireless and wired (If I run speedtest.net it is nearly the same usually, nearly maxed out)

Resolving speedtest.frankfurt.linode.com (speedtest.frankfurt.linode.com)... 139.162.130.8, 2a01:7e01::f03c:91ff:fe26:8794
Connecting to speedtest.frankfurt.linode.com (speedtest.frankfurt.linode.com)|139.162.130.8|:80... connected.
100.00M 30.8MB/s in 3.4s

Last edited by Cemafaci (2023-07-01 09:07:27)

seth · 2023-07-01 10:42:11

I think the issue is now narrowed (for server - for clarity smile ):

How?
You didn't post teh results of the proxyless test, same?

How does the wget speedtest perform on the same system using the archinstall iso?

Cemafaci · 2023-07-01 11:19:33

My appologies, I was thinking that wireless vs wired provides some useful information.
proxyless test gives same results.

WIll test archinstall iso this evening.
But please take a look what I see right now, I repeated the test several times, it always faster (10x) with torrent running
wget -v --show-progress -O /dev/null "http://speedtest.frankfurt.linode.com/1 … nkfurt.bin" # default behavior
Qbittorrent switched off:

100.00M 388KB/s in 4m 16s

Qbittorrent is downloading:

100.00M 5.13MB/s in 13s

Does it mean network card goes to kind of power saving mode and is not waking up by wget?

Last edited by Cemafaci (2023-07-01 11:22:25)

seth · 2023-07-01 11:51:52

Wired and wireless tests were on the same system? (I thought this was comparing it to the notebook)

Does it mean network card goes to kind of power saving mode and is not waking up by wget?

"unlikely", however

lspci -k
ethtool enp1s0
sysctl -a |& grep ipv4.tcp

And please post your complete system journal for the boot:

sudo journalctl -b | curl -F 'f:1=<-' ix.io

Cemafaci · 2023-07-01 19:54:56

seth
I tried live cd:
same story on wired internet 428KB/s; and on wireless connection 12.5 MB/s (Both tests are on Mele quieter 3 server)
My assumption that reinstall will help was a trash . Strange I did not notice that stuff earlier, prob did not pay attention as I am relatively new to Arch.

Here is the journalctl -b log: http://ix.io/4zxn

For the first command I paste only network related info below

lspci -k
Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 15)
Subsystem: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller
Kernel driver in use: r8169
Kernel modules: r8169

ethtool enp1s0
Settings for enp1s0:
        Supported ports: [ TP    MII ]
        Supported link modes:   10baseT/Half 10baseT/Full
                                100baseT/Half 100baseT/Full
                                1000baseT/Full
        Supported pause frame use: Symmetric Receive-only
        Supports auto-negotiation: Yes
        Supported FEC modes: Not reported
        Advertised link modes:  10baseT/Half 10baseT/Full
                                100baseT/Half 100baseT/Full
                                1000baseT/Full
        Advertised pause frame use: Symmetric Receive-only
        Advertised auto-negotiation: Yes
        Advertised FEC modes: Not reported
        Link partner advertised link modes:  10baseT/Half 10baseT/Full
                                             100baseT/Half 100baseT/Full
                                             1000baseT/Full
        Link partner advertised pause frame use: No
        Link partner advertised auto-negotiation: Yes
        Link partner advertised FEC modes: Not reported
        Speed: 1000Mb/s
        Duplex: Full
        Auto-negotiation: on
        master-slave cfg: preferred slave
        master-slave status: slave
        Port: Twisted Pair
        PHYAD: 0
        Transceiver: external
        MDI-X: Unknown
netlink error: Operation not permitted
        Link detected: yes

sysctl -a |& grep ipv4.tcp
net.ipv4.tcp_abort_on_overflow = 0
net.ipv4.tcp_adv_win_scale = 1
net.ipv4.tcp_allowed_congestion_control = reno cubic
net.ipv4.tcp_app_win = 31
net.ipv4.tcp_autocorking = 1
net.ipv4.tcp_available_congestion_control = reno cubic
net.ipv4.tcp_available_ulp = espintcp mptcp
net.ipv4.tcp_base_mss = 1024
net.ipv4.tcp_challenge_ack_limit = 2147483647
net.ipv4.tcp_child_ehash_entries = 0
net.ipv4.tcp_comp_sack_delay_ns = 1000000
net.ipv4.tcp_comp_sack_nr = 44
net.ipv4.tcp_comp_sack_slack_ns = 100000
net.ipv4.tcp_congestion_control = cubic
net.ipv4.tcp_dsack = 1
net.ipv4.tcp_early_demux = 1
net.ipv4.tcp_early_retrans = 3
net.ipv4.tcp_ecn = 2
net.ipv4.tcp_ecn_fallback = 1
net.ipv4.tcp_ehash_entries = 65536
net.ipv4.tcp_fack = 0
net.ipv4.tcp_fastopen = 1
net.ipv4.tcp_fastopen_blackhole_timeout_sec = 0
net.ipv4.tcp_fastopen_key = d515647f-16de6baa-9c149bf4-cc0e8642
net.ipv4.tcp_fin_timeout = 60
net.ipv4.tcp_frto = 2
net.ipv4.tcp_fwmark_accept = 0
net.ipv4.tcp_invalid_ratelimit = 500
net.ipv4.tcp_keepalive_intvl = 75
net.ipv4.tcp_keepalive_probes = 9
net.ipv4.tcp_keepalive_time = 7200
net.ipv4.tcp_l3mdev_accept = 0
net.ipv4.tcp_limit_output_bytes = 1048576
net.ipv4.tcp_low_latency = 0
net.ipv4.tcp_max_orphans = 32768
net.ipv4.tcp_max_reordering = 300
net.ipv4.tcp_max_syn_backlog = 512
net.ipv4.tcp_max_tw_buckets = 32768
net.ipv4.tcp_mem = 90798        121067  181596
net.ipv4.tcp_migrate_req = 0
net.ipv4.tcp_min_rtt_wlen = 300
net.ipv4.tcp_min_snd_mss = 48
net.ipv4.tcp_min_tso_segs = 2
net.ipv4.tcp_moderate_rcvbuf = 1
net.ipv4.tcp_mtu_probe_floor = 48
net.ipv4.tcp_mtu_probing = 0
net.ipv4.tcp_no_metrics_save = 0
net.ipv4.tcp_no_ssthresh_metrics_save = 1
net.ipv4.tcp_notsent_lowat = 4294967295
net.ipv4.tcp_orphan_retries = 0
net.ipv4.tcp_pacing_ca_ratio = 120
net.ipv4.tcp_pacing_ss_ratio = 200
net.ipv4.tcp_plb_cong_thresh = 128
net.ipv4.tcp_plb_enabled = 0
net.ipv4.tcp_plb_idle_rehash_rounds = 3
net.ipv4.tcp_plb_rehash_rounds = 12
net.ipv4.tcp_plb_suspend_rto_sec = 60
net.ipv4.tcp_probe_interval = 600
net.ipv4.tcp_probe_threshold = 8
net.ipv4.tcp_recovery = 1
net.ipv4.tcp_reflect_tos = 0
net.ipv4.tcp_reordering = 3
net.ipv4.tcp_retrans_collapse = 1
net.ipv4.tcp_retries1 = 3
net.ipv4.tcp_retries2 = 15
net.ipv4.tcp_rfc1337 = 0
net.ipv4.tcp_rmem = 4096        131072  6291456
net.ipv4.tcp_sack = 1
net.ipv4.tcp_slow_start_after_idle = 1
net.ipv4.tcp_stdurg = 0
net.ipv4.tcp_syn_retries = 6
net.ipv4.tcp_synack_retries = 5
net.ipv4.tcp_syncookies = 1
net.ipv4.tcp_thin_linear_timeouts = 0
net.ipv4.tcp_timestamps = 1
net.ipv4.tcp_tso_rtt_log = 9
net.ipv4.tcp_tso_win_divisor = 3
net.ipv4.tcp_tw_reuse = 2
net.ipv4.tcp_window_scaling = 1
net.ipv4.tcp_wmem = 4096        16384   4194304
net.ipv4.tcp_workaround_signed_windows = 0

Last edited by Cemafaci (2023-07-01 20:37:09)

seth · 2023-07-01 20:13:19

Try using https://archlinux.org/packages/extra/x86_64/r8168/
Also please use [code][/code] tags, not "quote" tags. Edit your post in this regard.

Cemafaci · 2023-07-01 20:45:06

seth
Amazing, it works! Thank you very much for help!!!

I see that speed with wget grows up to 10 MB/s, pacman just hit 32 MB/s.
I already started to try to compile realtek driver from their website without luck
Changed previous post

Big_Miki · 2023-07-25 00:08:03

Thank you very much seth!

I had the same problem, and the when i added that kernel module r8168, it was working like it is supposed to.
Ethernet was the problem, the wifi worked fine.

My internet is 400Mbps down and 160Mbps up. On speedtest i was getting 30Mbps down and 160 up, so only the download was not working correctly. Now everything is working good. 400 down 160 up.

I am using Lenovo Legion 5 pro 2022 intel

seth · 2023-07-25 06:13:34

This is btw. a known kernel regression, https://bugzilla.kernel.org/show_bug.cgi?id=217596

Arch Linux

#26 2023-06-30 22:29:29

Re: Download speed within terminal is extremely slow

#27 2023-07-01 06:46:54

Re: Download speed within terminal is extremely slow

#28 2023-07-01 09:00:36

Re: Download speed within terminal is extremely slow

#29 2023-07-01 10:42:11

Re: Download speed within terminal is extremely slow

#30 2023-07-01 11:19:33

Re: Download speed within terminal is extremely slow

#31 2023-07-01 11:51:52

Re: Download speed within terminal is extremely slow

#32 2023-07-01 19:54:56

Re: Download speed within terminal is extremely slow

#33 2023-07-01 20:13:19

Re: Download speed within terminal is extremely slow

#34 2023-07-01 20:45:06

Re: Download speed within terminal is extremely slow

#35 2023-07-25 00:08:03

Re: Download speed within terminal is extremely slow

#36 2023-07-25 06:13:34

Re: Download speed within terminal is extremely slow

Board footer