How can I make zstd use all cpu threads?

aljustiet · 2024-08-04 09:45:43

When compressing the package from the AUR, zstd uses maximally 100%. I guess that means cpu 1 core. How can I make it use all my cpu cores to compress the package faster? htop

gromit · 2024-08-04 09:57:01

Which compression options for zstd do you have set in /etc/makepkg.conf? See i.e. the output of "grep -i zstd /etc/makepkg.conf"

If you just keep packages locally you can also just disable compression at all

aljustiet · 2024-08-04 10:10:00

gromit wrote:

Which compression options for zstd do you have set in /etc/makepkg.conf? See i.e. the output of "grep -i zstd /etc/makepkg.conf"
If you just keep packages locally you can also just disable compression at all

COMPRESSZST=(zstd -c -T0 --ultra -20 -)

I wanna compress the packages, because I have 223.5 GiB drive.

gromit · 2024-08-04 10:30:21

"-T0" should autodetect with the amount of cores on your system (similar to "-j$(nproc)" for make), so I guess you already have the right options set for multicore compression. However I guess zstd can not utilize all cores at all times, so maybe its only really multicore in the beginning.

Trilby · 2024-08-04 13:15:56

-T0 detection is based, by default, on the number of physical not logical cores. But this default can be changed. Try adding "--auto-threads=logical".

Maniaxx · 2024-08-04 14:01:42

Try reducing -20 to -19.

Arch Linux

#1 2024-08-04 09:45:43

How can I make zstd use all cpu threads?

#2 2024-08-04 09:57:01

Re: How can I make zstd use all cpu threads?

#3 2024-08-04 10:10:00

Re: How can I make zstd use all cpu threads?

#4 2024-08-04 10:30:21

Re: How can I make zstd use all cpu threads?

#5 2024-08-04 13:15:56

Re: How can I make zstd use all cpu threads?

#6 2024-08-04 14:01:42

Re: How can I make zstd use all cpu threads?

Board footer