You are not logged in.

#1 2019-05-27 07:23:47

Utini
Member
Registered: 2015-09-28
Posts: 481
Website

How to benchmark hardware in Linux vs Windows without software limits?

Hello everyone,

my laptop is setup with Archlinux and Windows 10. Both OS are (to me) completely setup and optimized for my usage.
How ever, in video rendering I seem to notice performance differences between the two OS.
This could be related to software, codec, drivers, .... but I want to make sure that it e.g. is not related to TLP, selected scheduler,...
So I thought it would be interesting to benchmark both OS in a way that will not be compromised by different drivers or codecs. Something that stresses CPU, NVME SSD, RAM and maybe the iGPU (but preferable not dGPU) but is not limited to different architecture and programming limits. E.g. 7-zip in Windows utilizes all 12 CPUs while on Linux most archivers only use 1 CPU. FFMPEG seems to be fast on Windows than on Linux, no idea why, but it is software and not hardware related and there for bad as benchmark.

Can anyone recommend me on how to do this kind of benchmark?

Last edited by Utini (2019-05-27 08:16:26)


Setup 1: Thinkpad T14s G3, 14" FHD - R7 6850U - 32GB RAM - 2TB Solidigm P44 Pro NVME
Setup 2: Thinkpad X1E G1, 15.6" FHD - i7-8850H - 32GB RAM - NVIDIA GTX 1050Ti - 2x 1TB Samsung 970 Pro NVME
Accessories: Filco Majestouch TKL MX-Brown Mini Otaku, Benq XL2420T (144Hz), Lo(w)gitech G400, Puretrak Talent, Sennheiser HD800S + Meier Daccord FF + Meier Classic FF

Offline

#2 2019-05-27 08:08:06

d_fajardo
Member
Registered: 2017-07-28
Posts: 1,689

Re: How to benchmark hardware in Linux vs Windows without software limits?

You can have a look at phoronix test suite.

Offline

#3 2019-05-27 08:11:23

Utini
Member
Registered: 2015-09-28
Posts: 481
Website

Re: How to benchmark hardware in Linux vs Windows without software limits?

I already looked and phoronix benchmarks but it uses exactly the software that I mentioned which simple work different depending on the OS.
E.g. ffmpeg and 7-zip.

It's code/features/dependencies are too different between Windows/Linux which causes slower results eventhough the hardware is the same.
So for some benchmarks it mostly is benchmarking the software instead of the hardware.


Setup 1: Thinkpad T14s G3, 14" FHD - R7 6850U - 32GB RAM - 2TB Solidigm P44 Pro NVME
Setup 2: Thinkpad X1E G1, 15.6" FHD - i7-8850H - 32GB RAM - NVIDIA GTX 1050Ti - 2x 1TB Samsung 970 Pro NVME
Accessories: Filco Majestouch TKL MX-Brown Mini Otaku, Benq XL2420T (144Hz), Lo(w)gitech G400, Puretrak Talent, Sennheiser HD800S + Meier Daccord FF + Meier Classic FF

Offline

#4 2019-05-27 14:30:23

seth
Member
From: Won't reply 2 private help req
Registered: 2012-09-03
Posts: 78,500

Re: How to benchmark hardware in Linux vs Windows without software limits?

To rule out the SW you'll have to use the same SW and that SW must use the same code paths. You can try some windows benchmark via wine (ack'ing a small discount for the wine mappings)

As for 7z : "7z --help", look out for the -mmt option…

Edit: one dash only…

Last edited by seth (2019-05-27 14:30:54)

Offline

#5 2019-05-28 11:02:01

Lone_Wolf
Administrator
From: Netherlands, Europe
Registered: 2005-10-04
Posts: 15,515

Re: How to benchmark hardware in Linux vs Windows without software limits?

Maybe the tests used in https://www.phoronix.com/scan.php?page= … readripper would be suitable ?


Disliking systemd intensely, but not satisfied with alternatives so focusing on taming systemd.

clean chroot building not flexible enough ?
Try clean chroot manager by graysky

Offline

#6 2019-05-29 06:45:28

Utini
Member
Registered: 2015-09-28
Posts: 481
Website

Re: How to benchmark hardware in Linux vs Windows without software limits?

Lone_Wolf wrote:

Maybe the tests used in https://www.phoronix.com/scan.php?page= … readripper would be suitable ?

Thanks but I want to run the benchmark on my system to test my existing configuration.
E.g. with TLP, scheduler, etc etc are all set correctly and give me the performance that I would also get on Windows (which I have also setup "correctly").


Setup 1: Thinkpad T14s G3, 14" FHD - R7 6850U - 32GB RAM - 2TB Solidigm P44 Pro NVME
Setup 2: Thinkpad X1E G1, 15.6" FHD - i7-8850H - 32GB RAM - NVIDIA GTX 1050Ti - 2x 1TB Samsung 970 Pro NVME
Accessories: Filco Majestouch TKL MX-Brown Mini Otaku, Benq XL2420T (144Hz), Lo(w)gitech G400, Puretrak Talent, Sennheiser HD800S + Meier Daccord FF + Meier Classic FF

Offline

#7 2019-05-31 19:33:21

DrZaius
Member
Registered: 2008-01-02
Posts: 193

Re: How to benchmark hardware in Linux vs Windows without software limits?

Utini wrote:

FFMPEG seems to be fast on Windows than on Linux, no idea why, but it is software and not hardware related and there for bad as benchmark.

Show your command and the complete console output. Use the same input and command on each OS. Also use the same ffmpeg version. If encoding with an external library via ffmpeg, such as libx264, then also use the same library version.

Offline

Board footer

Powered by FluxBB