Arch Linux

JSequeira

Member

Registered: 2024-08-30

Posts: 3

5090 underperforming 4090 with `nvidia-open`

arch
6.13.8-arch1-1

llama.cpp
version: 4954 (3cd3a395)
built with cc (GCC) 14.2.1 20250207 for x86_64-pc-linux-gnu

I have a dual setup with a 5090 and a 4090 and if I use the `nvidia 570.133.07-2` package the 5090 does not show up.
So I'm using the `nvidia-open` package but, interestingly enough, the 4090 outperforms the 5090 when it comes to LLM inference, with llama.cpp.

Is there something I might be missing?

jl2

Member

From: 47° 18' N 8° 34' E

Registered: 2022-06-01

Posts: 737

Website

Re: 5090 underperforming 4090 with `nvidia-open`

Is there something I might be missing?

That linux drivers need a long time to get optimized for specific GPUs. Your lucky it even works (surprisingly the open source solution). Generally don't buy GPUs for the first few months after release if you want to daily drive it

Time (and other peoples effort) will fix it.

(In case you want to get involved, have a look at https://github.com/NVIDIA/open-gpu-kernel-modules)

Last edited by jl2 (2025-03-25 19:27:27)

---

Why I run Arch? To "BTW I run Arch" the guy one grade younger.
And to let my siblings and cousins laugh at Arsch Linux...

JSequeira

Member

Registered: 2024-08-30

Posts: 3

Re: 5090 underperforming 4090 with `nvidia-open`

Thanks

loqs

Member

Registered: 2014-03-06

Posts: 18,463

Re: 5090 underperforming 4090 with `nvidia-open`

Your lucky it even works (surprisingly the open source solution). Generally don't buy GPUs for the first few months after release if you want to daily drive it

Why is that surprising?  Blackwell and newer will only be supported by the open source solution.
Edit:
Another issue might be llama.cpp not having added support for the SM100 architecture.

Last edited by loqs (2025-03-25 21:59:19)

jl2

Member

From: 47° 18' N 8° 34' E

Registered: 2022-06-01

Posts: 737

Website

Re: 5090 underperforming 4090 with `nvidia-open`

Why is that surprising?  Blackwell and newer will only be supported by the open source solution.

That doesn't change that nvidia has a bad reputation on their open source linux drivers.
Perhaps I should have refraised that to I wouldn't buy GPUs for the first couple of months for stability reasons.

Have you seen any 9070 issues yet?

---

Why I run Arch? To "BTW I run Arch" the guy one grade younger.
And to let my siblings and cousins laugh at Arsch Linux...

Scimmia

Fellow

Registered: 2012-09-01

Posts: 12,748

Re: 5090 underperforming 4090 with `nvidia-open`

That doesn't change that nvidia has a bad reputation on their open source linux drivers.

No they don't. You do realize we're not talking about nouveau, right?

jl2

Member

From: 47° 18' N 8° 34' E

Registered: 2022-06-01

Posts: 737

Website

Re: 5090 underperforming 4090 with `nvidia-open`

That doesn't change that nvidia has a bad reputation on their open source linux drivers.

No they don't. You do realize we're not talking about nouveau, right?

Oh. right. whatever. Just me grrr-ing around about wrong stuff.

---

Why I run Arch? To "BTW I run Arch" the guy one grade younger.
And to let my siblings and cousins laugh at Arsch Linux...

JSequeira

Member

Registered: 2024-08-30

Posts: 3

Re: 5090 underperforming 4090 with `nvidia-open`

Blackwell and newer will only be supported by the open source solution.

I couldn't find any sources for this. Is this legit? Can you point me to official sources?

Scimmia

Fellow

Registered: 2012-09-01

Posts: 12,748

Re: 5090 underperforming 4090 with `nvidia-open`

Blackwell and newer will only be supported by the open source solution.

I couldn't find any sources for this. Is this legit? Can you point me to official sources?

https://us.download.nvidia.com/XFree86/ … _open.html
https://developer.nvidia.com/blog/nvidi … l-modules/

Last edited by Scimmia (2025-03-26 11:13:28)

loqs

Member

Registered: 2014-03-06

Posts: 18,463

Re: 5090 underperforming 4090 with `nvidia-open`

Have you seen any 9070 issues yet?

https://gitlab.freedesktop.org/drm/amd/ … U%20series

tekstryder

Member

Registered: 2013-02-14

Posts: 323

Re: 5090 underperforming 4090 with `nvidia-open`

Blackwell and newer will only be supported by the open source solution.

They are listed as supported by the proprietary driver under the Linux x64 (AMD64/EM64T) Display Driver 570.133.07 | Linux 64-bit

GeForce RTX 50 Series (Notebooks)
NVIDIA GeForce RTX 5090 Laptop GPU, NVIDIA GeForce RTX 5080 Laptop GPU, NVIDIA GeForce RTX 5070 Ti Laptop GPU

GeForce RTX 50 Series
NVIDIA GeForce RTX 5090 D, NVIDIA GeForce RTX 5090, NVIDIA GeForce RTX 5080, NVIDIA GeForce RTX 5070 Ti, NVIDIA GeForce RTX 5070

loqs

Member

Registered: 2014-03-06

Posts: 18,463

Re: 5090 underperforming 4090 with `nvidia-open`

Blackwell and newer will only be supported by the open source solution.

They are listed as supported by the proprietary driver under the Linux x64 (AMD64/EM64T) Display Driver 570.133.07 | Linux 64-bit

That tarball contains both the open and closed sources.  Please read the kernel open section of the README for that driver that Scimmia already linked to in post #6.