You are not logged in.

#1 2023-05-19 01:09:44

orbit1849
Member
Registered: 2022-10-13
Posts: 13

CUDA 11.7 on Arch, what to do when there's no AUR?

I need CUDA 11.7 specifically, as this is used in popular LLM (Large Language Model) projects. With a more modern CUDA version, the complex build environment breaks. I'd rather not have to install Debian or some other distro simply because NVIDIA supports these other distros, but I'm just mentioning this here because I know this will fix my problem, as I've tested it on a separate machine to see if CUDA 11.7 indeed resolved the issue, which it did.

In any case, this is the situation:

There is nothing in pacman for CUDA 11.7.
There is no AUR for CUDA 11.7.
There is no official NVIDIA support for Arch Linux for CUDA.

There doesn't seem to be any AUR for CUDA 11.7, or am I just not looking in the right place? I've tried yay and manually looked at https://aur.archlinux.org; I can't find any such package.

I've also tried to convert a .deb package (NVIDIA does support Debian, and a couple other distros), although I managed to create a package without errors using debtap, installing it doesn't seem to populate files in the directories I would expect. Moreover, the AUR appears to simply contain a slew of .deb files (within the AUR package) that are supposed to be extracted, compiled, and installed. This appears complicated to get to work by going this route.

Last edited by orbit1849 (2023-05-19 01:49:43)

Offline

#2 2023-05-19 01:38:06

dakota
Member
Registered: 2016-05-20
Posts: 282

Re: CUDA 11.7 on Arch, what to do when there's no AUR?

Are you looking for cuda? Or, specifically, for an old version of cuda (11.7)?


"Before Enlightenment chop wood, carry water. After Enlightenment chop wood, carry water." -- Zen proverb

Offline

#3 2023-05-19 01:47:08

orbit1849
Member
Registered: 2022-10-13
Posts: 13

Re: CUDA 11.7 on Arch, what to do when there's no AUR?

dakota wrote:

Are you looking for cuda? Or, specifically, for an old version of cuda (11.7)?

For CUDA 11.7 specifically.

The reason is, this is used for LLMs (Large Language Model) in a few popular projects, so this is something that should exist. The complex build environment basically expects CUDA 11.7 to exist on the system and it breaks in bad ways when a more recent version of CUDA is present.

Offline

#4 2023-05-19 02:14:55

Trilby
Inspector Parrot
Registered: 2011-11-29
Posts: 29,615
Website

Re: CUDA 11.7 on Arch, what to do when there's no AUR?

You can get cuda-11.7.1-3 from the archive, though you would need gcc11 from the AUR.


"UNIX is simple and coherent..." - Dennis Ritchie, "GNU's Not UNIX" -  Richard Stallman

Offline

#5 2023-05-19 20:30:42

orbit1849
Member
Registered: 2022-10-13
Posts: 13

Re: CUDA 11.7 on Arch, what to do when there's no AUR?

Trilby wrote:

You can get cuda-11.7.1-3 from the archive, though you would need gcc11 from the AUR.

Thanks, that actually worked. How did you find that package?

Last edited by orbit1849 (2023-05-19 20:30:52)

Offline

#6 2023-05-19 20:37:19

Trilby
Inspector Parrot
Registered: 2011-11-29
Posts: 29,615
Website

Re: CUDA 11.7 on Arch, what to do when there's no AUR?


"UNIX is simple and coherent..." - Dennis Ritchie, "GNU's Not UNIX" -  Richard Stallman

Offline

#7 2023-07-20 01:06:44

ntbollman
Member
Registered: 2023-07-20
Posts: 1

Re: CUDA 11.7 on Arch, what to do when there's no AUR?

I love Arch, and Im loving AI language models.

I find it useful to be able to bounce around my cuda programs to include cuda, cuda-tools some programs require cu118 cu117...

anyway, yay package manager has a program that is a godsend for switching between versions called downgrade, when you downgrade a package you can tell arch to ignore future updates for that package when running pacman, press y to ignore package updates when you use the downgrade utility. This will access the cached versions and most times you dont even need to restart, but if sometimes... its safer to restart after downgrade

'sudo downgrade cuda cuda-tools'

menu driven commands listing the AUR Archives for the programs you choose to downgrade... anyhoo hope this makes things easier for cuda management on Arch.

Offline

#8 2023-07-20 01:45:16

Trilby
Inspector Parrot
Registered: 2011-11-29
Posts: 29,615
Website

Re: CUDA 11.7 on Arch, what to do when there's no AUR?

ntbollman wrote:

yay package manager has a program ... called downgrade

No.  It really doesn't.


"UNIX is simple and coherent..." - Dennis Ritchie, "GNU's Not UNIX" -  Richard Stallman

Offline

Board footer

Powered by FluxBB