Arch Linux

abdorithm

Member

Registered: 2024-11-21

Posts: 1

Can Ollama (ollama-rocm) utilize AMD RX 550?

Hi. I am having trouble getting ollama to use my discrete AMD GPU on my laptop. I installed the ollama-rocm package from the official repos but still when using any model, it only utilizes my cpu. I have the mesa drivers installed. I know my GPU is not on the "officially supported GPUs list", but I saw people online getting ollama to use their not-supported AMD GPU. So it made me curious: can I get ollama to use my AMD Radeon 500 Series GPU?

this is from the ouput of journalclt

time=2024-11-21T21:22:42.231+02:00 level=INFO source=gpu.go:221 msg="looking for compatible GPUs"
time=2024-11-21T21:22:42.279+02:00 level=WARN source=amd_linux.go:61 msg="ollama recommends running the https://www.amd.com/en/support/linux-drivers" error="amdgpu version file missing: /sys/module/amdgpu/version stat /sys/module/amdgpu/version: no such file or directory"
time=2024-11-21T21:22:42.279+02:00 level=INFO source=amd_linux.go:399 msg="no compatible amdgpu devices detected"
time=2024-11-21T21:22:42.279+02:00 level=INFO source=gpu.go:386 msg="no compatible GPUs were discovered"

I tried running ollama from their docker ollama:rocm image. Still only uses CPU. I would love to get that GPU pump. Any help is appreciated. Thanks in advance!

Output of fastfetch:

                  -`                     abdo@archlinux
                 .o+`                    --------------
                `ooo/                    OS: Arch Linux x86_64
               `+oooo:                   Host: 20KN001YED (ThinkPad E480)
              `+oooooo:                  Kernel: Linux 6.11.9-arch1-1
              -+oooooo+:                 Uptime: 2 hours, 24 mins
            `/:-:++oooo+:                Packages: 1678 (pacman)
           `/++++/+++++++:               Shell: bash 5.2.37
          `/++++++++++++++:              Display (BOE074C): 1366x768 @ 60 Hz in 14" [Built-in]
         `/+++ooooooooooooo/`            DE: KDE Plasma 6.2.3
        ./ooosssso++osssssso+`           WM: KWin (X11)
       .oossssso-````/ossssss+`          WM Theme: Breeze
      -osssssso.      :ssssssso.         Theme: Breeze (Dark) [Qt], Breeze-Dark [GTK2], Breeze [GTK3/4]
     :osssssss/        osssso+++.        Icons: breeze-dark [Qt], breeze-dark [GTK2/3/4]
    /ossssssss/        +ssssooo/-        Font: Noto Sans (10pt) [Qt], Noto Sans (10pt) [GTK2/3/4]
  `/ossssso+/:-        -:/+osssso+-      Cursor: breeze (24px)
 `+sso+:-`                 `.-/+oso:     Terminal: konsole 24.8.3
`++:.                           `-/+/    CPU: Intel(R) Core(TM) i5-8250U (8) @ 3.40 GHz
.`                                 `/    GPU 1: AMD Radeon 500 Series [Discrete]
                                         GPU 2: Intel UHD Graphics 620 @ 1.10 GHz [Integrated]
                                         Memory: 3.46 GiB / 7.66 GiB (45%)
                                         Swap: 256.00 KiB / 5.83 GiB (0%)

V1del

Forum Moderator

Registered: 2012-10-16

Posts: 23,289

Re: Can Ollama (ollama-rocm) utilize AMD RX 550?

https://github.com/rocm-arch/rocm-arch? … or-polaris