Arch Linux

laichiaheng

Member

Registered: 2017-02-12

Posts: 279

How to use Vulkan for Ollama on Arch?

It seems like the latest 0.12.6 has supported Vulkan, but it still runs on CPU when I run ollama.
ollama-rocm works, but all other people say that ROCm is much slower than Vulkan

Last edited by laichiaheng (2025-10-20 13:12:45)

Luciddream

Member

From: Greece

Registered: 2014-12-08

Posts: 41

Re: How to use Vulkan for Ollama on Arch?

Not sure about ollama but as an alternative you can use llama.cpp that supports both ROCm and Vulkan. You can even make it easier by using the lemonade-server that also has 7.9.0 ROCm builds (tech preview)

Lone_Wolf

Administrator

From: Netherlands, Europe

Registered: 2005-10-04

Posts: 14,482

Re: How to use Vulkan for Ollama on Arch?

archlinux ollama PKGBUILD

depends=(gcc-libs glibc)
makedepends=(cmake ninja git go rocm-toolchain hipblas cuda clblast)

https://github.com/ollama/ollama/blob/m … s.txt#L143 indicates ollama will only enable vulkan support if it detects vulkan.
repo ollama isn't built with vulkan present .

---

Disliking systemd intensely, but not satisfied with alternatives so focusing on taming systemd.

clean chroot building not flexible enough ?
Try clean chroot manager by graysky

laichiaheng

Member

Registered: 2017-02-12

Posts: 279

Re: How to use Vulkan for Ollama on Arch?

archlinux ollama PKGBUILD

depends=(gcc-libs glibc)
makedepends=(cmake ninja git go rocm-toolchain hipblas cuda clblast)

https://github.com/ollama/ollama/blob/m … s.txt#L143 indicates ollama will only enable vulkan support if it detects vulkan.
repo ollama isn't built with vulkan present .

Why doesn't ArchLinux build ollama with Vulkan?

gromit

Administrator

From: Germany

Registered: 2024-02-10

Posts: 1,396

Website

Re: How to use Vulkan for Ollama on Arch?

That sounds fixable, please raise a feature request or Merge Request (https://wiki.archlinux.org/title/Genera … e_requests) on the Package Repo: https://gitlab.archlinux.org/archlinux/ … ges/ollama

Scimmia

Fellow

Registered: 2012-09-01

Posts: 13,247

Re: How to use Vulkan for Ollama on Arch?

Why doesn't ArchLinux build ollama with Vulkan?

Likely because nobody has requested it.

brian001

Member

Registered: 2021-01-04

Posts: 31

Re: How to use Vulkan for Ollama on Arch?

There's now an ollama-vulkan package for anyone finding this thread.

https://archlinux.org/packages/extra/x8 … ma-vulkan/