You are not logged in.
NVIDIA graphics card, under normal boot, OLLAMA can use the AI large model through the GPU without issue. However, once it goes into sleep mode and then wakes up, it cannot use the AI through the GPU properly.
and I have to use the bash shell restart NVIDIA Drive so that OLLAMA can use the AI.
#!/usr/bin/env bash
sudo systemctl daemon-reload
sudo systemctl restart ollama && sudo modprobe -r nvidia-drm && sudo modprobe -r nvidia-uvmOffline
Potentially unrelated but I do some AI work using CUDA with a combination of python and docker. I’ve noticed that after going into sleep mode, I had to fully reboot for the AI work to be able to run. Perhaps I can try some of the steps you listed here.
Offline
Potentially unrelated but I do some AI work using CUDA with a combination of python and docker. I’ve noticed that after going into sleep mode, I had to fully reboot for the AI work to be able to run. Perhaps I can try some of the steps you listed here.
Every time I wake Arch Linux, I am required to manually execute the script above. This is the best solution I have at the moment, but it still falls short of my expectations. I don't wish to manually run the script each time, and even incorporating it into an automated script doesn't seem to be satisfactory. Of course, I haven't implemented that yet.
Offline
Agree with you but perhaps these details can be somewhat diagnostic. Anything interesting in dmesg?
Offline
https://wiki.archlinux.org/title/Power_ … stem-sleep
https://wiki.archlinux.org/title/NVIDIA … er_suspend (the volatile VRAM won't get refreshed during the sleep, a hallmark of this problem is that very short sleep cycles would not have that problem)
Offline
Agree with you but perhaps these details can be somewhat diagnostic. Anything interesting in dmesg?
I know the reason but not clearly, It is relation with nvidia's status and wake up status, hard to explain. use the command to refresh the status that it will work.
Offline
https://wiki.archlinux.org/title/Power_ … stem-sleep
https://wiki.archlinux.org/title/NVIDIA … er_suspend (the volatile VRAM won't get refreshed during the sleep, a hallmark of this problem is that very short sleep cycles would not have that problem)
ok, thank you very much , I will try it late.
Offline