Arch Linux

avi9526

Member

Registered: 2015-05-15

Posts: 121

Properly wait for CUDA devices to be ready with systemd

I'm playing with some AI programs (open-webui+ollama, chatterbox-tts, comfyui) and all of them either need (to be effective) or require (to run at all) CUDA device. Which appears to be the problem at OS startup.
I have tried to use udev to create custom ***.device file and set it as dependency for AI services.
It doesn't work. Currently I have:

ExecStartPre=/usr/bin/sleep 5

which is ugly.
I can make this unit to be wanted by graphical.target. But is it right? IDK.
Anyone has experience with this problem?