Arch Linux

alllexx88

Member

Registered: 2023-12-22

Posts: 52

Getting nvidia-container-toolkit to work with Docker Desktop

Has anyone been able to launch nvidia-container-runtime with this Docker Desktop? nvidia-container-toolkit is installed, my docker desktop engine config looks like this (Docker Desktop: Settings->Docker Engine):

{
  "builder": {
    "gc": {
      "defaultKeepStorage": "20GB",
      "enabled": true
    }
  },
  "runtimes": {
    "nvidia": {
      "args": [],
      "path": "nvidia-container-runtime"
    }
  }
}

Yet I'm getting an error:

$ docker run --rm -it --runtime=nvidia --gpus all ubuntu:latest nvidia-smi
docker: Error response from daemon: could not select device driver "" with capabilities: [[gpu]].

If I switch to the default context (the system docker) it works:

$ docker context use default
default
Current context is now "default"
$ docker run --rm -it --runtime=nvidia --gpus all ubuntu:latest nvidia-smi
Fri Nov  1 16:19:30 2024       
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 565.57.01              Driver Version: 565.57.01      CUDA Version: 12.7     |
|-----------------------------------------+------------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
|                                         |                        |               MIG M. |
|=========================================+========================+======================|
|   0  NVIDIA GeForce RTX 4070 ...    Off |   00000000:01:00.0  On |                  N/A |
| N/A   51C    P5             11W /   80W |    1380MiB /   8188MiB |      2%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+
|   1  NVIDIA GeForce RTX 4070 Ti     Off |   00000000:04:00.0 Off |                  N/A |
|  0%   30C    P8              1W /  285W |       2MiB /  12282MiB |      0%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+
                                                                                         
+-----------------------------------------------------------------------------------------+
| Processes:                                                                              |
|  GPU   GI   CI        PID   Type   Process name                              GPU Memory |
|        ID   ID                                                               Usage      |
|=========================================================================================|
+-----------------------------------------------------------------------------------------+

The default docker config is:

$ cat /etc/docker/daemon.json 
{
    "runtimes": {
        "nvidia": {
            "args": [],
            "path": "nvidia-container-runtime"
        }
    }
}

Any ideas? Thanks!