Docker with nvidia-container-toolkit does not run

[ruffsl]

What happens if you omit capabilities: [gpu] from your compose file?

          devices:
          - driver: cdi
-            capabilities: [gpu]
            device_ids:
            - nvidia.com/gpu=all

I don’t see capabilities declared in prior posts:

Nvidia docker container runtime doesn't detect my gpu

Hello @Traktorbek! You need to adapt your docker-compose file so that it uses the CDI driver, like documented in Nixpkgs Reference Manual. In your case, it should be along the lines: pipeline: image: '${DOCKER_IMAGE_PIPELINE?Variable not set}:${TAG-latest}' build: target: development context: ./pipeline args: - PIPELINE_BASE_IMAGE=${PIPELINE_BASE_IMAGE} environment: - CONFIG_PATH=${PIPELINE_CONFIG_PATH} runtime: ${DOCKER_RUNTIME:-runc} restart: always deploy: …

virtualisation.docker.enableNvidia vs hardware.nvidia-container-toolkit.enable

I’ve been using this: deploy: resources: reservations: devices: - driver: cdi device_ids: - nvidia.com/gpu=all Container runs, but vulkan doesn’t work for me - not sure if cuda would work… If you find out anything else, I’d be happy to hear about it… Trying to switch to NixOS as main OS and this is kinda stopping me