Ollama SIGSEGV with missing CUDA kernel image

Help
9

Apparently my initial google-fu was lacking. This is a known bug: ollama-cuda: works with only subset of GPU CUDA architectures supported by ollama, not documented anywhere · Issue #421775 · NixOS/nixpkgs · GitHub . Workaround is to add

 nixpkgs.config.packageOverrides = pkgs: {
    ollama = pkgs.ollama.override {
      cudaArches = [ "61" ];
    };
  };

to your configuration.nix so it builds in support for your cuda architecture.