The ollama latest ollama version is 0.2.3 but nixpkg is still in 0.1.38 and gemma2 require versions 0.1.47 or later. Is there any plan to update it?
probably too late now but I was able install 0.3.12 on 24.05 by
replacing default service to unstable
{ config, pkgs, lib, ... }:
let
unstablepkgs = import (builtins.fetchTarball https://github.com/nixos/nixpkgs/tarball/nixos-unstable) {};
in {
disabledModules = [ "services/misc/ollama.nix" ];
imports = [
"${unstablepkgs.path}/nixos/modules/services/misc/ollama.nix"
];
services.ollama.enable = true;
services.ollama.acceleration = "cuda";
services.ollama.package = unstablepkgs.ollama;
}
and also by upgrading nvidia driver to latest one
hardware.nvidia = {
package = config.boot.kernelPackages.nvidiaPackages.mkDriver {
version = "550.120";
sha256_64bit = "sha256-gBkoJ0dTzM52JwmOoHjMNwcN2uBN46oIRZHAX8cDVpc=";
sha256_aarch64 = "sha256-dzTEUuSIWKEuAMhsL9QkR7CCHpm6m9ZwtGSpSKqwJdc=";
openSha256 = "sha256-O3OrGGDR+xrpfyPVQ04aM3eGI6aWuZfRzmaPjMfnGIg=";
settingsSha256 = "sha256-fPfIPwpIijoUpNlAUt9C8EeXR5In633qnlelL+btGbU=";
persistencedSha256 = "sha256-ztEemWt0VR+cQbxDmMnAbEVfThdvASHni4SJ0dTZ2T4=";
};
};
1 Like