Ollama version is too old to run gemma2

The ollama latest ollama version is 0.2.3 but nixpkg is still in 0.1.38 and gemma2 require versions 0.1.47 or later. Is there any plan to update it?

probably too late now but I was able install 0.3.12 on 24.05 by
replacing default service to unstable

{ config, pkgs, lib, ... }:

let 
  unstablepkgs = import (builtins.fetchTarball https://github.com/nixos/nixpkgs/tarball/nixos-unstable) {};
in {
  disabledModules = [ "services/misc/ollama.nix" ];
  imports = [
    "${unstablepkgs.path}/nixos/modules/services/misc/ollama.nix"
  ];

  services.ollama.enable = true;
  services.ollama.acceleration = "cuda";
  services.ollama.package = unstablepkgs.ollama;
}

and also by upgrading nvidia driver to latest one

hardware.nvidia = {
  package = config.boot.kernelPackages.nvidiaPackages.mkDriver {
    version = "550.120";
    sha256_64bit = "sha256-gBkoJ0dTzM52JwmOoHjMNwcN2uBN46oIRZHAX8cDVpc=";
    sha256_aarch64 = "sha256-dzTEUuSIWKEuAMhsL9QkR7CCHpm6m9ZwtGSpSKqwJdc=";
    openSha256 = "sha256-O3OrGGDR+xrpfyPVQ04aM3eGI6aWuZfRzmaPjMfnGIg=";
    settingsSha256 = "sha256-fPfIPwpIijoUpNlAUt9C8EeXR5In633qnlelL+btGbU=";
    persistencedSha256 = "sha256-ztEemWt0VR+cQbxDmMnAbEVfThdvASHni4SJ0dTZ2T4=";
  };
};
1 Like