Ollama version is too old to run gemma2

Help
1

The ollama latest ollama version is 0.2.3 but nixpkg is still in 0.1.38 and gemma2 require versions 0.1.47 or later. Is there any plan to update it?

2

probably too late now but I was able install 0.3.12 on 24.05 by
replacing default service to unstable

{ config, pkgs, lib, ... }:

let 
  unstablepkgs = import (builtins.fetchTarball https://github.com/nixos/nixpkgs/tarball/nixos-unstable) {};
in {
  disabledModules = [ "services/misc/ollama.nix" ];
  imports = [
    "${unstablepkgs.path}/nixos/modules/services/misc/ollama.nix"
  ];

  services.ollama.enable = true;
  services.ollama.acceleration = "cuda";
  services.ollama.package = unstablepkgs.ollama;
}

and also by upgrading nvidia driver to latest one

hardware.nvidia = {
  package = config.boot.kernelPackages.nvidiaPackages.mkDriver {
    version = "550.120";
    sha256_64bit = "sha256-gBkoJ0dTzM52JwmOoHjMNwcN2uBN46oIRZHAX8cDVpc=";
    sha256_aarch64 = "sha256-dzTEUuSIWKEuAMhsL9QkR7CCHpm6m9ZwtGSpSKqwJdc=";
    openSha256 = "sha256-O3OrGGDR+xrpfyPVQ04aM3eGI6aWuZfRzmaPjMfnGIg=";
    settingsSha256 = "sha256-fPfIPwpIijoUpNlAUt9C8EeXR5In633qnlelL+btGbU=";
    persistencedSha256 = "sha256-ztEemWt0VR+cQbxDmMnAbEVfThdvASHni4SJ0dTZ2T4=";
  };
};
1 Like