so that’s good to know
No, that’s my guess … I assume the error coming from python has that cause. I am not totally sure though.
how do I increase tmpfs on nixos?
I guess you could try unmounting the /tmp
mountpoint and just create a directory in /tmp
on your root partition? There is an old thread where this was suggested, however it is quite old indeed: How to get rid of /tmp?
I would not guarantee for this solution either…
I don’t have this mount point in the first place. I use btrfs
on my machine instead of ext4
. The btrfs
setup seems to handle this by creating a subvolume for tmp. In which case you just share the underlying filesystem space. So for me /tmp
has all that is left of the 2 TB of my nvme drive.
and as for the cache
I meant the binary cache where the pre-compiled binaries are being fetched from. Since you have that in your config, idk why it doesn’t do that. If you add rocBLAS
to your regular selection of ROCm libraries, but don’t activate ollama, will it try to compile stuff or just fetch the prebuilt library?
Because let’s be honest, even if you could compile rocBLAS from scratch on your machine, you most likely don’t want to do that.