Rocblas-6.0.2 failure to build with ollama acceleration = rocm is broken with 24.05 upgrade

so that’s good to know

No, that’s my guess :sweat_smile: … I assume the error coming from python has that cause. I am not totally sure though.

how do I increase tmpfs on nixos?

I guess you could try unmounting the /tmp mountpoint and just create a directory in /tmp on your root partition? There is an old thread where this was suggested, however it is quite old indeed: How to get rid of /tmp?

I would not guarantee for this solution either… :slight_smile:

I don’t have this mount point in the first place. I use btrfs on my machine instead of ext4. The btrfs setup seems to handle this by creating a subvolume for tmp. In which case you just share the underlying filesystem space. So for me /tmp has all that is left of the 2 TB of my nvme drive.

and as for the cache

I meant the binary cache where the pre-compiled binaries are being fetched from. Since you have that in your config, idk why it doesn’t do that. If you add rocBLAS to your regular selection of ROCm libraries, but don’t activate ollama, will it try to compile stuff or just fetch the prebuilt library?

Because let’s be honest, even if you could compile rocBLAS from scratch on your machine, you most likely don’t want to do that.