ROCm package caches

I just got my new Framework mainboard with the 7840U and I was eager to try out jax and AMDGPU.jl using ROCm. While AMDGPU.jl can be activated without a few of the needed libraries being installed, jax refuses to load if not all libs are present. So I went and installed them one by one, but it seems like two of them are needed to be compiled: miopen and rccl. Is it intended for those two packages not having a cache or am I doing something wrong?

EDIT: it is not miopen specifically which takes a long time, but composable kernel.

IIRC their output paths were too large for hydra, causing them to not be cached.

Though sometimes they’re also simply broken.

ROCm is a mess.

Thanks for the explanation! Didn’t know hydra had an upper limit for caching. I compiled rccl in an hour and miopen is also compiling over an hour now :') Maybe I will upload it to cachix (if I figure out how) in the future, just in case I need it somewhere else, or to compile it on one of my work servers and speed it up that way!