Last time I heard, stites was working on a Hydra for the GPU libs.
For now you can use his GitHub - stites/pytorch-world: nix scripts for pytorch-related libraries repo with the cachix binary cache.
@stites : how close are you from a working automated binary cache for PyTorch ? 