Dream2nix with python poetry pytorch - `libcuda.so.1` not found

JonBoyleCoding · July 11, 2023, 1:44pm

I’m a little out of my depth on this one…

When trying to use a version of torch with dream2nix python with the poetry package manager, it fails with the following error:

       > auto-patchelf: 1 dependencies could not be satisfied
       > error: auto-patchelf could not satisfy dependency libcuda.so.1 wanted by /nix/store/nxy6vswgy0s0vzadv4cdsa2p2rnhm1a9-python3.10-eurmars-classifier/lib/python3.10/site-packages/torch/lib/libcaffe2_nvrtc.so
       > auto-patchelf failed to find all the required dependencies.
       > Add the missing dependencies to --libs or use `--ignore-missing="foo.so.1 bar.so etc.so"`.

Now looking through the torch-bin package I noticed this:

github.com

NixOS/nixpkgs/blob/4a729ce4b1fe5ec4fffc71c67c96aa5184ebb462/pkgs/development/python-modules/torch/bin.nix#L53-L59


      
          autoPatchelfIgnoreMissingDeps = lib.optionals stdenv.isLinux [
            # This is the hardware-dependent userspace driver that comes from
            # nvidia_x11 package. It must be deployed at runtime in
            # /run/opengl-driver/lib or pointed at by LD_LIBRARY_PATH variable, rather
            # than pinned in runpath
            "libcuda.so.1"
          ];

I presume something similar has to be done with dream2nix, but for all my efforts nothing seems to work. Does anyone have any thoughts on how I could get this to work?

I’ve tried many different overrides and have not been able to get it to work. I made an issue here with some of my attempts a few days ago: python - `torch` auto-patchelf could not satisfy dependency `libcuda.so.1` · Issue #556 · nix-community/dream2nix · GitHub

Any thoughts would be really appreciated. Thanks.