Hi, I am a nixOS beginner for about a month. I tested openai-whisper-cpp 1.5.2 (from unstable and 23.11), it works great with CPU. I want to test it with CUDA GPU for speed. I use a modified nix file, and add cudaPackages libcublas cudatoolkit in buildInputs and cuda_nvcc in nativeBuildInputs, al…

[image] phaeseeKe5Ee: newStr = "-lcuda -L${pkgs.linuxPackages.nvidia_x11}/lib "; Hi! Great progress! Note that nvidia_x11 isn’t meant to be linked to directly, because its libcuda.so is only compatible with the .ko from the exact same nvidia_x11 revision. At build time one may link ${cudaPac…

Cannot get openai-whisper-cpp to work with CUDA

Help

Solene January 8, 2024, 12:59pm 2

I got this problem in the past

1 Like