Using a python wheel-only library

Hi I have an odd python package which has it’s wheels not at the URL that’s generated by fetchPypi

{ lib, python3Packages }:
python3Packages.buildPythonPackage rec {
  pname = "opencv-contrib-python-headless";
  version = "4.5.3.56";
  format = "wheel";


  src = python3Packages.fetchPypi {
    inherit pname version format;
    sha256 = "";
    python = "cp39";
    abi = "cp39";
    platform = "manylinux2014_x86_64";
  };
}

This tries to fetch the url https://files.pythonhosted.org/packages/py3/o/opencv-contrib-python-headless/opencv-contrib-python-headless-4.5.3.56-cp39-cp39-manylinux2014_x86_64.whl, which 404s.

Now normally when I do a pip -v install opencv-contrib-python-headless==4.5.3.56, I get a request to https://pypi.org/simple/opencv-contrib-python-headless/ first, then it downloads one of those .whl from there. How can I do that with nix?