Easiest is probably to revert those update commits touching the nvidia driver in a local Nixpkgs checkout of 23.11.