The problem is that patches are not derivations, and nixpkgs are derivations, so with flakes this is currently simply not possible. This is still an open issue at the moment: 3920
Also this kind of works as a temporary hack