Neat! I was also annoyed recently and hacked together a script that caches nix search results and uses rg. Its got no polish and problematic interface but I like not having to wait.
https://git.sr.ht/~twitchy0/deltron/tree/master/item/pkgs/nix-search.nix