One issue I discovered yesterday is that I had stale ControlMaster sockets in /root/.ssh/ and nix was showing connecting to ssh://builder in verbose log, but nothing else, and it also never timed out 
I’m on nixUnstable right now on all machines and remote builds are working for me again.