@lucasew I’ve built the nixpkgs-update-notifier (see discussion) for exactly this use-case, albeit in regards to nixpkgs-update.
I’m planning on adding Hydra integration though, at which point you’ll receive Matrix notifications when a package fails to build on Hydra as well.