How to setup a notification in case of systemd service failure?

[waffle8946]

Notification on systemd service failures

I deploy my server with NixOps and I want to be notified about systemd service failures. Therefore I tried to extend every systemd service with onFailure. Currently I have something along the lines of { config, lib, pkgs, ... }: { config = lib.setAttrByPath [ "systemd" "services" ] (lib.genAttrs (lib.attrNames config.systemd.services) (serviceName: lib.setAttrByPath [ "serviceConfig" "onFailure" ] [ "email@%n.service" ])); } However, that will lead into an infinite recursion. Any…

tldr set up monitoring e.g. prometheus and friends