You need to remove/backup one or more dotfiles (files in your home directory). Not your nix config.
journalctl -xeu home-manager-evangelist.service should give you the home-manager logs. Have a look for the files home-manager wants to backup.
Be careful with home-manager. It doesn’t support rollbacks. If your home directory gets messed up you’ll have to fix it yourself: words of warning