Have you tried stopping the qemu-guest-agent service, and starting the agent manually (you’ll find its location in ps x|grep qemu)? I’m having a similar problem with qemu not being able to connect to the agent (Qemu guest agent on Hetzner Cloud doesn't work) and so far that’s the only solution I’ve found.