I saw a similar thread recently, in which switching to pipewire was suggested in general, which solved the issue there. I had a similar problem with my volume resetting to 100% (but I think under different circumstances), and this also seems like switching to pipewire solved it (was using pulse before as well).
Thread here: Headphone volume resets itself to 100% - #2 by hmenke