Is there any danger in swapping desktop environments, window managers, etc?

Or suppose I went further, and switched to xfce + xmonad, and then switched back to kde. Should I expect all my KDE configurations (KDE requires a lot of manual config) to survive the trip?