I found a config that works, the problem is, since it creates a new xorg.conf and use it instead of the nixos-generated one, no keyboard or mouse is usable, all the other services.xserver configs in my configuration is meaningless
The said config: The Struggle to get Thunderbolt eGPU to output to its display at all in NixOS