To continue using the files as a submodule, you would need to fetch submodules explicitly for the corresponding input, like in this thread.
For programs that are supported by home manager it would be better to migrate to the home manager’s options rather than managing symlinks.