You do not add the submodule itself as an input, you need to add the submodules=1 query parameter to the input that has the submodule.
If this is your “self”, you need to provide the query parameter on each CLI invocation.
nix build '.?submodules=1'