Obviously, given the context, I am not trying to say immigrants don't pay taxes or follow the law. I am saying the the job of a government is to look after its own. If you have some better term for "its own people" go for it.
I'd also say, immigrants are only temporary non-citizens. If they are immigrating to stay, then it's the government's job to take care of them. Countries like the US and Australia were founded on immigrants.
If their loyalty is not to the country they are immigrating to, and is to their previous country's government, I am not sure why it would be a priority to support them.