The way it works is that the origin country is worse off when people leave, but in general immigrants are much better off for moving, and it's not even close.

A big argument for letting people emigrate is that they owe no real debt to the county where they are born, or the city, or anything like that. They aren't selfs owned by a nobleman. If moving increases their personal lot, why should we stop them?