> It's weird how it's not considered a basic human right to be able travel to where you want, and even live where you want as long as you can support yourself and comply with the local laws and customs
The "as long as you can" is exactly the reason. There is no way to ensure the travelers or migrants can (and want) to do that, if you don't have a border.
