At the root of the problem in your question is how does society determine who has a right to live where. Obviously, given the opportunity, most of the world would want to live with on the California coast or similar places.

Obviously, the most basic answer to the question I posed above is “might makes right”. But we have moved past a situation where fight someone to take their land, and instead have to buy it.

Yes, the current system is unfair for most people. Most people will never get a chance to live where they want, and most people are born without the chance in the first place. So why should society let those born to wealthy moms get the spoils?

There isn’t a good answer, other than a better alternative hasn’t been invented yet. But at least in the current scenario, a small percentage of people can move into the places they want, giving enough hope that people aren’t resorting to war. Or they are unable to.