Except that the average person doesn't have the same access to financing as some minority of well connected entities to financing bodies. Access to cheap or even free lending. The fed prints more money than the economy actually creates.
It's a rigged market. That's why it doesn't work. Limiting properties would attenuate the problem, but it's just a bandade solution, and a few will again find loopholes to benefit.