Investors have finite capital, and it's easier to corner a tight, pinched market than a large market with lots of liquidity.
You don't see PE making huge investments in gas stations, because you can always easily just go to another gas station, and there's way too many of them to easily corner the market. We could pretty easily make housing similarly unattractive.