This would reduce the housing stock.

The way capitalism works is that some people have excess capital, and they invest it. Housing is one such investment. People don't need multiple houses to live in, so multi-property owners rent out their investments, which is great because there are many people that can only afford renting, not buying.