Once you try to clamp down on investment properties, you have couples getting divorces so they can own two homes (this happened in China), and all your kids are going to have their own home as well.
It isn't a bad idea, people will game whatever. A singapore public housing system might work better, but I doubt it would work for SFHs.