Agreed, I think the simple answer is the tax rate is one thing for a primary residence and another for non-primary residences regardless of who owns it. For example in CA, Prop 13 stays in place for your primary residence, but properties are re-assessed every year like in Texas if it's not your primary residence. In addition, take away some (or all) of the tax deductions for SFH that aren't primary residences.