You have
A - Demand (immigration of 1 Million per year)
Or
B - Supply (building only 120,000 houses per year)
We MUST fix one or both of these sides of the equation. Holiday homes aren't going to add up to a row of beans quite frankly (and will have very negative effects on the tourism industry, not so bad in London - but might be quite an impact in cornwall for example).