That graph starts 70 years after the aforementioned coal miner scenario...
And yes, in the 1800s housing was comparatively cheap because land was close to free and you built your own home. Same goes for booze and venues to drink it because you made your own and there was zero regulation.
Today everyone is being choked by the relatively high cost of real estate (inflation looks ok because we have cheap durable goods like electronics). The death of 3rd spaces is well documented.