It's more complex than that. When I'm not looking to sell, I certainly don't want the assessed value of my house to increase. That just means, higher property tax bill for me.
Also, houses get older every day. Tastes change - ranch, open-plan, multi-story, multi family get more or less valued as time goes on. Not just 'fewer houses means better resale value'. In fact, a shortage may not change housing prices at all - sometimes it just makes them sell faster.
It's easy to take a complex picture, connect a dot or two and draw a line from someplace to some conclusion. But it's always a trickier picture than that. You gotta consider more dots and connect them all.