It’s been a few years since I was there but last I was it had the very common tourist pattern of expensive vacation homes near the water for wealthy part time occupants and reasonable housing further away for permanent residents.
Frankly that area was better than many tourist areas where workers have to commute long distances to live in crap apartments or worse dormitories.