My co-worker rents a condo on VRBO and the condo board is perfectly fine with the short-term renters as they have far more trouble with long-term renters.
The real issue is how much real estate isn't available for long term renters because short term rentals are so much more profitable and easy. It's killer on vacancy rates and drives up rents for everyone.
I'm sure the condo board is fine: short term renters are probably less demanding in terms of services provided by the condo board. I suspect the buildings fellow residents might differ: they're the ones that suffer quality of life issues from (eg) party rentals.
For reference, co-op boards tend to outright ban short term rentals.