Well yes of course there's a maximum deviation. If you're too different you won't fit in. Not a bad thing because then there's no real point in being there anyway.
That's why you have to pick the communities you engage in so you fit. You don't have to change yourself but you pick the community to suit.
It's not an assumption though. I live in a city of millions and I'm in some communities of only hundreds of people. Which thrive and even have their own places. That's the nice thing, in a city it's easy to have enough scale even to make niche communities thrive.