Not for me, I have been to plenty of meetups in my city. If you're not liked or don't get along with the others, the worst that can happen is that you'll be politely ostracized. The paranoia about being publicly "cancelled" seems very overblown.
For what it is worth, I didn't think the complainers went out of their way just to complain, they did have a genuine interest in the events. They just also liked to complain about the demographics and steer the groups towards things that would make us "more inclusive"
It always ended the same way: the group mostly dissolved
I unfortunately have known people that have died in car crashes, which is very tragic, but I don’t refuse to drive anywhere as a result. There’s no data on this but I suspect we have far more car deaths than we do individuals who have been socially ostracized as a result of someone spinning their comments as racist/misogynistic/etc…
Basically, it seems like a bad way to run your life. “I might get hit by lightning, better not go outside.”
You DO, however, control your own words and actions, and generally those have a strong correlation with how you're perceived. Food for thought.