As a fellow Indian immigrant, I actually share your discomfort, and always try to be inclusive and diverse in my social groups. Most of my Indian coworkers and friends behave this way — we came to the US to be a part of a mixed culture, so our social groups should be diverse.

What makes me uncomfortable is that this inclusivity is increasingly being taken for granted to the point where not having it starts conversations about how to "fight back".

Even though it's not my preference I don't think there is anything wrong with Indians cracking jokes in a non-English language, or going to a restaurant by themselves. You will find that Americans will mysteriously be far more tolerant of, say, a group of French people talking among themselves in French; and going to a French restaurant as a group.