That's not true. Creating a hostile environment and perpetuating attitudes that lead to prejudiced action is hurting people. The words you say tug towards the culture you want, and when that culture's thing is hurting the weak, you're responsible for it.