I suspect that a lot of people forget the concept of mens rea (sometimes through lack of critical thinking, sometimes for deliberate conflation). Labels are easy to throw around; unconscious bias gets lumped together with racism. One is culpable behaviour, the other not paying attention. But again if someone wants to push a particular point of view it's just easier to label someone else as "bad" without having to explain exactly what is bad or how bad.

For every problem there is a solution that is simple, neat—and wrong. -- H.L. Mencken

and from a different social issue but highlighting how easy it is to go from "good guy" to "bad guy";

When I give food to the poor, they call me a saint. When I ask why they are poor, they call me a communist. -- Hélder Câmara