Yeah. This is how prejudice works. It doesn't matter what you do, if you're X you'll be (pre)judged as an X and nothing short of an immaculate behaviour will prevent people from just pointing at some past mistakes or self-serving behaviours to undo all positive actions you may have done