I've definitely noticed an overlap between the kinds of folks who want society to embrace and normalize violence against "Nazis" and the kinds of folks who go around accusing opponents of Nazism with little to no restraint.

Edit: I'm struggling to articulate this, but I also sense a rhetorical sleight-of-hand along the lines of "By definition, we only go after Nazis. If you claim that Nazi we went after was actually a conservative, that says more about you than it does about us and it makes us question your sympathies."