That's not my understanding of micro-aggressions [1]. IIUC, inadvertently doing a micro-aggression isn't being an asshole, but persisting in it after it has been pointed out definitely is.

[1]: Disclosure: I'm a minority (disabled), but I'm also a white man.