If you hire someone over someone else due to an immutable quality such as their skin colour, sexual orientation (which shouldn't even be a thing to discuss on a job interview), hair colour, sex, gender etc than that is discrimination, and in the case of race, racist. Just because the majority of racism happens in one way, does not mean it's not racism in the other way.

Unless the immutable quality somehow makes the person physically better for the job, such as males typically having better muscle/bone mass which gives them an advantage for physical work (e.g. oil rigs), or employing a black female actor to play a black female character.

If you hire based on someone's race, that would appear to be racist.

In my experience, the DEI office rejected the results of an interview panel after the interview-and-candidate-selection stage because the candidates selected by the interviewers and interviewing panel to receive offers were "insufficiently diverse". This resulted in Corporate closing the job requisition because they didn't feel like dealing with the hassle (and expense) of repeating the process. (This sucked because we fucking needed that hole to be filled... but there's no arguing with Corporate.)

This is an N=1 report, and I'm sure there are other companies that aren't so super-fucked, but at this particular company, this is how it went down.

This scenario doesn't meet the strict definition of "diversity hire", but it sure does feel like actions motivated by the same sort of reasoning.