To your point, every team in my org also has one or more... but it's not enough to have one in each team. More than half of the population of the United States are women, and far less than half of our engineering teams are comprised of women. And when talking about people of color, the stats are even worse. It's less about whether we have any and more about whether our team composition reflects the population accurately.
To your other point, one of the reasons our teams are composed inequitably like this is because of exactly what you described: we have to take ANYONE who is qualified and accepts an offer, because otherwise we'd never even come close to our hiring goals! (Not that we ever meet those, anyway...)