> The problem is that companies also want an objective hiring process
Usually only at a very superficial level. Enough to comply with the law. And to be fair, some companies do have good intentions with a little extra effort and money put into diversity efforts.
A truly objective hiring process would take into account that Joe and Charley who both got the same results on the coding test are not equally qualified if Joe grew up poor, with parents who never graduated high school, paid his own way through university by working full-time, and along with raising a child as a single parent. While Charley comes from a wealthy family and focused only on studying and job interview prep. With his parents passing along some of their own higher education to him as needed, connecting him to their large network for job opportunities, etc.
Joe is obviously a better candidate. His starting line was far behind Charley's and yet he crossed the finish line at the same time. Joe would be a better candidate even if he passed the finish line a little after Charley. If you want a truly objective hiring process you need to look at starting lines, not just finish lines.
Most companies are doing almost the opposite and only looking at the finish line. They want to look only at the skills and exclude the actual person in a misguided effort to be objective.
All that really does it amplify existing societal bias and privilege by rewarding those who got the most breaks in life.
> this is such a difficult problem to solve.
Agreed. And it would be more expensive. Part of why the status quo is so hard to change. You've got to spend the money and do the work. Or take shortcuts and discriminate on one side or the other.