1. Is this system calibrated down to the role and task at hand? Even just in tech, someone doing more design work is going to look different from the backend folks. Doubly so if one project is just starting while the other is midway.

2. How can we understand the potential bias already in this system? It's a black box by design, at what point is it reviewed and by whom?

3. Even if it's fine today, who is to say how it will be tuned tomorrow? Do you think new management would just leave it alone?

4. Do you think the people running this system are applying it to themselves equally?

IMO, this is a poor replacement for having a manager that's a human being and treats you like one too. I'm sad for people that can't find options away from these things, and can't vote with their bodies and leave.