An SAT score is an assessment of how well you will do in college. It's not something you can earn or deserve. If someone does less well than you but came from a much worse school district, why shouldn't a predictor take that into account?

If this were almost any other example of adding a modifier to correct for a bias in an initial scoring system, nobody would bat an eye, and we'd be discussing specifics.