This is an argument to extremes, and it falls apart when you go to the other extreme: if you refuse to make any adjustments then you're now unable to separate the marginal effect of the school from the much larger effect of socioeconomic status. This would likewise obscure significant problems and encourage incorrect solutions.
The correct approach is to adjust for demographics but do so carefully, rigorously, and consistently.