No.
So it's not about race. (I just gave you proof.)
It's about wealth and social class. Sure, those might correlate with race, and even be caused by racism (past or present), but virtually all real world consequences are downstream of wealth (in particular the ones mentioned: where you live, what you can afford, the amount of free time you have, your health, your nutrition, access to education/jobs, ...).
If you ignore wealth and focus on race, you're racist.