There exists a win-win equilibrium for upper class people.
It's an advantage for wealthy, educated blacks to live in mostly white neighborhoods, because it shows that they've "made it" according to the (admittedly racist) standards of success.
And it's an advantage for the white majority in such a neighborhood to have a few blacks around to demonstrate how incredibly non-racist they are.
(Obviously, the underclass (of whatever race) gets left out to dry.)