this whole argument depends on whether "White" means wealthy and "Black" means poor.
And the fact is, being white is NOT synonymous with having money, and being black is NOT synonymous with being poor.
Synonymous, no. But highly correlated. And precisely because of the way that racial segregation by neighborhood correlates with income disparity by race, desegregation by race is a good first approach to solving the problem.
Don't let the best become the enemy of the merely good.