My gut feeling that wealth disparity is a bigger issue than absolute wealth. If the poor lived in mansions and drove Ferraris, but the rich owned entire islands and private rocket ships that travel to Mars, the poor people still wouldn't have access to what the wealthier people have, still setting them back from achieving their true potential.
