Your idea reminds me of a recent novella by Cory Doctorow, Unauthorized Bread. In there, there was an apartment tower with an elevator that had separate doors for poor and rich people (with the two groups living on different floors), and the poor people couldn't call the elevator when it was in use by the rich.