The distinction is that money provides opportunities, poverty is the lack of them.
You can hold the wealthy responsible for what they do with their wealth, or what they don't do with their wealth. Because wealth is something they HAVE. The poor, on the other hand, don't HAVE anything, so you can't say they are using their lack of wealth foolishly, nor can you say they are failing to use their lack of wealth wisely.