As I have some Brazilian friends that disagree with you I went to the statistic data and it doesn't look so bad.
For instance,the poverty headcount:
http://data.worldbank.org/indicator/SI.POV.NAHC?locations=BR
Specially against this one, a growing population:
http://data.worldbank.org/indicator/SP.POP.TOTL?locations=BR