Cambodia (for example) has a terrible rubbish problem. They burn their trash, and vast amounts of it get thrown in the Mekong river and washed out to sea. There's also a big problem with unlicensed forest logging, and all sorts of environmental concerns. This is, primarily, because poor people are too busy with immediate survival concerns to worry about their environment.
Norway (for example) has a higher per-person consumption of resources, but also looks after its countryside and environment.
What's the relative damage being done to the global environment? Is there an argument that raising people out of poverty will actually reduce their impact on the environment even though it increases their resource consumption?