So because we can't fix their situation for them, we're allowed to actively make it worse? This is such a nonsense point of view. Exploitative industry is not like regular industry. This is not a rising tide that lifts all boats, this is enriching one or two psychopathic monsters at the expense of their entire region, and possibly financing even more in other regions.
The West does not need to go in and "fix" every developing nation, but at the same time, saying "well if we didn't sell them scrapheap ships or buy the minerals their children mine, they'd starve" is a complete abdication of responsibility for the role the demand for those minerals plays in their situation. They mine them because they can sell them, that's the whole point. If you remove the entities buying them, then there's no reason to mine them.