Humans I can see benefitting from more/greater intelligence for sure. It could help mitigate existential threats of all kinds. I agree it depends who wields the power.
My point was that I think it's hard to argue that the world, as in Earth and it's non-human inhabitants, are better off because of human intelligence. So it's questionable whether more intelligence would change that.
I agree with that, human intelligence can be at odds with the well being of the rest of the natural world. It's my hope that we're on the cusp of reversing that, but at this point I don't think less intelligence (short of reduction of humans) will reverse the trend.
If anything I think reduction in distributed intelligence would and has made the situation far worse.