First, the primary use case of rockets (especially SpaceX) is satellite lift and ultimately Moon and Mars landing, not "wealthy tourists." Obviously the recent Inspiration4 launch shows that there will be tourist flights, but this appears to be the exception and not the norm (unlike Blue Origin and Virgin Galactic).
Second, there are approximately 100,000 airline flights per day worldwide; American Airlines alone flies 5,000 per day. Even 1,000 rocket launches per year would be equivalent to 5 days of traditional flights.
People disagree with the climate concern not because "Elon Musk is involved" - it is because critics are focused on the wrong thing. There are far more climate destructive practices with far less benefit to the good of mankind. All those 100,000 flights per day? That only accounts for about 2% of carbon emissions. A SpaceX launch, to use your figures, accounts for 0.00005%.
So why focus on this extraordinarily tiny fraction of climate impact? Is it because it's Elon? Because rockets look big and thus wasteful?
What about the incredibly important climate monitoring satellites they'll lift, or benefits like GPS, global internet, potential breakthroughs in space manufacturing, astronomy, or physics? Or even just the hope and excitement about the future that many feel in the face of otherwise depressing news everywhere. The massive size and lift capacity of the Starship (100 tons to orbit, 8m wide by 20m high or so) will transform activities in low earth orbit and beyond.
And I'll close by saying, yes I think Elon has earned a little slack - he has done more than most people on the planet to reduce global emissions. Tesla, Solar City (now Tesla solar), battery technology (which has been a massive impediment to clean energy storage), future electric long-haul trucks, and the supercharger network (to make extended travel on electric vehicles possible) all have reduced emissions tremendously - probably far more than the additional carbon from rocket launches (though I haven't done the math).
So that's my $0.02, anyway.