I’ve spent considerable time in Tokyo in recent years as well. It’s largely the same as it ever was. “Incidents” with tourists are clearly blown out of proportion by local social media. Yes, there are visibly more foreigners than in 2008 (mostly immigrants who work and speak Japanese). No, the character of the city has not changed.
On my Shinkansen from Kyoto to Tokyo most recently, a noisy quartet of drunk guys chatted loudly for over a hour on the late evening weekday train and spilled a beer. Can you imagine the horror? They were Japanese restaurateurs from Osaka.