What extreme is that? As far as visiting when it's packed with Japanese tourists, I didn't see any downside aside from (obviously) some long lines and lots of people in the gardens.
Sure, Japan has some issues such as too much overwork in their culture, but America has that too. How many Silicon Valley engineers only work 40 hours? And how many poorer people have multiple part-time jobs to make ends meet and they still can't afford health insurance?