Ok, that's all pretty subjective.
I said in another comment, If you were a police officer, pilot, truck driver, deep sea diver or in numerous other professions, you'd be expected to do some weird hours and have a lot of time away from home.
This is where I think people are being unreasonable. Remote work, we have it better than ever, no commutes, no time away from family, almost non-inconvenience but now, even a late night meeting is against "my time".
I think with remote work, the cost of walking 50 meters, sitting in a comfortable chair and dialing into a meeting from 11pm-12am is pretty inconsequential all things considered. You can probably have the meeting in your jammies on the couch.
I'm not 100% discounting that it's inconvenient, but I mean, relative to the things I've been through and others have to go through, it's minuscule in comparison.
Lastly, I think you're just lucky you work for a company who allows you to just say no to meeting with your peers in other time zones. Again, you might be lucky and everyone has a good crossover with you, but many don't have this luxury, and never meeting with your peers, at least where I work, means you're not part of the team and you're getting fired.
We rotate the difficult meetings in the group so we all feel some of the pain, but three is a bit of pain and I guess that's why it's called "a job" and why I'm part of a team.