On the contrary. I've been on an island literally halfway across the world and it's been quite good. I primarily do non-SSH stuff. I surf the web, use IDEs etc.
When I'm at my cabin with 10/2 Mbps internet it's like I'm at home, except when I forget myself and start watching YouTube, then I notice the reduced quality of the video (RDP selectively encodes fast-updating regions to lowish bitrate h264 or similar).
I even do my Teams stuff over RDP, bidir sound just works without fiddling.