My experience with X11 over a network (across a city, geographically and distance-wise) was very poor. Slow updates, just extreme latency in doing anything. Not impossible to use, but definitely unusable by any reasonable metric. We're talking dozens of seconds for most GUI interactions.

I eventually piped it through RDP (mRDP, iirc), which itself was piped through a VPN. This vastly improved performance and made it so that I didn't have to be physically present at my workstation. Just as well, since it was during the early covid timeframe.