I have almost no latency issues with RDP in Azure. I can watch a YouTube video with no major latency. Workspaces wasn't terrible in that regard but definitely not as smooth.
The Azure machine is a bit beefier than Workspaces, so that probably factors into it.