That's the problem with centralization, walled gardens, and proprietary protocols. You won't ever have a problem if you just don't go into the gardens. Self-host with mumble, teamspeak, matrix, or something.
They all use the same Opus voice codec so it's not a quality issue.
