Latency makes it totally impossible to do that securely. Reaction times in case of a problem is the difference between life and dead and you cannot "outsource" that to someone 1000 miles away: network latency, monitor latency, input method latency (I send an "emergency braking order", network latency a second time.
Impossible within our current understanding of physics: I mean... You could do it, but the added delay for reaction times would literally have many people killed.
Guiding a drone / missile is kiddie stuff compared to remotely driving a car in trafic.