I think that we'll only turn over driving to a computer (for reals) when safety systems are good enough to prevent most accidents. I think we'll keep the safety system separate from the drive system.
Perfecting safety on human drivers first is the way to go and will most of the risk of lettings computers drive.