See that's the thing, I don't see how it can ever be safer than all but the least competent human drivers.
I have yet to see an autonomous vehicle that could cope with anything other than a completely unobstructed road with everyone behaving themselves, and I can't see a way for autonomous vehicles to progress beyond that.
If you don't think taxis are available 24/7, you haven't met anyone that drives a taxi. Someone is always up and about.