I have been driving for almost two decades with 0 accidents. I'm not saying I can't have a lapse of judgement or do something stupid going forward, but I certainly won't mis-class an object, nor kill myself over it.
I hypothetically want bad drivers to be replaced by AI because it's likely already better. But replacing everyone with AI (at the current generation of AI, which isn't the first, nor the last) will undoubtedly lead to tons of avoidable deaths, and I'm not keen on drawing a lottery ticket for it.