The main difference is humans can be held accountable of these things, where as an AI system cannot be held accountable as it is not a human.
Accepting unchecked AI systems at scale as the future is plain fantasy in the view of regulator, especially in very high risk industries which is why it makes no sense for anyone to trust these systems without any assistance.