> I started to had this thought especially when AI starting to take place in jobs replacing people.
At the moment this worries me less.
This week it became clear that tens of people here in Norway have been punished for crimes that didn't exist (the laws use where overriden by EU laws).
Except one or two managers leaving their positions nobody is likely to see any consequences it seems and it is hard for me to see how accountability should be implemented in such a system in a fair way.
What seems clear however is that a faceless AI has a real chance to make things extremely much worse, especially if most of its decisions are great. (If it mostly makes idiotic decisions it will be thrown out in a few months or years.)
