So, imagine that some humans make this choice and then AI autonomously takes over and humans can't stop it anymore. Is that enough to treat AI in such a situation as a magical alien something that can threaten your or my survival?
One thing that the whole AI debate has shown to me is how many people completely lack any sort of imagation.