I never understood why our understanding of the ASI is relevant. Termites don't understand why we pave over wetlands and build shopping malls. If termites speculated on our motives they wouldn't get anywhere.
If an ASI is doing something we don't value, then why assume our values matter. If the only answer is "I'm a human, i want what i want" then meh.
