He said they want to move all the HQs to Texas, which implies they could still have offices in California just maybe smaller. This may be part of the plan.

They are also opening a new Palo Alto office for xAI where they could move a lot of engineering talent as well. Which is likely the other big reason.