No, you only pay for time worked in CA. The only exception I found are options/RSUs granted in CA and vested after you've left, these may be taxed in proportion to the time originally worked in CA after the grant.