It's 60 days, not 2 weeks, and you can transfer an H1B over to a new job within that 60 days, or if you know you're going to be terminated (e.g. you're on a PIP) then you can transfer the H1B to a new employer anyway.
Wouldn't say it's necessarily easy to do so, but it's not an automatic deported from the country kind of deal.