That's where they're intending to start (deporting those convicted of, possibly charged with, other crimes). Neither he nor his representatives have said that that's where they'll stop.
I guess we could assume he is pretending to bend towards the middle in order to avoid spooking people prior to consolidating power in the executive, after that he will pivot and cross the Rubicon. But Trump is no FDR so I don’t see him being able to pull that off even if he wanted to.