And in most scenarios when I've had to argue against isolationists they tend to ignore issues such as Americans refusing to work in certain labor sectors that illegal immigrants tend to work (and be abused without employers being punished, see: farm work) the way we treat immigrants right now (especially those seeking asylum) and so forth which ends up leading to a root motivation of racism rather than any actual practical reasons.
You've also managed to paint them with the stereotypical 'they took our jobs' mindset which, well, tends to thrive in more xenophobic communities.