The people he's targeting now are Americans, which for better or worse people are much less willing to tolerate. Green card and visa holders are Americans.
This map doesn't say anything about visa holders and green card holders. It is only relevant for persons born in the country, which I'm assuming most visa/green card holders aren't.
Visa holders are not necessarily "Americans". For example holders of G-{1-4} Visas from the proscribed countries are not affected by the ban and remain foreign nationals.
