There would be riots, for example, if agricultural workers were paid rates that would make Americans willing to do this. If you think food inflation is bad now, that would be off the charts.
Like it or not, we benefit from cheap labor, across many, many different industries.