> About 25% [1] of the population are foreigners, so it can't be that bad?
It's not a convincing argument. As counterexample, until not to recently, black people were a sizable portion of the US population, and it was literally that bad for them...
They did come to Switzerland voluntarily and could have left any time they wanted, that must mean something. However an overwhelming majority of that 25% are white and European so I agree that it's not the most convincing argument.