The more you read about this stuff, you realize that there's some real ugliness there - now and in the past. Maybe not everyone, but it goes well beyond the original intent of zoning to keep housing away from factories and tanneries and such.
https://www.sightline.org/2018/05/25/a-century-of-exclusion-...
Of course, in places like San Francisco and Portland, people are mostly smart enough to not "say the quiet part out loud", so they come up with other excuses.