This is precisely why hiring for "cultural fit", very often also called "company culture" or "company values", often leads to racial or other discrimination. Because different groups hold different values. E.g. white guys from expensive colleges hiring people who "align with their values" can result in deeply discriminatory behavior -- racially, culturally, socioeconomically, etc. -- even if that's not the intention.