> Is it controversial that companies aren't allowed to refuse service based on gender or race (in the US at least)?

Those are legal categories known as "protected classes," and yeah, it was and is pretty controversial[1]. I think you'd have a hard time getting purchasers of porn games declared a protected class.

[1] https://en.wikipedia.org/wiki/Civil_Rights_Act_of_1964 ; further reading, https://en.wikipedia.org/wiki/Protected_group