Problem is, the generation gap by that 'majority'. The younger the demographic you talk to is, the less they care. Without saying the two things are the same, just pointing out the generational differences, when you were my age someone your age would have used "common decency" to explain their discomfort with mixed race restrooms and marriages.
Fact of the matter is, when the generation split in a culture war goes that way, eventually the social conservatives get worn down and lose those battles.