I'm on the same boat and I hear you. And since we are on this subject, do you know what else grinds my gears? The whole idea of cultural appropriation. So if your ancestry is X then you can't do/wear/celebrate Y.
So when you ask these people something like: Is it okay for my half-X, half-Y children to do this? they start feeling confused. But if you go: What about my grandchildren, who are 1/4 X and 1/4 Y and 1/2 Z?. Some of them begin to realize how racist and simplistic they are being.
Learn and enjoy other people's cultures, for goodness' sake. It's called being human.