A good overview of the allergy situation is here: https://en.wikipedia.org/wiki/Hygiene_hypothesis
Though that article goes into more about young human immune systems too. TLDR: Yeah ... it's complicated, but the evidence seems to, just maybe, lean towards more exposure being better. So, you're right, I think?