I disagree with the person you responded to, but want to thread this here.
Mathematics can be taught at early ages. Unfortunately, we tend to teach mathematics by rote. We teach arithmetic and not mathematics.
What we could be doing is teaching mathematics as a language. Mathematics is a language, it's an expressive language that relies on logic. Like any language, it is unconstained by reality and can be used to express concepts and ideals. In conjunction with other languages, it can express complexities and trivialities.
Unfortunately, we never seem to teach kids why, but simply teach them the method. We teach them a process, by rote and enforcement. We don't encourage discovery, nor do we try to explain the totality. In part, I believe, this is due to many who give instruction not actually having the knowledge to do so.
Tempting as this is to turn this into a novella, I'll try for brevity. It is true that mathematics isn't an easy subject, but a part of that difficulty comes from the way in which we teach it.