I am not sure if that is really true or if it’s just that a 5 yr old can look back to when they were 3 yr old, a 10 yr old can do the same, so can a 20 yr old or an 80 yr old.
In the same amount of time anybody can look at their memories and say ‘gee… where did all the time go?’ The older you are the more that time is.