No, memories accumulate. And in my very normal and apparently common experience, rose colored glasses and "I earned my success by struggling" make up for any past lack of happiness I've experienced. Those memories are white-washed unless you've had some severe trauma.

So the only thing that really matters is if you currently happy, or if you are about to become happy. Nothing accumulates.