In hindsight this explained a lot of things. One example would be that I always was bad at blindfold chess even though I was a decent chess player. Before, I never understood how people can do this.
Still I am absolutely fine. I can recognize all these things. I can describe them. I just can "imagine" them.
After the first shock you understand that everything has pros and cons. E.g. I never have trouble sleeping. I close my eyes and turn the world around me off. My wife can see images very vividly and always has trouble going to sleep.
In the end we just need to accept that the brain is very complex and each of us has developed / adapted the best way, allowed by our biology.
Experiences like that are how I understand the question of 'shame' relating to aphantasia and the importance of 'diagnosis'/understanding how your mind actually works. 'Diagnosis' just helps you understand how to adapt and prevents you from slamming your head against approaches that won't work no matter how hard you try.
Similarly on sleep, I can sleep anywhere anytime with little effort and always tell my wife, who often has insomnia, "just close your eyes until you sleep" to her frustration.
What's really remarkable is how similar the life experiences are of most who have aphantasia...