The universe is physically big, which means we'd have a hard time finding life even if it was going on at the same time as us, but add time to the equation and it's game over. There could have been a star trek tier civilisation next door that died 1m years ago and we would probably never know
At that point you don’t have a single civilisation , you have thousands of functionally independent civilisations, with numbers increasing all the time. Sure something could wipe out a civ in one star system, but it couldn’t spread to others quickly enough to affect those others.
The most successful civilisations would continue to expand independently over time to take up all the resources in a galaxy.
Unless they found a way to travel faster than light, which means events could spread fast enough to collapse the civilisations.
https://en.wikipedia.org/wiki/Firstborn_hypothesis https://en.wikipedia.org/wiki/Formation_and_evolution_of_the... https://en.wikipedia.org/wiki/Nebular_hypothesis https://en.wikipedia.org/wiki/Protoplanetary_disk
Now you could still say that surely there have been enough time for some advanced civilizations to form. And I would argue that we don't know that. At least we have not detected them, either due our instruments or unwillingness of the intelligent life to communicate to us.
There are of course many other explanations of the Fermi Paradox. But since its all unknown, its basically pick and choose. I choose to pick the nice option. There are however other nice options :) https://en.wikipedia.org/wiki/Fermi_paradox#Hypothetical_exp...
Maybe intelligence isn't always a product of evolution. Even here on Earth, in the, what, 4 billion years history of the planet, humans are the only evolved creatures with intelligence as defined here. Maybe intelligence doesn't always occur.
A lengthy tangentially related post on my blog if you care -
https://www.rxjourney.net/extraterrestrial-intelligence-and-...
It is unlikely that other beings becoming intelligent enough to rival us and deny us the supremacy over the planet would ever be allowed. Homo sapiens are believed to have "contributed to" the extinction of several other modern-human-like species (one of them being the Neanderthals). How many other times before could something similar have happened, perhaps far earlier in the evolutionary timeline?
The only way we would allow sufficiently highly intelligent life to develop and flourish is if it is completely subservient to us.