The universe was very hot in the beginning. It took a while for stars to form. Even longer for planets to form. Even longer for planets to cool down. The early universe was a violent place. Full of destruction. After the protoplanetary disk finally coalesces to planets and when planets finally stopped getting bombarded by meteorites, they could start cooling. In the earlier days of the universe there might have been intelligent life supporting planets wiped out by the chaos of the early universe. We might not be the first. But we might be one of the first. We might be early. The universe might have a bright future ahead of itself in terms of intelligent life. This is all speculation of course.

https://en.wikipedia.org/wiki/Firstborn_hypothesis https://en.wikipedia.org/wiki/Formation_and_evolution_of_the... https://en.wikipedia.org/wiki/Nebular_hypothesis https://en.wikipedia.org/wiki/Protoplanetary_disk

Now you could still say that surely there have been enough time for some advanced civilizations to form. And I would argue that we don't know that. At least we have not detected them, either due our instruments or unwillingness of the intelligent life to communicate to us.

There are of course many other explanations of the Fermi Paradox. But since its all unknown, its basically pick and choose. I choose to pick the nice option. There are however other nice options :) https://en.wikipedia.org/wiki/Fermi_paradox#Hypothetical_exp...