Not at all.

Gallium Arsenide works fine. So does Indium Phosphide. etc.

Silicon was much simpler to start and then path dependence kicked in. So, we poured R&D money at silicon because it was "better" than everything else. Then, because we poured R&D money at silicon, it was "better" than everything else. Lather, rinse, repeat.

For silicon not to exist, the universe would have to be quite different. Maybe making life possible and in some planet a life form might eventually find out how to build computers with whatever chemistry they'd end up with. And the chemistry of such a universe would seem uncannily suited for such computers.

Point being, you can't delete an element from the universe and expect everything else to be the same. Silicon exists because of the physics in this universe. So do silicon based computers.