there's no repair involved. imagine a series of throwaway satellites on an orbit that essentially leaves them close enough together for effective mesh networking, and probably on an orbit that slowly takes them away from earth.
the compute is used for training, not inference. the redundancy and mesh networking means that if any of them die, it is no big deal.
and an orbit that takes them away from earth means they avoid cluttering up earth's orbital field.