Since we are never at infinity, our observations are always finite, all this is saying is "we always deal with approximations of reality," i.e., statistics is never, in fact, about the "actual truth", it is about testing the set of our limited observations of reality against a model.