I think that's more of a relative impact. When you have just one measurement, you know it's not particularly reliable. When you have a bunch, we are conditioned to think it's more reliable.
So in the latter case, the distance between its reliability and its perceived reliability is greater than in the former case.