Objectively, the group settles into a particular speed.
It's based on both safety and perceived safety, and it's not perfect, but it works out pretty well.
If the road is designed properly it's the top few percentile that you need to restrain, not the masses.
If you make a super wide straight shot of asphalt down a residential neighborhood, and people go too fast, that's the road designer's fault.