I think what happens is when people have a routine outdoor activity, they develop a sense of their local weather, that seems like a mystery if one isn't regularly immersed in it. Also, some subtle adaptations make it easier, such as wearing quick drying clothes or having an emergency change at work.
Now, I do have the luxury of flexible hours at my workplace, but (for instance) my daughter doesn't, and she manages just fine.