Brutal is a bit overstated, but it can be very chilly (especially in the foggy areas) compared to what people expect of summer. You often need to wear or carry along warm clothing even in July.

A lot of sweaters get sold at Fisherman's Wharf during summer months to people caught unaware.