I guess you need to specify what you mean by "tolerate"
If you're saying it's organizationally foolish to let Stallman be the face of the FSF due to his insensitivity... I can see a good argument there.
If you're saying we need to stop "tolerating" nerd insensitivity by condemning them on blogs and refusing to use their software and stuff like that, then I just think that is childish and pointless.