If people don't want to associate with a person who says awful things, it's not a violation of their freedom of speech to disassociate with them.
Time will come there will be regulations aiming to fix that, because slander laws apparently aren't enough. And then people will come out and talk about freedom of speech, but the only answer will be, "you had it, and you misused it, and almost ripped the society apart".
Your freedom of speech doesn't trump anyone else's freedom of speech. If someone is knowingly or recklessly spreading harmful lies, you have recourse for that, but freedom of speech includes freedom of angry speech, and outside of harmful knowing and reckless lies, it included the freedom to be wrong in your speech.
[1] - This event was started by somebody sending a copy of a discussion on a private mailing list to a third party. This third party then took social media and shared it. It fell flat, except for a handful of 'Twitter activists'. They then started spamming it off to their followers and media outlet they could find. Some of the clickiest baitiest institutions took it up along with some completely unrelated Twitter personalities. It all spun what were relatively innocuous comments into limited context outrage bait and that then caught the outrage train spot on.