I think framing this as being about speech with which one disagrees, or finds repugnant, is a bit disingenuous. It omits consideration of the possibility of speech that is genuinely harmful. For a few examples:

- My friends and I decide it'd be cool to put you in jail, so we report you as committing a serious crime that you didn't, and all give matching testimony that leads to your conviction.

- Pfizer starts selling a new drug that cures cancer. Except it turns out that they completely fabricated all the studies showing its effect, and actually the pills are nothing but placebos.

- A mugger with his hand in his pocket stops you at night and says, "Give me your wallet or I'll shoot you." You give him your wallet and he leaves.

I hope you would agree that these situations are... not ideal, and that the law should be able to discourage them. Despite the fact that all of these are, indisputably, speech.