No it is not a universally Good Thing, that is an extremely facile reading of free speech.
Is it a good thing if someone at your job shouts racial epithets at you all day? Should woman have to tolerate being jeered and catcalled at every private business they patronize? Should a restaurant turn a blind eye to a belligerent customer that curses at the wait staff and everyone in ear shot?
Of course not. A private business has a vested interest in creating an environment where customers feel welcome. They could also choose to do nothing and let the chips fall where they may, but if enough bad actors make things bad for everyone else, that business will fail.
You have a right to not face retaliation from the government for speaking your mind. It doesn't mean everyone else has to accommodate whatever it is you have to say.