Cue the 1960s and 70s long before any social media and the amazing amount of not just protests but bombings, assassinations and so on that make the current culture war seem like a mere shouting match.
Before the media started using social media as “facts” for their reporting, these arguments would just be another online “flame war.” Remember when we used those terms? Remember when online arguments remained as just that?
Now, when 1000 people on Twitter try to cancel someone the media reports it as if it’s an actual popular opinion, thus amplifying the problem for better or worse.
I find it tough to blame the news for this — the social media companies were making deliberate design choices and the news companies were reacting in an attempt to stay in business in a rapidly changing market.
For an analogy imagine a town that with an arsonist setting lots of homes on fire. It is obviously true that "storing gas in your hose contributes to houses burning down", but "getting rid of gasoline in house will not fix the fires".
For clarity I consider "the algorithm" the sophisticated ordering of your follower's posts, and the recommendation of new followers. This means getting rid of "the algorithm" mostly means going back to the 00's when post where sorted by date, likes, or simple formula that combined the two. Content still went viral, and people still sorted themselves into information silos. This meant people spend more time searching for content, but I don't see any real fundamental difference that is going to result in less polarization.
The underlying problem is people communicating with other people. I argue if we got rid of the internet it would not get rid of this polarization and spread of misinformation and conspiracy theories. In fact you saw many similar problems prior to the Civl War, when the fastest method of communication was a telegram. People still distributed pamphlets, formed clubs with like minded individuals, gossiped, and spread rumors and falsehoods.
I think people grab on to idea "the algorithm is causes polarization", because it puts single thing, presents a specific solution (change/get rid of the algorithm), and has an specific, abstract group of people to blame the owners and employees of the big tech companies. People don't like it what the problems affecting their lives are caused by dozens of interacting forces and there is no clear simple solution, but rather a lot of work in a lot of areas.
As an aside drop in disappearing manufacturing jobs and illegal immigrants. See what you get.
It's obviously much more complicated than than that though.
But with modern social networks, a single mouse click can send it into dozens of feeds; hundreds, for some people. And then you get this effect magnified manyfold: