I think the consensus in the future will be that LLMs were, after all, stochastic parrots.

The difference with what we think today is that in the future we'll have a new definition of stochastic parrots, a recognition that stochastic parrots can actually be very convincing and extremely useful, and that they exhibit intelligence-like capabilities that seemed unattainable by any technology up to that point, but LLMs were not a "way forward" for attaining AGI. They will plateau as far as AGI metrics go. These metrics keep advancing to stay ahead of LLM, like a Achilles and the Turtle. But LLMs will keep improving as tooling around it becomes more sophisticated and integrated, and architecture evolves.