The plateau in this case is presumably how far you can advance intelligence from the current model architectures. There seems to be diminishing returns from throwing more layers, parameters or training data at these things.

We will see improvements but for dramatic increases I think we'll need new breakthroughs. New inventions are hard to predict, pretty much by definition.