Sure, and the end of biotech is perfect control of the human body from pre-birth until death, but innovation has many bottlenecks. I would be very surprised if the bottlenecks to LLM performance are compute and model architecture. My guess is it’s the data.

Are you sure you can get to that with transformers?

https://www.lesswrong.com/posts/SkcM4hwgH3AP6iqjs/can-you-ge...

And some Mongols, Romans, etc probably said continually expanding their boarders would give them comparable contemporary heights.