> OpenAI showed they can do capability extrapolate/predict (training loss) for the amount of compute they put in [1, see Predictable Scaling section]. This is also in line with earlier findings.
That’s interesting if it’s actually true. I think it’s important to keep in mind that it’s also their own marketing materials…
