undefined | Better HN

0 pointsmountainriver9mo ago0 comments

Almost every single major benchmark, and yes progress is incremental but it adds up, this has always been the case

0 comments

We were talking about linear improvements and I have yet to see it

check the benchmarks or make one of your own

I checked the BlEU-Score and Perplexity of popular models and both have stagnated around 2021. As a disclaimer this was a cursory check and I didn't dive into the details of how individuals scores were evaluated.

1 more reply

j / k navigate · click thread line to collapse