undefined | Better HN

0 pointsandrepd5mo ago0 comments

"Benchmarks" for LLMs are a total hoax, since you can train them on the benchmarks themselves.

0 comments

XCSme5mo ago

I would assume a good benchmark has hidden tests, or something randomly generated that is harder to game

j / k navigate · click thread line to collapse

XCSme5mo ago

I would assume a good benchmark has hidden tests, or something randomly generated that is harder to game

j / k navigate · click thread line to collapse