undefined | Better HN

0 pointspessimizer10mo ago0 comments

Really? I'd assume that an LLM would deduplicate Wikipedia into something much smaller than 25GB. That's its only job.

0 comments

> That's its only job.

The vast, vast majority of LLM knowledge is not found in Wikipedia. It is definitely not its only job.

Tostino10mo ago

When trained on next word prediction with the standard loss function, by definition it is it's only job.

j / k navigate · click thread line to collapse

> That's its only job.

The vast, vast majority of LLM knowledge is not found in Wikipedia. It is definitely not its only job.

Tostino10mo ago

When trained on next word prediction with the standard loss function, by definition it is it's only job.

j / k navigate · click thread line to collapse