undefined | Better HN

0 pointsksynwa10mo ago0 comments

Don't they mean that LLMs cannot perfectly reproduce the source material?

0 comments

tomrod10mo ago

They're only stochastically lossy compression -- so sometimes it can.

Given a unique enough arrangement of words and a low enough entropy in token selection.

j / k navigate · click thread line to collapse

0 pointsksynwa10mo ago0 comments

Don't they mean that LLMs cannot perfectly reproduce the source material?

tomrod10mo ago

They're only stochastically lossy compression -- so sometimes it can.

Given a unique enough arrangement of words and a low enough entropy in token selection.

j / k navigate · click thread line to collapse