undefined | Better HN

0 pointsolliepro20d ago0 comments

I bet they lack good long context training data and need to start a flywheel of collecting it via their api (from willing customers)

0 comments

jbergqvist19d ago

This would be my guess too. It can probably be generated synthetically or via agentic rollouts, but high quality long context examples where outputs meaningfully depend on long-range interactions probably remain scarce

j / k navigate · click thread line to collapse

0 pointsolliepro20d ago0 comments

I bet they lack good long context training data and need to start a flywheel of collecting it via their api (from willing customers)

0 comments

jbergqvist19d ago

This would be my guess too. It can probably be generated synthetically or via agentic rollouts, but high quality long context examples where outputs meaningfully depend on long-range interactions probably remain scarce

j / k navigate · click thread line to collapse