undefined | Better HN

0 pointspsadri8mo ago0 comments

You could instruct the LLM to formulate a “lesson” based on the error and add this to the tool instructions for future runs.

0 comments

ch4s38mo ago

This isn’t practical at scale. You’ll run into too many novel lessons and burn through too many tokens setting up context.

psadriOP8mo ago

At scale you need to use more tricks. For example, only inject examples if the tool is going to be needed. Or amass lessons, then ask the LLM to summarize them to prune redundant information before it is used in the context.

j / k navigate · click thread line to collapse

0 pointspsadri8mo ago0 comments

You could instruct the LLM to formulate a “lesson” based on the error and add this to the tool instructions for future runs.

0 comments

ch4s38mo ago

This isn’t practical at scale. You’ll run into too many novel lessons and burn through too many tokens setting up context.

psadriOP8mo ago

j / k navigate · click thread line to collapse