undefined | Better HN

0 pointsfwip7mo ago0 comments

It would be nice if the tools we usually use for LLMs had a bit more programmability. In this example, It we could imagine being able to chunk up work by processing a few items, then reverting to a previous saved LLM checkpoint of state, and repeating until the list is complete.

I imagine that the cost of saving & loading the current state must be prohibitively high for this to be a normal pattern, though.

0 comments

radarsat17mo ago

Agreed. You basically want an LLM to have a tool that writes its own agent to accomplish a repetitive task. I think this is doable.

steveklabnik7mo ago

You can already sort of do this by asking it to write a script to do the refactor. Claude sometimes suggests this on its own to me even.

But obviously sometimes larger refactors aren't easy to implement in bash.

fwipOP7mo ago

Right - and ideally, after writing the script to do the task, it could discard all the tokens involved in writing the script.

j / k navigate · click thread line to collapse