undefined | Better HN

0 pointsoverfeed8mo ago0 comments

Also works perfectly fine in fire-and-forget, non-interactive agentic workflows. My dream scenario is that I create a bunch of kanban tickets and assign them to one or more AI personas[1], and wake up to some Pull Requests the next morning. I'd me more concerned about tickets-per-day, and not tk/s as I have no interest in watching the inner-workings of the model.

1. Some more creative than others, with slightly different injected prompts or perhaps even different models entirely.

0 comments

numpad08mo ago

> I create a bunch of kanban tickets and assign them to one or more AI personas[1],

Yeah that. Why can't we just `find ./tasks/ | grep \.md$ | xargs llm`. Can't we just write up a government proposal style document, have LLM recursively down into sub-sub-projects and back up until the original proposal document can be translated into a completion report. Constantly correcting a humongous LLM with infinite context length that can keep everything in its head doesn't feel like the right approach.

londons_explore8mo ago

In my experience, this sort of thing nearly works... But never quite works well enough and errors and misunderstandings build at every stage and the output is garbage.

Maybe with bigger models it'll work well.

numpad08mo ago

I had hoped that this recursive breakdown approach could remove the need for bigger and bigger monolithic LLM for ever bigger tasks, by allowing every tasks to be at same granularity, but... I guess I should just try building one myself.

j / k navigate · click thread line to collapse

0 pointsoverfeed8mo ago0 comments

1. Some more creative than others, with slightly different injected prompts or perhaps even different models entirely.

0 comments

numpad08mo ago

> I create a bunch of kanban tickets and assign them to one or more AI personas[1],

londons_explore8mo ago

In my experience, this sort of thing nearly works... But never quite works well enough and errors and misunderstandings build at every stage and the output is garbage.

Maybe with bigger models it'll work well.

numpad08mo ago

j / k navigate · click thread line to collapse