undefined | Better HN

0 pointskaba02y ago0 comments

Ideally a recursive execution would also be a pure function - maybe a better way to put it about current LLMs is that they are a single mathematical expression being built up from a fix number of nodes and only addition and multiplication.

0 comments

lukev2y ago

yes, except the "reasoning" process should also be able to look up facts (retrieval) and invoke external tools, making it non-pure.

Scubabear682y ago

Agree. I am not an expert on AGI, but I suspect this route is a dead end because I believe true AGI requires interaction with an external environment to learn eg there needs to be a feedback loop to external things that it can interact with and learn from.

“You learn best from your mistakes” comes to mind here.

And not just shallow feedback loops but bigger, more profound ones eg “I didn’t go to work for a month and so I was fired and and now I have no money and it will now be hard to be hired again”.

j / k navigate · click thread line to collapse

0 comments

lukev2y ago

yes, except the "reasoning" process should also be able to look up facts (retrieval) and invoke external tools, making it non-pure.

Scubabear682y ago

“You learn best from your mistakes” comes to mind here.

And not just shallow feedback loops but bigger, more profound ones eg “I didn’t go to work for a month and so I was fired and and now I have no money and it will now be hard to be hired again”.

j / k navigate · click thread line to collapse