undefined | Better HN

0 pointsgavmor1y ago0 comments

Ah, I see. The model returns the name of an appropriate tool, then the client takes arbitrary action, and appends the `tool` message to the chat context, and finally a second call to the model minges these together.

Part of me was hoping for some magic plugin space where I could drop named functions, but I couldn't imagine how.

0 comments

jejeyyy771y ago

You specify the API of your functions (inputs/description).

The LLM will decide which functions to call and with what values.

You perform the actual function execution.

gavmorOP1y ago

Thanks.

If their announcement had included the schema of the return value of `response['message']['tool_calls']` it might've been more transparent to me.

j / k navigate · click thread line to collapse