Template: OpenAI GPT chat bot API running on Cloudflare Worker (opens in new tab)

(github.com)

1 pointskwhitley2y ago4 comments

4 comments

While working on my latest project, I wanted a simple GPT chat bot API hosted on Cloudflare Workers. I decided to make this skeleton a template for future projects and to share it with the community.

Instructions to get started inside the README!

Let me know if this helps, or how to improve it! :)

roadtonyc2y ago

Looks interesting, what is the core use case.

kwhitleyOP2y ago

I'm about to start hosting apps that need a preconfigured AI context (basically feed it an opening script/instructions), for users to interact with.

This is really just to test the concept, watch the token usage rates, etc.

Since you feed in the entire script with each pass, the API side could simple prepend the origin instructions/first parts, then tack on the user input to the end.

kwhitleyOP2y ago

Look in the openai.ts file for an example of prepending messages... in this case, I actually prepend one just to embed a random seed (otherwise the same input always gives the same response).

j / k navigate · click thread line to collapse

4 comments

kwhitleyOP2y ago

While working on my latest project, I wanted a simple GPT chat bot API hosted on Cloudflare Workers. I decided to make this skeleton a template for future projects and to share it with the community.

Instructions to get started inside the README!

Let me know if this helps, or how to improve it! :)

roadtonyc2y ago

Looks interesting, what is the core use case.

kwhitleyOP2y ago

I'm about to start hosting apps that need a preconfigured AI context (basically feed it an opening script/instructions), for users to interact with.

This is really just to test the concept, watch the token usage rates, etc.

Since you feed in the entire script with each pass, the API side could simple prepend the origin instructions/first parts, then tack on the user input to the end.

kwhitleyOP2y ago

Look in the openai.ts file for an example of prepending messages... in this case, I actually prepend one just to embed a random seed (otherwise the same input always gives the same response).

j / k navigate · click thread line to collapse