undefined | Better HN

0 pointslysace1y ago0 comments

Sent via your servers, I assume, since you are providing the Anthropic api key.

So we must trust both Anthropic's and your infrastructure with our code.

I agree that a local LLM is the way to go.

0 comments

That's correct, our server just routes calls directly to Anthropic. Some users requested an option to input their own API key and talk to Anthropic directly. I'll add this by the end of the week, maybe today if time.

Local LLM is still the end goal

lysaceOP1y ago

Ok. I think you should be more transparent about this, until everything is local.

I mean, more than stating "We don't store any of your code."

LiamPrevelige1y ago

Got it, how about a manual trigger for diagram creation and an explicit description of LLM/server usage on the page with the trigger?

1 more reply

j / k navigate · click thread line to collapse

0 pointslysace1y ago0 comments

Sent via your servers, I assume, since you are providing the Anthropic api key.

So we must trust both Anthropic's and your infrastructure with our code.

I agree that a local LLM is the way to go.

0 comments

LiamPrevelige1y ago

Local LLM is still the end goal

lysaceOP1y ago

Ok. I think you should be more transparent about this, until everything is local.

I mean, more than stating "We don't store any of your code."

LiamPrevelige1y ago

Got it, how about a manual trigger for diagram creation and an explicit description of LLM/server usage on the page with the trigger?

1 more reply

j / k navigate · click thread line to collapse