Show HN: Agentpanel – Universal LLM API Written in Rust (opens in new tab)

(github.com)

9 pointshackintoshrao1y ago4 comments

Agentpanel is an observability platform for optimizing the control flow, performance, token usage, and correctness of LLM/AI agents!

Built-in @rustlang, the first release of Agent Panel currently features an AI gateway that provides seamless access to 100+ LLMs across 20+ platforms, including OpenAI GPT-4o, Gemini 1.5 Pro latest, AnthropicAI Claude 3.5, MistralAI, Cohere, Groq,Perplexity AI, and more.

4 comments

hamasho1y ago

Interesting! And it looks much sane compared to LangChain.

Question: do almost all LLM APIs have the same roles "user", "assistant", and "system"?

hackintoshraoOP1y ago

Thank you. Yes, almost all LLM APIs have the same roles. Let me know your thoughts once you try the project.

mathnmusic1y ago

Gemini models don't have "system" roles.

akash_sky1y ago

gg stuff

j / k navigate · click thread line to collapse