Ask HN: What agent frameworks are you using, and how well do they work?

2 pointsistvan_intrnd3mo ago3 comments

We’ve built and used our own custom agent framework for a while (before “agents” became a mainstream term), mainly because existing tools didn’t fit our needs around control, observability, and composability.

I’m curious what others are actually running in production today—custom frameworks, LangGraph, AutoGen, CrewAI, homegrown pipelines, etc. and how satisfied you are with them.

What’s working well? What breaks down at scale (debuggability, cost, determinism, tool orchestration, evals)?

3 comments

sshadmand3mo ago

A friend of mine is using N8N a lot, but he isn't a developer and I think that is the main reason. I think LangChain is the most popular, but there is always a trade off between upstart costs, and the cost of forcing a pre-fab to fit your needs as you grow. I personally have used NextJS's AI SDK a a lot since it is very web friendly (nodejs/JS) https://ai-sdk.dev/docs/introduction.

walpurginacht3mo ago

i'm enjoying langgraph the most, it's got nice integration with langfuse for observability and langchain (despite its shortcomings) with its plethora of integrations makes things easier to do, and the way to define the graph and transitions is pretty intuitive

currently trying out pydantic's own graph based approach to use together with dspy

istvan_intrndOP3mo ago

I did use langchain in the very early days and was a contributor as well, but I just found myself needing to constantly have to change it for my needs...so that's why I moved away.

Do you get into situations like that where the framework just can't serve your needs? if yes, would you please list up a couple.

j / k navigate · click thread line to collapse