Fastmcpp (Fastmcp for C++) (opens in new tab)

(github.com)

61 points0xeb4mo ago8 comments

8 comments

I find the idea of highly optimised MCP kind of funny. The protocol is so far from finished - the update for stateless MCP (which is our only hope at properly scaling it) isn't even released yet in the core protocol.

And even then - the LLMs are going to be so much slower than the MCP server, I've never quite understood the point of trying to optimise it. Even FastMCP is pretty good because everything is async.

But even given all that - this is very impressive :)

0xebOP4mo ago

It is not about optimization but more just having a C++ library.

Then with C++ implementation, you get more portability than Python or other interpreted languages.

anuramat4mo ago

> so much slower

unless you're working on 10 features in parallel with smaller models in best-of-4 groups

orochimaaru4mo ago

The agents call the MCPs, which could reside on resource constrained environments or devices. Other situations like MCPs that run on your laptop are better off as self contained binaries (my personal and probably unpopular opinion ;) ).

So MCP optimization may be something that’s targeted to those areas.

idohlevi4mo ago

Nice name

0xebOP4mo ago

Yes :)

cyber_kinetist4mo ago

If they really cared about performance (which I think is the case since they're using C++ for this) - they should use something else than nholmann-json. It's simple to use, but has one of the most atrocious performance for a C++ JSON library. (The safest choice would probably be RapidJSON)

0xebOP4mo ago

Hi, I made that port. Performance was not the goal. Just the C++ port mainly.

I also ported the Claude Agent SDK to C++, so fastmcpp is needed for that: https://github.com/0xeb/claude-agent-sdk-cpp

RapidJSON is a good suggestion, maybe I will switch to it at one point.

j / k navigate · click thread line to collapse

8 comments

noogai034mo ago

And even then - the LLMs are going to be so much slower than the MCP server, I've never quite understood the point of trying to optimise it. Even FastMCP is pretty good because everything is async.

But even given all that - this is very impressive :)

0xebOP4mo ago

It is not about optimization but more just having a C++ library.

Then with C++ implementation, you get more portability than Python or other interpreted languages.

anuramat4mo ago

> so much slower

unless you're working on 10 features in parallel with smaller models in best-of-4 groups

orochimaaru4mo ago

So MCP optimization may be something that’s targeted to those areas.

idohlevi4mo ago

Nice name

0xebOP4mo ago