undefined | Better HN

0 pointseli4mo ago0 comments

Some unsolicited advice: Streaming support is tricky. I'd strip the streaming out when you proxy until everything else is solid.

0 comments

Cool. Sounds good. Thanks. I'll do it.

This will be a bit challenging I'm sure but I agree, litellm and friends do too many things and take too long to get simple asks from

I've been pitching this suite I'm building as "GNU coreutils for the LLM era"

It's not sticking and nobody is hyped by it.

I don't know if I should keep going or if this is my same old pattern cropping up again of things I really really like but just kinda me

So I've pitched this a few more times. It's way too complicated for people.

The value comprehension market is small

So I'll need to surface it better or just do something else

j / k navigate · click thread line to collapse