undefined | Better HN

0 pointssupern0va21d ago0 comments

This seems super cool if as described, but I'm sure you can understand the skepticism.

Do you anticipate having any kind of public accessible chat interface for testing in the near future?

Also, what, if any, benefits are there for smaller context windows? Is there still a material improvement in cost to serve under say 256k? I'm curious about the broader implications for the space beyond improvements for very large context windows.

0 comments

alexsubq20d ago

I do, for sure! Yes, we have a few product rollouts lined up. The differentials for latency are posted in our blog post, so that should provide an idea of where the scaling law differentials kick in.

dvfjsdhgfv20d ago

> I do, for sure! Yes, we have a few product rollouts lined up.

When, more or less?

alexsubq18d ago

We will have a few rollouts in the next two months.

j / k navigate · click thread line to collapse