undefined | Better HN

0 pointsd4rkp4ttern2y ago0 comments

What about streaming output — is there a uniform interface for all models for streaming output?

0 comments

Hi @d4rkp4ttern - yes it's standardized to the openai format - https://litellm.readthedocs.io/en/latest/stream/

j / k navigate · click thread line to collapse

0 pointsd4rkp4ttern2y ago0 comments

What about streaming output — is there a uniform interface for all models for streaming output?

Hi @d4rkp4ttern - yes it's standardized to the openai format - https://litellm.readthedocs.io/en/latest/stream/

j / k navigate · click thread line to collapse