Llama2 on Replicate faster than ChatGPT? (opens in new tab)

(github.com)

1 pointsij232y ago2 comments

2 comments

ij23OP2y ago

Ran some testing and discovered llama2 on replicate is faster than chatgpt!

Code - https://github.com/BerriAI/litellm/blob/main/cookbook/Evalua...

Are others seeing similar results?

The response time you get from a Pay-as-you-Go account on OpenAI is not anything close to what you get with an Enterprise Agreement. If your usage is large enough, talk to your account rep.

j / k navigate · click thread line to collapse

2 comments

ij23OP2y ago

Ran some testing and discovered llama2 on replicate is faster than chatgpt!

Code - https://github.com/BerriAI/litellm/blob/main/cookbook/Evalua...

Are others seeing similar results?

agnokapathetic2y ago

The response time you get from a Pay-as-you-Go account on OpenAI is not anything close to what you get with an Enterprise Agreement. If your usage is large enough, talk to your account rep.

j / k navigate · click thread line to collapse