Show HN: Python lib to run evals across providers: OpenAI, Anthropic, etc. (opens in new tab)

(github.com)

8 pointscr4zy1y ago1 comments

Library makes requests asynchronously across models, so you can spend a lot of $$ quickly if you want XD. But seriously I hope this enables folks to create and run evals (especially safety ones) a lot easier than before.

1 comments

detente181y ago

nice! thanks for using litellm! - maintainer :)

j / k navigate · click thread line to collapse

Show HN: Python lib to run evals across providers: OpenAI, Anthropic, etc. (opens in new tab)

(github.com)

8 pointscr4zy1y ago1 comments

Library makes requests asynchronously across models, so you can spend a lot of $$ quickly if you want XD. But seriously I hope this enables folks to create and run evals (especially safety ones) a lot easier than before.

1 comments

detente181y ago

nice! thanks for using litellm! - maintainer :)

j / k navigate · click thread line to collapse