Llama3 Performance Cost Benchmark (opens in new tab)

(parseur.com)

2 pointsjoss821y ago1 comments

1 comments

I spent the last few days testing Llama3 on different GPUs, to find the cheapest cost per token. Spoiler: it's the Nvidia L4, surprisingly.

j / k navigate · click thread line to collapse

(parseur.com)

2 pointsjoss821y ago1 comments

joss82OP1y ago

I spent the last few days testing Llama3 on different GPUs, to find the cheapest cost per token. Spoiler: it's the Nvidia L4, surprisingly.

j / k navigate · click thread line to collapse