undefined | Better HN

0 pointsbastawhiz3mo ago0 comments

> Google is now able to squeeze significantly more performance per dollar than their peer competitors in the LLM space

Performance per dollar doesn't "win" anything though. Performance (as in speed) hardly cracks the top five concerns that most folks have when choosing a model provider, because fast, good models already exist at price points that are acceptable. That might mean slightly better margins for Google, but ultimately isn't going to make them "win"

0 comments

pu_pe3mo ago

It's not slightly better margins, we are talking about huge cost reductions on the main expense which is compute. In a context where companies are making trillion dollar investments, it matters a lot.

Also, performance and user choice are definitely impacted by compute. If they ever find a way to replace a job with LLMs, those who can throw more compute at it for a lower price point will win.

j / k navigate · click thread line to collapse

0 pointsbastawhiz3mo ago0 comments

> Google is now able to squeeze significantly more performance per dollar than their peer competitors in the LLM space

0 comments

pu_pe3mo ago

Also, performance and user choice are definitely impacted by compute. If they ever find a way to replace a job with LLMs, those who can throw more compute at it for a lower price point will win.

j / k navigate · click thread line to collapse