undefined | Better HN

0 pointsgerash3y ago0 comments

It all sounds good as a consumer but there are a few questions which are by no means clear to me:

* How does getting recommendations from a chatbot (what TV to buy) play with websites that produce such content (TV reviews) * How does it play with websites that rely on ad impression * How can you monetize a chatbot? (there's an easy way: free tier + monthly subscription) * How to reduce the massive compute cost of a good chatbot without making it bad (this also seems more straightforward)

0 comments

visarga3y ago

Apparently Google is capable of doing cool things. DeepMind’s speculative sampling achieves 2–2.5x decoding speedups in LLM. That brings cost down significantly, without degradation in quality.

j / k navigate · click thread line to collapse

0 pointsgerash3y ago0 comments

It all sounds good as a consumer but there are a few questions which are by no means clear to me:

0 comments

visarga3y ago

Apparently Google is capable of doing cool things. DeepMind’s speculative sampling achieves 2–2.5x decoding speedups in LLM. That brings cost down significantly, without degradation in quality.

j / k navigate · click thread line to collapse