undefined | Better HN

0 pointsscarface743y ago0 comments

It’s not “trivial” because of the cost per query. As far as Google, it doesn’t even have access to the most valuable phone users without paying Apple $18B+ a year.

0 comments

endisneigh3y ago

Something can be both expensive and trivial. If the market is huge they will bear the cost. The tech is well understood even now.

The parameter size will likely be an order of magnitude less for gpt4 level results in a few years

fillipvt3y ago

Not sure about "the tech is well understood" given the LLM itself is a black box in regards to how it works internally, even Microsoft researches admit it (Sparks of Artificial General Intelligence: Early experiments with GPT-4).

scarface74OP3y ago

If the fixed cost was huge, you would have point. But the variable costs are also huge.

I’m sure the market is also huge for dollars sold for 95 cents.

endisneigh3y ago

it's really not that huge. unlike most companies, people are willing to pay if it's Apple. they can roll it into the iCloud subscription

scarface74OP3y ago

That doesn’t help. You’re still making something that has a high variable cost into something that the user only is paying a fixed cost for.

1 more reply

j / k navigate · click thread line to collapse

0 comments

endisneigh3y ago

Something can be both expensive and trivial. If the market is huge they will bear the cost. The tech is well understood even now.

The parameter size will likely be an order of magnitude less for gpt4 level results in a few years

fillipvt3y ago

scarface74OP3y ago

If the fixed cost was huge, you would have point. But the variable costs are also huge.

I’m sure the market is also huge for dollars sold for 95 cents.

endisneigh3y ago

it's really not that huge. unlike most companies, people are willing to pay if it's Apple. they can roll it into the iCloud subscription

scarface74OP3y ago

That doesn’t help. You’re still making something that has a high variable cost into something that the user only is paying a fixed cost for.

1 more reply

j / k navigate · click thread line to collapse