People here like to slag on google for being late to the chatbot party, but they've been using ML the entire time and integrating it into various products for ages. I kind of wonder if the only reason they were "behind" was the lawyers were less brazen about the copyright situation.
I agree with the commodity take, and I personally bet on Google eating everybody else's lunch eventually, because there's a lot of other business behind them and they can afford to undercut competitors. They aren't a one trick pony.
The market demands models that don't fail constantly with HAL-like "Sorry, Dave, I cannot do that for you" moralizing responses.
An API that is used for mission-critical purposes and that randomly fails with "HTTP/1.1 406 You Are A Terrorist And/Or Hitler" is a BUG, and the market will coalesce around models that don't have this bug.
did anything good come from wework?
More coworking spaces.
Adam and Rebekah Neumann got exposed for being the frauds that they are.
Commodities can be massive businesses with competitive moats. Oil is a commodity BP and Exxon do just fine financially speaking.
In 2024, they are projected to bring in $3.4 billion in revenue and lose $5 billion dollars.
They just had a massive fundraising round for $6.6 billion which at the current costs and growth is what, 6-8 months of spend?
If they bring in $11 billion in 2025, I expect them to lose at least $18 billion dollars. Good luck!
They invested in exploration and now they control those oilfields. They built refineries and have the systems and experienced people to operate them. Meta can't release a LLamaOilfieldAndRefinery which I can operate by just spending a few thousand on gpu's.
I don't see how a chatbot meets any of those criteria
I'm as cynical as it gets on this forum, as evidenced by my comment history.
But you're comparing these AI companies to WeWork? Really?
WeWork was a real estate company operating in a historically favourable environment (0% interest rates) pretending to be a tech company. They literally rented office space. What do they have in common?
I notice there's a new generation of "grey beard" programmers constantly talking about how "useless" AI is for programming, and they can do everything faster. Meanwhile, there are tons of us out there who are paying $20, $30, $50 per month and upwards for these tool as they are, and wouldn't want to go without. Ever. And we have no idea where it's going to go. Maybe you're missing something?
I'm paying for Claude, which I find super helpful (although mostly for side-projecty stuff rather than dayjob). I'd definitely pay double what it costs today, particularly if I went back to shorter-term environments where I think it shines.
If you can't hook it up to your codebase/you write in a language where it's not great (it doesn't seem good at Elisp at all, at all) then I could see how people might not find the value.
Nonetheless, despite finding these tools useful, I too am sceptical about whether or not there's a valuable business there.
For context, I said this about Uber, WeWork and a bunch of other startups that never really monetised. Note that I also said that about Facebook, where I was completely wrong.
If you are paying attention, this is a pretty terrifying prospect if you are building a $200k+/yr life on the basis that SWE will pay like this forever. A machine is coming along that genuinely might be 80% of your skill set in a few years, makes it very difficult to negotiate generous packages with the remaining 20%.
Comparing to airlines was fine, but you take issue with a comparison to real-estate? WeWork was also beloved by their customers and had leadership who were a bit off the rails.
The fact that switching models is changing one string in AWS bedrock means that nobody is going to be able to charge a significant premium.
I've always found the time-consuming part of this job to be understanding the context of the change rather than making the change itself. Essentially, trying to understand the existing code and business requirements and how they all fit together. I can definitely see the potential for AI to help make this easier but I haven't found the current tooling to be any good at this.
It's the first tool that came to hand: I'm sure there are better historical comparisons if I bothered to look. For professional reasons, I was well acquainted with WeWork when they were a big deal. It was clear to many of us in advance of their collapse that WeWork was heading for a hard crash based on their lease commitments and other public data. In this case, public data, such as for OpenAI and Anthropic, strongly suggests that, like WeWork, the economics of the businesses don't make sense. There are some fundamentals that no amount of innovation can overcome. Committing to leases you can't conceivably cover is one of them. Spending $2.35 for every $1 of revenue is clearly another, absent some breakthrough.
WeWork is not a perfect example. But if OpenAI flames out, it will be mentioned in the same breath as WeWork. The reasons are not the same, but they do sort of rhyme.
OpenAI: $3.6B revenue - people paying $2.7B for personal subscription (growth rate of 285% per year) - rest is AI
This would mean the latest OpenAI valuation of $156B is a P/E of about 43. For a company growing 285% per year ... that actually doesn't sound horrible. In fact, that's pretty good.
Also, isn't Microsoft getting paid back 75% of the profits first, up to their investment, so $13 billion and then 49% for another ~100 billion?
That is roughly true, but also only matters if Microsoft can influence OpenAI policy and chooses violence^1 (taking profit over investment in technology). Otherwise I would expect OpenAI to keep investing all of their income into more AI. Meanwhile OpenAI is hellbent on reaching effective AGI / pushing towards singularity, as long as they keep making progress and having cheap access to capital profitability is not required. So my personal conclusion is to invest in people selling AI shovels because the madness will continue.
Note 1: in my humble opinion Microsoft choosing violence is highly unlikely with Nadella in change.
IMHO the bigger risk is the "AI" ending up not doing that much after all or their R&D not paying off(which is a risk, their SORA is nowhere to be found when Chinese AI companies are having its alternative in production. Maybe OpenAI isn't that far ahead and it's the language barrier that gives that impression? I don't know I don't speak Chinese but things are happening outside of the Anglosphere).
https://x.com/pika_labs/status/1841143349576941863
Where's Sora?
Example: a week ago the natural conversation feature sucked. Now it doesn’t. That’s huge for creating a D0 positive engagement.
That being said, $3.6B is quite a lot of revenue, considering it's mostly from a $20/mo subscription model.
the only way the valuation is put "in perspective" is if you estimate that we gonna have a race of heavy investments now to get to a point where the models are "good enough" and you no longer need to invest in training new ones, at which point you switch from running a immensely unprofitable business to a immensely profitable one.
the issue is that nobody knows when that will be the case (if ever) and it currently looks like whoever player is best equipped with capital to fund that race will have a winner takes all future ahead so you just place all your chips and hope for the best
Why is Google still printing money on Search 20 years later? Surely at this point the know-how to build a search engine at scale is out there. It is a 2-sided marketplace, first they captured people's habits, then advertiser dollars. It could be that in the end LLM usage will also be ad-driven, in which case this will be captured by OpenAI most likely, similar to the Google case.
Another case. Why is Outlook the market leader for corporate email, even though email protocols are open standards, and there is no shortage of open source alternatives, etc. The reason is bundling of course and various other IT considerations, such as trainig/certs/control/security. Imo we don't really know yet how the LLM space will play out, what will enable (or not) OpenAI to win beyond the first years.
Of course there _were_ cases when the moat wasn't there, or was quickly disappeared, eg. Netscape's business melted away as soon as Microsoft bundled Internet Explorer with Windows.
Personally I think OpenAI still has a good 10x growth ahead (eg. 100M paid users for ChatGPT at the $20/mo-ish pricepoint) if they just maintain the current lead on the rest of the pack, and probably the API income can similarly be scaled up. At the slow-moving Retail company I work at, all the execs have been talking about AI for the last 2 years, but we still don't have a single AI feature in production in any of our apps, so we're not yet contributing to OpenAI revenues. But we will soon, as will 1000s of other slow-moving BigCos.
I would have assumed there's more profit in the subscriptions than the API. $20 is roughly 2 million output tokens a month through the API. Given the 50% margin they claim, each user would have to be generating 3-4 million output tokens a month for OpenAI to be at a loss. Is that likely? Seems like a lot of words to me.
Pretty easy when you start having it search websites, documents, code references etc. Before caching, lots of people used up $20 in a day or 2.
Which assumes that Google will stand still, instead of cannibalizing its own business model.
I’d really like to see as “pay as you go” gateway for popular LLMs. As Bezos said: “your margin is my opportunity.”
However they really are banking on the idea that people pay a bunch up front and use it fairly minimally. This allows them to make profit on the subscribers to pay for queries by free users. I have no idea where the pricing model will go in the future but it wouldn’t surprise me if pricing models become the primary method for fighting for market share as opposed to the AI’s actual ability.
[1] "[...] with $1 billion coming from other businesses using its technology." https://www.nytimes.com/2024/09/27/technology/openai-chatgpt...
[2] https://www.bloomberg.com/news/articles/2024-06-12/openai-do...
Because, tbf, the free version is really good. I feel like a lot of AI companies are in the stage where they're still trying to gain massive marketshare and convince people of it's value. The real test is going to be when they pull the plug to force people to transition to premium.
But this is not their main business model.
Employers will see too much delegation to flawed models - codebases will swell with ai-slop that eventually seizes the business. Skills will atrophy. Internal comms will be similarly impacted, with flooding of generic memos and strategy docs from people pretending to work dripping with that RLHF sheen.
I mean, start at step 1: can you name 10 companies related to it?
I disagree, based on my experience
The investors behind OpenAI's historic $6.6B funding round https://news.ycombinator.com/item?id=41726370 - Today (2 comments)
OpenAI wants to build 5-gigawatt data centers, nobody could supply that power https://news.ycombinator.com/item?id=41726970 - Today (3 comments)
Why OpenAI burns through billions https://news.ycombinator.com/item?id=41729038 - Today (0 comments, informative article)
OpenAI's bankruptcy flames linger on as Apple wiggles out of $6.5B funding round https://news.ycombinator.com/item?id=41726224 - Today (0 comments, informative article)
OpenAI is now valued at $157B https://news.ycombinator.com/item?id=41727947 - Today (0 comments, informative article)
This is such an interesting new industry —- so many comments here about race to the bottom / commodification, and I tend to think that way too, but in practice, I’m very very often like “Meh, ChatGPT is bad at this, I’ll ask Claude”, or vice-versa. We may actually be entering a world where we have different personalities and strengths in very large frontier models. I don’t think it’s easy to confidently predict where all this goes.
Some people prefer to delude themselves in order to not admit this.
Just yesterday [1], I argued ChatGPT was a strong brand just to be downvoted to the bottom. Lol. Imagine being so blatantly wrong at something you are supposedly a specialist at.
Turns out it's only a 3BnUSD / year brand, two years after its inception. Also, who is "Claude"? [2].
In terms of tech, nothing even comes close to "GPT-4o mini" for the same price/performance.
OpenAI will continue to dominate the market for the next decade, at least.
1: https://news.ycombinator.com/item?id=41723208
2: https://trends.google.com/trends/explore?date=now%201-d&geo=...
Microsoft is living with the possibility of OpenAI cutting them off at any time of their choosing, as well as not being in control of a technology which is becoming increasingly important, and they are feeling it. Microsoft is trying to build their own SOTA model internally, and there is every reason to expect they will succeed - they have the GPUs, money, desire, paranoia and talent required to do it, and as we have seen from many players there is no moat.
So, what happens to OpenAI when (not if), Microsoft end their relationship? How do OpenAI sell their product, other than directly, to what extent does it cut them off from enterprise customers, can they financially handle building their own $100B datacenters if they are forced to?
I don't know, but @sama should know (and most likely he does).
I'm not his fan. But am a fan of reality and that's what it is.
It's also not like "some guy" suddenly has to build $100B datacenters and whoops that's an issue. This is a 150BnUSD company, with millions of users and a brand that's recognized worldwide, they have plenty of options to choose from.
There is a partnership that benefits both parties, and the legal agreement is most certainly more complicated than you're describing.
I'd agree being the current best, having a lot of revenue, and being the popular origin of generic terms like "GPT" are indeed great examples of being dominant though. Having "a strong moat" means having reasons 5 other companies won't be able to do the same thing in the next 5-10 years and overtake them. History has shown, plenty of times, just being the big brand OG player at the start doesn't provide a big moat in and of itself. If that were the case you'd be talking about how some other company like Google is the dominant player in all things AI right now.
That’s $0.5 trillion revenue rate