Did you not notice a trendline of technological improvement of AI?
> Sure, I probably could make something more effective, using non-LLM technologies (given a large enough budget), but… why would I, or anyone else, do that when it'd be obviously harmful, with no benefit?
Technology will improve. The likelihood of you being part of that progress is nearly zero. So what you say here is categorically wrong. You are not able to make anything better. Humanity collectively will make something better and we don’t know who will be the one to do it.
People are willing to pay for companionship so there’s huge profitability in this area. Profit and self interest often at the expense of everything else is what drives progress.
No, in fact I noticed a series of AI winters. In all things, progress is famously _not_ a straight line.
Also I find it interesting that your argument seems to boil down to “I’m smart because line goes up, you’re dumb because you think line goes down.” Everyone Clearly can see what would happen if line went up, I just; looking at the broad history and totality of factors(that I’m aware of) don’t think it’s inevitable.
“You can’t stop progress”
We literally stop progress all the time, every time we choose not to invest in something, crypto progress slowed from its height, Vr progress, green energy, I’d argue it’s relatively few technologies that progress forever.
A series of winters? There's only one winter. Then after Geoffrey Hinton you can bullshit every 6 month lull into a "winter" if you want but everyone knows what the "actual" winter was. In general over a span of 10 years the line is UP.
>Also I find it interesting that your argument seems to boil down to “I’m smart because line goes up, you’re dumb because you think line goes down.” Everyone Clearly can see what would happen if line went up, I just; looking at the broad history and totality of factors(that I’m aware of) don’t think it’s inevitable.
The crazy thing is it's true. I never said that the line going up is inevitable. I said that's the most probable outcome. And you are dumb if you don't acknowledge the most probable outcome. like there's no logical way around this. You can sort of twist my argument into something that looks strange or stupid or whatever but there's no logical counter to what I said because it is factually the best answer.
>We literally stop progress all the time, every time we choose not to invest in something, crypto progress slowed from its height, Vr progress, green energy, I’d argue it’s relatively few technologies that progress forever.
You can't stop it. It can stop but you can't actually put your hand in front of it to stop it. That's what I mean. Nobody is choosing to stop progress and nobody really has this choice.
That being said you're right. No technology can progress forever. There is an upper bound. But AI. What's the upper bound? Do we have examples of the upper bound of intelligence? Do these things physically exist in reality that we can use these physical examples of Intelligence to measure how far in physical actuality and reality that we can go with AI?
No. No such examples exist. LLMs are the forefront of intelligence. There is nothing in reality more intelligent then LLMs and LLMs represent the physical limit in terms of evidence. Or is there something I'm missing here?
Yeah for certain things like space travel. It's possible we're hitting upper bounds, because we don't have physical examples of certain technologies.
But Again, intelligence? Do we have examples? What is the upper bound? Why don't you kick that brain (hint) into gear and think about it? One of the most realistic predictions of a continued upward trend in technology is in AI BECAUSE a PHYSICAL ACTUALITY of what we want to achieve both EXISTS and is reading this comment right now.
So we have a trendline that points up. And the actuality of what we want to achieve ALREADY exists. What is the most probable bet that you cannot just not acknowledge? The logic is inescapable. You must consider the outcome that AI continues to progress as that is the most likely outcome.
I'll grant you that AI not progressing and hitting another winter IS not at such a lower probability that we cannot consider it. But most of HN is just claiming we 100% hit a wall when all evidence is saying otherwise. In actuality another AI winter is the lower probability bet. Wait 10 years and come back to this comment and we'll see if you're right.
https://www.aei.org/carpe-diem/the-sp-500-index-out-performe...
You'd be a fucking idiot if you bet on zero or negative growth for the SP500 in the next decade. The market is utterly the perfect example of a predictable trendline. The key is that you need to look at it over the long term.
Warren buffet called out every idiot investor because they all did short term bets based on short term gains and he said the way forward was long term investments. Now tell me. What does the long term trendline for the past decade say about machine learning? What does the short term LLM "training wall" say about it? Are you an idiot investor or are you not? Most investors are idiots.
Xerox PARC. Bell Labs. Academia. Wikipedia. You must have a rather narrow and useless definition of "progress".
No i have a realistic definition of progress in capitalism. You must have a rather narrow brain and are unable to comprehend the difference between a realistic and practical application of "progress" versus an ideal that is unrealistic.
Bell labs, Xerox PARC are done. These labs existed because capitalist businesses were successful in their profitable endeavors AND could AFFORD side quests that were unprofitable. In the end these places were shuttered because they were unprofitable.
Now take a look at academia. Where does all that money come from? Taxes. Where do Taxes come from? Business and profit. Academic progress comes from business.
In fact all progress comes from business and profit. That's the general actuality. Of course there are exceptions, but that's just pedantism.