undefined | Better HN

0 pointsnerpderp823y ago0 comments

> ChatGPT isnt in the game of modelling problems and solving them, it possesses only superficial semantic characteristics of the questions posed

You can give it the datamodel and a semantic description and it will do a pretty good job of reprojecting your data.

People talk about chatgpt as being a fixed thing, it isn't. ChatGPT is the Apple II of LLMs. 3-4 moore units from now every issue that people think is a "gotcha" for chatgpt will have evaporated.

0 comments

kietay3y ago

In your analogy to the Apple II, is there a fundamental problem people claimed for early computers, which didn’t just boil down to “they need to be faster”?

There are fundamental limitations to what an LLM can achieve.

mjburgess3y ago

You missed the ever-powerful ellipsis in what he said:

Today "..." and then it will be solved.

It's the most powerful operator in the whole of applied computer science.

gptgpp3y ago

True, I mean, just look at all of the examples of technologies that were projected to revolutionize computing and machine learning "..." eventually, here:

https://en.wikipedia.org/wiki/AI_winter

Just because they haven't happened to yet doesn't mean they never will! I've heard very good things about expert systems and IBM's Watson for Oncology.

The Harvard Business Review has a great article on all of the eventual "..." AGIs here:

https://hbr.org/2022/03/why-ai-failed-to-live-up-to-its-pote...

nerpderp82OP3y ago

Yeah, ChatGPT/copilot kinda is that ellipsis.

baq3y ago

Integrate it with wolfram alpha and Google, tack on a bullshit detector and spank dispenser conetwork and it looks like limitations of LLMs are easily overcome by not running anywhere near them.

geraneum3y ago

Some of the problems with ChatGPT are not mere “gotcha”s but rather problems inherent to how LLMs work and their philosophy. The biggest issue I’ve seen some other scientists [1] who don’t have a stake in OpenAI bring up is that: “LLMs make sh*t up”.

Maybe LLMs are not the final answer. For now, it looks like they are not.

[1] Yann LeCun: https://twitter.com/ylecun/status/1617254676428111872?s=46&t...

SomeCallMeTim3y ago

By the time the semantic description is sufficiently exact, you may as well have written the code, though. [1]

[1] https://i.pinimg.com/originals/e3/2f/22/e32f2209b4c3d6b32bbc...

ResearchCode3y ago

Still waiting for those autonomous cars.

burnished3y ago

They are already here. We can haggle over error rate and incidents per million miles or what have you but that is more an argument about safety and suitability.

ResearchCode3y ago

Those must be some big gotchas, because self-driving cars have not replaced a job here, yet.

Large language models show more promise for replacing non-programming office workers.

1 more reply

j / k navigate · click thread line to collapse

0 comments

kietay3y ago

In your analogy to the Apple II, is there a fundamental problem people claimed for early computers, which didn’t just boil down to “they need to be faster”?

There are fundamental limitations to what an LLM can achieve.

mjburgess3y ago

You missed the ever-powerful ellipsis in what he said:

Today "..." and then it will be solved.

It's the most powerful operator in the whole of applied computer science.

gptgpp3y ago

True, I mean, just look at all of the examples of technologies that were projected to revolutionize computing and machine learning "..." eventually, here:

https://en.wikipedia.org/wiki/AI_winter

Just because they haven't happened to yet doesn't mean they never will! I've heard very good things about expert systems and IBM's Watson for Oncology.

The Harvard Business Review has a great article on all of the eventual "..." AGIs here:

https://hbr.org/2022/03/why-ai-failed-to-live-up-to-its-pote...

nerpderp82OP3y ago

Yeah, ChatGPT/copilot kinda is that ellipsis.

baq3y ago

Integrate it with wolfram alpha and Google, tack on a bullshit detector and spank dispenser conetwork and it looks like limitations of LLMs are easily overcome by not running anywhere near them.

geraneum3y ago

Maybe LLMs are not the final answer. For now, it looks like they are not.

[1] Yann LeCun: https://twitter.com/ylecun/status/1617254676428111872?s=46&t...

SomeCallMeTim3y ago

By the time the semantic description is sufficiently exact, you may as well have written the code, though. [1]

[1] https://i.pinimg.com/originals/e3/2f/22/e32f2209b4c3d6b32bbc...

ResearchCode3y ago

Still waiting for those autonomous cars.

burnished3y ago

They are already here. We can haggle over error rate and incidents per million miles or what have you but that is more an argument about safety and suitability.

ResearchCode3y ago

Those must be some big gotchas, because self-driving cars have not replaced a job here, yet.

Large language models show more promise for replacing non-programming office workers.

1 more reply

j / k navigate · click thread line to collapse