undefined | Better HN

0 pointslancesells3y ago0 comments

> The implications of the ChatGPT response are pretty terrifying.

I agree with everything you're saying but this response (and many others) are what concerns me. What power does ChatGPT hold? A lot of this thread seems to treat the model as something with power over people or something that is actually real.

Let's treat it as what it is. A remarkable piece of software that can mimic human speech, write software, etc. Even when it's right it is not a source of truth and should not ever be considered a source of truth.

Sure, if we give this to children to educate themselves that could lead to very bad things. But this isn't HAL unless we give it the power of HAL. This is a product from a small group of people that scraped the text of humanity and now want to sell it back to us in a more convenient way.

> should NOT trust any AI model that you didn't train yourself

You shouldn't trust any AI model.

0 comments

cardanome3y ago

I had the same reaction to ChatGPT at first but in am seeing a lot of beginner level people use it for learning a new programming languages or framework.

Traditional search engines are becoming more and more useless so it is not wonder that ChatGPT starts filling that need.

It might be obvious for you and me that ChatGPT should not be "considered a source of truth" and people are better off reading the actual manual instead of asking it but it is NOT so obvious for a terrifyingly huge percentage of people.

Also, I saw videos on how ChatGPT is used to generate tutorials and whatnot, further reducing the quality of text-based content one can find with traditional search engines.

So yeah, it does have power. People rely on it for learning and doing programming tasks.

Maybe it is just a short lived hype and they get burned by it and abandon it soon but who knows.

j / k navigate · click thread line to collapse