Ask HN: Have people started to see cracks in the ChatGPT answers with time

3 pointssandeepkd4mo ago12 comments

Context: I have a co-worker who is used to execute the suggested scripts from Chat-gpt with high confidence. Lately one of the scripts to use Github API was not working and he asked me to debug. Turns out, Github had changed/updated the attribute names in the output and they no longer matched with the Chat-Gpt provided script. Hard part, this individual is really good engineer, however he/she was low on confidence about how to debug the Chat-gpt provided script

12 comments

almosthere4mo ago

Don't use chatgpt for that kind of work, use agents. It will read the error message and adapt, perhaps even go as far as open the release notes for the tools you're using and fix the problems it encounters.

bjourne4mo ago

IMnsHO, nope! People trust the bot way more than their own experience.

speedgoose4mo ago

Skill issue.

First, switch to Codex. Then, consider using the context7 mcp server to let agents automatically fetch the latest documentation.

Debugging is not so different than debugging code written by someone else. It’s a skill you can practice.

By the way, agents are also good at debugging.

techblueberry4mo ago

This is a great advertisement:

Agents: harder, slower and more expensive than just doing it yourself.

pavelai4mo ago

It's a very overgeneralized statement. Agents could do a lot of work, which most of people wouldn't want to do. and agents can do this on a pretty good level for now. Probably we would enhance their ability to do this in near future. People should stop write code and start to do real life things.

1 more reply

speedgoose4mo ago

It depends on the task.

j / k navigate · click thread line to collapse