undefined | Better HN

0 pointsbrink1y ago0 comments

I'm still dealing with hallucinations nearly every time I use it.

0 comments

I get maybe one hallucination per twenty chats with gpt4.

I haven't tried more than a handful of queries, but I think I've gotten 100% rate of hallucination or generic useless response to specific question.

p1esk1y ago

Can I try your question? Just curious.

kwppen1y ago

It is very easy to find such questions. A very recent example is a thread about AIs not having a concept of correlation:

https://news.ycombinator.com/item?id=40751756

In that thread multiple people posted wrong answers from GPT-4o but assumed that the answers were correct and praised the AI.

This matches my experience that anything that deviates from an encyclopedia lookup or web search is very likely to be wrong.

1 more reply

thfuran1y ago

I don't remember exactly, but they were broadly "How can I do $WEIRD_NICHE_THING with $GENERAL_FEATURE of gradle / some java library?"

2 more replies

jakderrida1y ago

Do you mean 3.5? While I still face issues with GPT 4, I can't even remember the last time it hallucinated. I'm not saying it can't. But, yeah, that's crazy that they're specifically targeting your IP address like that.

j / k navigate · click thread line to collapse

0 comments

p1esk1y ago

I get maybe one hallucination per twenty chats with gpt4.

thfuran1y ago

I haven't tried more than a handful of queries, but I think I've gotten 100% rate of hallucination or generic useless response to specific question.

p1esk1y ago

Can I try your question? Just curious.

kwppen1y ago

It is very easy to find such questions. A very recent example is a thread about AIs not having a concept of correlation:

https://news.ycombinator.com/item?id=40751756

In that thread multiple people posted wrong answers from GPT-4o but assumed that the answers were correct and praised the AI.

This matches my experience that anything that deviates from an encyclopedia lookup or web search is very likely to be wrong.

1 more reply

thfuran1y ago

I don't remember exactly, but they were broadly "How can I do $WEIRD_NICHE_THING with $GENERAL_FEATURE of gradle / some java library?"

2 more replies

jakderrida1y ago

j / k navigate · click thread line to collapse