undefined | Better HN

0 pointslogicchains2y ago0 comments

>Finally, some competition for GPT4 API!!! This is such good news.

Save your enthusiasm for after it launches; Google's got a habit of over-promising when it comes to AI.

0 comments

Everything they published thus far in the generative AI space has been abysmal in quality compared to the competition. I'd be hella surprised if this reaches GPT-4 levels of quality...

bklyn112012y ago

I'm a GPT4 subscriber and a Google GSuite work subscriber. I've been using the latest Bard this morning to write and refine python code, and it's just as good if not slightly better than GPT4. I asked it to refine some obtuse code with lots of chaining, and it did an admirable job writing accurate comments and explaining the chained logic. It's ridiculously anecdotal of course, but I used Bard for all of 5 minutes last time they announced. This time seems different.

jefftk2y ago

Manifold has this at 69%, so here's an opportunity to take some people's internet points: https://manifold.markets/brubsby/will-googles-gemini-beat-gp...

danpalmer2y ago

Looks like it's 75%? It briefly dropped to 68% in October/November, but has been fairly consistently around 75% for a while.

jefftk2y ago

It's very active today: 50+ trades in the last hour. When I checked it was 69%, but it's gone up and down since then. Click on the "trades" tab to see.

1 more reply

endisneigh2y ago

I’m curious which instances of overpromising you’re referring to.

logicchainsOP2y ago

Like how much they hyped up Bard, which when released turned out to be barely competitive with GPT3.5. E.g. https://www.reuters.com/technology/google-ai-chatbot-bard-of...

freedomben2y ago

I definitely think GPT is better than Bard, but Bard definitely did live up to the hype in a few ways. The two that blew my mind (and still do to some extent) are the blazing speed and the ability to pull information real time (no more pesky knowledge cutoff date). Bard also felt pretty comparable to 3.5 to me, better in some things and worse in others. Coding was definitely a bust with Bard.

vorticalbox2y ago

ChatGPT via plugins and tools can access real time data, the bot I built for slack at my work has the ability to load Web pages, search DDG etc.

endisneigh2y ago

I do not recall Bard being said to be better than any particular other model, but then having worse performance by some metric when released.

Your link isn’t really an indication of an overpromise.

danpalmer2y ago

Bard isn't a model, it's a product. Saying comparisons against "Bard" without specifying a particular point in time are like analyses of "ChatGPT" without specifying a model. There have been a number of releases adding more features, tool use, making it smarter, and crucially adding more languages. ChatGPT is not fine-tuned in different languages – it manages them but lacks cultural context. That's one place Bard is quite far ahead from what I've seen.

willsmith722y ago

all that shows is that google screwed up their positioning, and openai got it right

people don't see a difference between model and product, they think "gpt3 is ok", "gpt4 is great", "bard is like gpt3"

it's not the consumer's fault when the business has a positioning mistake, the business has to try and win the consumer back

1 more reply

kolinko2y ago

In terms of AI? Last year? A better question is what wasn't an overpromise?

j / k navigate · click thread line to collapse

0 comments

isoprophlex2y ago

Everything they published thus far in the generative AI space has been abysmal in quality compared to the competition. I'd be hella surprised if this reaches GPT-4 levels of quality...

bklyn112012y ago

jefftk2y ago

Manifold has this at 69%, so here's an opportunity to take some people's internet points: https://manifold.markets/brubsby/will-googles-gemini-beat-gp...

danpalmer2y ago

Looks like it's 75%? It briefly dropped to 68% in October/November, but has been fairly consistently around 75% for a while.

jefftk2y ago

It's very active today: 50+ trades in the last hour. When I checked it was 69%, but it's gone up and down since then. Click on the "trades" tab to see.

1 more reply

endisneigh2y ago

I’m curious which instances of overpromising you’re referring to.

logicchainsOP2y ago

Like how much they hyped up Bard, which when released turned out to be barely competitive with GPT3.5. E.g. https://www.reuters.com/technology/google-ai-chatbot-bard-of...

freedomben2y ago

vorticalbox2y ago

ChatGPT via plugins and tools can access real time data, the bot I built for slack at my work has the ability to load Web pages, search DDG etc.

endisneigh2y ago

I do not recall Bard being said to be better than any particular other model, but then having worse performance by some metric when released.

Your link isn’t really an indication of an overpromise.

danpalmer2y ago

willsmith722y ago

all that shows is that google screwed up their positioning, and openai got it right

people don't see a difference between model and product, they think "gpt3 is ok", "gpt4 is great", "bard is like gpt3"

it's not the consumer's fault when the business has a positioning mistake, the business has to try and win the consumer back

1 more reply

kolinko2y ago

In terms of AI? Last year? A better question is what wasn't an overpromise?

j / k navigate · click thread line to collapse