> As part of this process, we’ll make Gemini Ultra available to select customers, developers, partners and safety and responsibility experts for early experimentation and feedback before rolling it out to developers and enterprise customers early next year.
Finally, some competition for GPT4 API!!! This is such good news.
You are assuming GPT4 didn't do the exact same!
Seriously, it's been like this for a while, with LLMs any benchmark other than human feedback is useless. I guess we'll see how Gemini performs when it's released next year and we get independent groups comparing them.
Possibly by that time GPT5 will already be out.
They already caught up and surpassed GPT-4 and OpenAI's availability and APIs are very unstable and all that matters is that and the cost per token.
Save your enthusiasm for after it launches; Google's got a habit of over-promising when it comes to AI.
When I was reading the benchmarks and seeing how Gemini Ultra was outperforming GPT-4 I thought, "Finally, some competition for GPT4"!
But when I got to that part, that's when I realized that it could potentially be caught in release hell and not actually see the light of day or significant use. Google, for better or worse, has more of a brand reputation to maintain and is more risk averse, so even if Gemini Ultra can, in theory, outperform GPT4, users might not get a chance to access it for a while.
You think this is why Google is so far behind?
(Speaking as someone who's worked on launching several somewhat risky technologies at Google.)
Most of the comments I see on Hacker News claim ChatGPT is getting worse at different things (though I don't believe those claims).
