undefined | Better HN

0 pointsBoorishBears1y ago0 comments

Saying these models are at GPT-4 level is setting anyone who doesn't place special value on the local aspect up for disappointment.

Some people do place value on running locally, and I'm not against then for it, but realistically no 70B class model has the amount of general knowledge or understanding of nuance as any recent GPT-4 checkpoint.

That being said these models are still very strong compared to what we had a year ago and capable of useful work

0 comments

simonw1y ago

I said GPT-4, not GPT-4o. I'm talking about a model that feels equivalent to the GPT-4 we were using in March of 2023.

int_19h1y ago

I remember using GPT-4 when it first dropped to get a feeling of its capabilities, and no, I wouldn't say that llama-3.3-70b is comparable.

At the end of the day, there's only so much you can cram into any given number of parameters, regardless of what any artificial benchmark says.

simonw1y ago

I envy your memory.

BoorishBearsOP1y ago

You're free to intentionally miss their point, does them no good.

j / k navigate · click thread line to collapse

0 pointsBoorishBears1y ago0 comments

Saying these models are at GPT-4 level is setting anyone who doesn't place special value on the local aspect up for disappointment.

That being said these models are still very strong compared to what we had a year ago and capable of useful work

0 comments

simonw1y ago

I said GPT-4, not GPT-4o. I'm talking about a model that feels equivalent to the GPT-4 we were using in March of 2023.

int_19h1y ago

I remember using GPT-4 when it first dropped to get a feeling of its capabilities, and no, I wouldn't say that llama-3.3-70b is comparable.

At the end of the day, there's only so much you can cram into any given number of parameters, regardless of what any artificial benchmark says.

simonw1y ago

I envy your memory.

BoorishBearsOP1y ago

You're free to intentionally miss their point, does them no good.

j / k navigate · click thread line to collapse