undefined | Better HN

0 pointssolarmist3y ago0 comments

This kind of model is harder to abuse, so I guess it passed their internal checks much more easily.

I can understand not releasing GPT-3, even if I disagree with the decision.

0 comments

ignoramous3y ago

> This kind of model is harder to abuse, so I guess it passed their internal checks much more easily.

The version I choose to believe: stability.ai ate DALL-E for lunch, and that woke them up.

solarmistOP3y ago

This is probably also true.

jfoster3y ago

True. The potential of GPT-3 to cause internet mayhem was/is significant. I would argue that the mere act of announcing it was still a catalyst for an eventual GPT-3-like model being released. In revealing it, they established a target for what open source models could aim to achieve, and simultaneously got bad actors thinking about ways to abuse it.

zarzavat3y ago

It was a credible argument when GPT-3 was released. But now there are open models that are as capable as GPT-3 and that mayhem has not materialized, with the possible exception of GPT-4chan. They could release it now under a non-commercial license, if they cared to.

jfoster3y ago

Can you provide an example of an open model as capable as GPT-3?

I know there's some "mini-GPT" type models around, but they don't seem nearly as capable.

1 more reply

dwohnitmok3y ago

> I can understand not releasing GPT-3, even if I disagree with the decision.

Why do you disagree?

solarmistOP3y ago

Two reasons. First, someone else will release something similar. Second, I didn’t see a related push from them to work with other in the industry to do something productive towards safety with the time they got by delaying availability of these kinds of models. So it felt disingenuous.

moyix3y ago

Several groups already have. Facebook's OPT-175B is available to basically anyone with a .edu address (models up to 66B are freely available) and Bloom-176B is 100% open:

https://github.com/facebookresearch/metaseq

https://huggingface.co/bigscience/bloom

1 more reply

bigyikes3y ago

I don’t see how GPT-3 is any more dangerous than Stable Diffusion, Photoshop, that fake news website the crazy person you’re friends with on Facebook really likes, or any of the number of other tools and services that can be used to generate or spread fake information.

jfoster3y ago

All of your examples are limited in some way, but GPT-3 wouldn't have any meaningful limits.

Stable Diffusion: Marks images as AI-generated. (invisible watermark, but still, it's there)

Photoshop: Requires time & effort from a human.

Fake news website: Requires time & effort from a human.

3 more replies

mmh00003y ago

Because why should the wealthy and connected be the only ones -allowed- have access to such life improving technology?

j / k navigate · click thread line to collapse

0 comments

ignoramous3y ago

> This kind of model is harder to abuse, so I guess it passed their internal checks much more easily.

The version I choose to believe: stability.ai ate DALL-E for lunch, and that woke them up.

solarmistOP3y ago

This is probably also true.

jfoster3y ago

zarzavat3y ago

jfoster3y ago

Can you provide an example of an open model as capable as GPT-3?

I know there's some "mini-GPT" type models around, but they don't seem nearly as capable.

1 more reply

dwohnitmok3y ago

> I can understand not releasing GPT-3, even if I disagree with the decision.

Why do you disagree?

solarmistOP3y ago

moyix3y ago

Several groups already have. Facebook's OPT-175B is available to basically anyone with a .edu address (models up to 66B are freely available) and Bloom-176B is 100% open:

https://github.com/facebookresearch/metaseq

https://huggingface.co/bigscience/bloom

1 more reply

bigyikes3y ago

jfoster3y ago

All of your examples are limited in some way, but GPT-3 wouldn't have any meaningful limits.

Stable Diffusion: Marks images as AI-generated. (invisible watermark, but still, it's there)

Photoshop: Requires time & effort from a human.

Fake news website: Requires time & effort from a human.

3 more replies

mmh00003y ago

Because why should the wealthy and connected be the only ones -allowed- have access to such life improving technology?

j / k navigate · click thread line to collapse