undefined | Better HN

0 pointsTulliusCicero4y ago0 comments

There are also other models that are more open. NovelAI uses GPT-J IIRC.

0 comments

There's no public model of the same size as the biggest GPT-3 yet, is there? I'd use GPT-3 to see what's possible, and then try to replicate the performance with the smaller public models. With the pace of AI development it's likely that GPT-3 will be matched by an open model in the not too distant future, but it's nice to be able to prototype with GPT-3 now to get a head start.

robbedpeter4y ago

Gpt-J is of comparable quality, within 7-10% of the performance of gpt-3 in almost all metrics. It's also much smaller and less expensive to run. The higher quality training data and better tweaks to the algorithm paid off - the license, restrictions, and cost of gpt-3 aren't necessarily valuable enough to justify not using gpt-j.

stavros4y ago

Hmm, that's very interesting! Do you know if there's a hosted service anywhere? I don't mind paying a few dollars a month for my small use case, but my usage can't justify the huge server it needs to run.

2 more replies

j / k navigate · click thread line to collapse

0 comments

modeless4y ago

robbedpeter4y ago

stavros4y ago

2 more replies

j / k navigate · click thread line to collapse