I've read that ChatGPT is not connected to the net, but if it was: Couldn't you have it do a google search (or better yet corpus search) for the string it generated and then return the most significant matches (significance by string matching, not google rank)? It would be really crude, but wouldn't this just be a handful of lines of code that don't interfere with the "transformers-based model" code at all?
The other day I had GPT write a rap battle between Burger King and Ronald McDonald. One of the stanzas came back:
Burger King:
Your burgers are plain, your buns a bore.
Your clown's been around since '63,
I'm sure my flame-grilled taste will leave you impressed
My burgers are fresh, my fries are the best
So here's the challenge for you - who do you compensate for that line?
The complaint that people have isn't that GPT isn't citing its sources but rather that it isn't compensating the people who created the data that has that information.
... and now, if you're ever asked about historical clown trivia and pull out the "Ronald has been around since 1963", who should you give a royalty to? Me (for writing this), GPT (for making me aware of it), Wikipedia (for the source of my links in this post), the estate of Willard Scott for the Joy of Living (which Wikipedia cites), some random blog author that had some clown trivia on it that happened to have been part of the training set for GPT?
It isn't just monetary compensation that's important here.
I come at this from the point of view of a scientist who is expected to reference ideas. Not necessarily back to their original source, but at least back to a source that can theoretically point back to another link in the chain.
Sure, I can manually search for a reference based on what ChatGPT gave me. Or someone could spend a few minutes adding a few lines of code to ChatGPT to save millions of people some minutes of time.
-----
What would be awesome is an LLM that you can feed data to, and it can then write a paper based solely on the data you feed it.
I had it write a poem the other day in the style of Roses are read about coffee and bacon.
Roses are red
Bacon is greasy
My coffee is hot
Together they please me
Identify a word that have different meanings to two different professions at the same time and the professions that use them. Give the definition of the word for each profession. Write a joke using this word.
The word is "band."
Definition for a Musician: A group of musicians who play music together.
Definition for an Astronomer: A dark region in the sky with less stars.
Joke: What did the astronomer say when the musician asked him to join his band? "I'm sorry, I don't do solos in the dark!"
---
> What would be awesome is an LLM that you can feed data to, and it can then write a paper based solely on the data you feed it.
Based on a quick search the best credits would be ChatGPT as the arranger, and "Roud Folk Song Index number 19798" as the inspiration.
> "Joke: What did the astronomer say when the musician asked him to join his band? "I'm sorry, I don't do solos in the dark!""
> "How do you credit that?"
That you credit to ChatGPT. It's not referencing facts or discoveries, so credit isn't as important as it is for articles. If you want to credit an inspiration then I'm sure there's an index of joke forms out there that has an appropriate number to cite.
I can't actually find a definition for band in astronomy that is "a dark region in the sky with less stars." So it seems to be a pretty poor joke.
> https://platform.openai.com/docs/guides/fine-tuning
This does it solely based on the data you feed into it? And by data I mean scientific data that you discovered, and want formatted into a particular research article style.
Edit to add: Possible sources for the line "together they please me":
1) https://www.google.com/books/edition/Poetical_Works_of_Louis...
2) https://www.google.com/books/edition/Florio_s_First_fruites/...