Researchers say ChatGPT model is trained on texts from copyrighted books

Share post:

The University of California, Berkeley researchers published a paper titled “Speak, Memory: An Archaeology of Books Known to ChatGPT/GPT-4” in which they discuss how OpenAI’s ChatGPT and the GPT-4 big language model were trained on material from copyrighted novels.

GPT-4 has learned a wide range of copyrighted content, according to the study team of Kent Chang, Mackenzie Cramer, Sandeep Soni, and David Bamman, with the degree of memory connected to the frequency of excerpts from the books appearing on the web. The team has made their code and data available on GitHub, as well as a list of the recognized novels, which includes titles such as Harry Potter, The Lord of the Rings, and The Hitchhiker’s Guide to the Galaxy.

The researchers observe that science fiction and fantasy literature lead the list, which they ascribe to their popularity on the internet. They also mention that remembering certain titles has a knock-on effect, making models more accurate in responding to specific instructions. ChatGPT, on the other hand, shows less understanding of works in other genres as a result of the models’ familiarity with sci-fi and fantasy novels. The researchers propose for the usage of publicly available training data to improve the transparency of the models’ behavior.

While the researchers have focused less on the copyright implications of memorizing copyrighted texts, text-generating applications based on these models may produce passages that are significantly similar or identical to copyrighted texts ingested.

The sources for this piece include an article in TheRegister.

SUBSCRIBE NOW

Related articles

Target’s new AI is aimed at employees

Target is introducing a new generative artificial intelligence tool aimed at enhancing the efficiency of its store employees...

The good and the bad of AI generated code

Generative AI tools are transforming the coding landscape, making both skilled and novice developers more efficient. However, the...

Microsoft’s AI success may spell defeat for it’s climate goals

Microsoft's ambitious strides in AI technology are now posing a significant challenge to its own climate goals, as...

OpenAI’s Chief Scientist Ilya Sutskever Departs Company

Ilya Sutskever, co-founder and chief scientist of OpenAI, has officially announced his departure from the company. This move...

Become a member

New, Relevant Tech Stories. Our article selection is done by industry professionals. Our writers summarize them to give you the key takeaways