Without ego or inspiration: your favorite work was written by ChatGPT
Your favorite writers are actually machines: a study found that readers rated AI-generated stories as higher quality when the source was hidden. We refuse to believe it, but the line between human creativity and algorithms is vanishing.
Bad news for the human ego: many readers struggle to distinguish between stories written by artificial intelligence and those penned by humans. In fact, when readers believed a text was written by a person, they consistently awarded it higher scores. These are the findings of a new study published in the journal Judgment and Decision Making by the University of Cambridge, led by researchers from Villanova University in the USA.
The study involved 1,682 adults aged 18 to 81. Participants read one of six short stories—three written by published authors and three generated using ChatGPT. Researchers matched the stories by theme but, in some cases, provided participants with incorrect information regarding the source.
The results were surprising:
"When participants thought a story was written by a human, they gave it higher ratings. But when they did not know who was behind the work, the stories written by AI sometimes received higher scores in metrics such as quality, style, and ability to engage the reader."
In a subsequent stage, 905 participants were asked to compare two stories on the same topic and guess the author. According to The Guardian, in one experiment, participants correctly identified the AI-written story in only 39.9% of cases. In another, the recognition rate was approximately 52%.
Researchers concluded that there is currently no reliable ability to distinguish between human-written fiction and AI-generated stories. Previous reading experience did not improve identification, though familiarity with AI tools helped some participants recognize the system's writing style.
"I would say that public assumptions about the capabilities of artificial intelligence are becoming outdated," said Dr. Deena Weisberg, lead researcher and faculty member in the Department of Psychological and Brain Sciences at Villanova University.
The study also examined personal attitudes toward AI. Individuals with positive views toward artificial intelligence tended to rate stories they believed were written by ChatGPT more favorably. Researchers suggest that AI-generated stories may be highly regarded because they are often simpler and more accessible. However, the study also confirmed that readers still attach great importance to the idea of human creation—when told a text was written by a human, they were inclined to rate it higher.
