Readers Prefer Outputs of AI Trained on Copyrighted Books over Expert Human Writers
Not on the map. Why?
Abstract (arXiv)
The use of copyrighted books for training AI has sparked lawsuits from authors concerned about AI generating derivative content. Yet whether these models can produce high-quality literary text emulating authors' voices remains unclear. We conducted a preregistered study comparing MFA-trained writers with three frontier models (ChatGPT, Claude, Gemini) writing up to 450-word excerpts emulating 50 award-winning authors' styles. In blind pairwise evaluations by 28 MFA-trained readers and 516 college-educated general readers, AI text from in-context prompting was strongly disfavored by MFA readers for stylistic fidelity (OR=0.16) and quality (OR=0.13), while general readers showed no fidelity preference (OR=1.06) but favored AI for quality (OR=1.82). Fine-tuning ChatGPT on authors' complete works reversed these results: MFA readers favored AI for fidelity (OR=8.16) and quality (OR=1.87), with general readers showing even stronger preference (fidelity OR=16.65; quality OR=5.42). Both groups preferred fine-tuned AI, but the writer-type X reader-type interaction remained significant (p=0.021 for fidelity; p<10^-4 for quality), indicating general readers favored AI by a wider margin. Effects are robust under cluster-robust inference and generalize across authors in heterogeneity analyses. Fine-tuned outputs were rarely flagged as AI-generated (3% vs. 97% for prompting) by leading detectors. Mediation analysis shows fine-tuning eliminates detectable AI quirks that penalize in-context outputs, altering the nexus between detectability and preference. While not accounting for effort to transform AI output into publishable prose, the median fine-tuning cost of 81 per author represents a 99.7% reduction versus typical writer compensation. Author-specific fine-tuning enables non-verbatim AI writing preferred over expert human writing, providing evidence relevant to copyright's fourth fair-use factor.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 17 of its 65 references that are in the map. First posted on arXiv 15 Oct 2025.
Builds on
17 of 65 references.
References · 17
- 2023Art or Artifice? Large Language Models and the False Promise of Creativitycited by 168
- 2023Generative artificial intelligence enhances creativity but reduces the diversity of novel contentcited by 165
- 2023Self-Alignment with Instruction Backtranslationcited by 149
- 2022The Debate Over Understanding in AI's Large Language Modelscited by 142
- 2023Artificial Artificial Artificial Intelligence: Crowd Workers Widely Use Large Language Models for Text Production Taskscited by 102
- 2025Which Economic Tasks are Performed with AI? Evidence from Millions of Claude Conversationscited by 88
- 2024Can AI writing be salvaged? Mitigating Idiosyncrasies and Improving Human-AI Alignment in the Writing Process through Editscited by 49
- 2024Echoes in AI: Quantifying lack of plot diversity in LLM outputscited by 47
- 2024Detection and Measurement of Syntactic Templates in Generated Textcited by 44
- 2025People who frequently use ChatGPT for writing tasks are accurate and robust detectors of AI-generated textcited by 39
- 2024SHIELD: Evaluation and Defense Strategies for Copyright Compliance in LLM Text Generationcited by 33
- 2025AI-Slop to AI-Polish? Aligning Language Models through Edit-Based Writing Rewards and Test-time Computationcited by 24
5 more
- 2024How Does the Disclosure of AI Assistance Affect the Perceptions of Writing?cited by 12
- 2024Does ChatGPT Have a Poetic Style?cited by 12
- 2016Small sample methods for cluster-robust variance estimation and hypothesis testing in fixed effects modelscited by 7
- 2025ParaPO: Aligning Language Models to Reduce Verbatim Reproduction of Pre-training Datacited by 6
- 2024Creative Writers' Attitudes on Writing as Training Data for Large Language Modelscited by 4
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026GPTZero: Robust Detection of LLM-Generated Textscited by 10
- 2026Can Good Writing Be Generative? Expert-Level AI Writing Emerges through Fine-Tuning on High-Quality Bookscited by 9
- 2026StoryScope: Investigating idiosyncrasies in AI fictioncited by 9
- 2026Alignment Whack-a-Mole : Finetuning Activates Verbatim Recall of Copyrighted Books in Large Language Modelscited by 6
- 2026AI Fiction in the Wildcited by 2
- 2026Generative AI floods and dilutes the market for bookscited by 2
- 2026Hitting a Moving Target: Test-Time Adaptation for AI Text Detection under Continual Distribution Shiftcited by 1
- 2026Weightless Fine-Tuning: Personalizing LLMs via Logit-Space Transportcited by 0
- 2026Weightless Fine-Tuning: Personalizing LLMs via Logit-Space Transport11 Aug 2026
- 2026Generative AI floods and dilutes the market for books22 Jul 2026
- 2026Hitting a Moving Target: Test-Time Adaptation for AI Text Detection under Continual Distribution Shift23 Jun 2026
- 2026AI Fiction in the Wild22 Jun 2026
- 2026StoryScope: Investigating idiosyncrasies in AI fiction3 Apr 2026
- 2026Alignment Whack-a-Mole : Finetuning Activates Verbatim Recall of Copyrighted Books in Large Language Models21 Mar 2026
- 2026GPTZero: Robust Detection of LLM-Generated Texts13 Feb 2026
- 2026Can Good Writing Be Generative? Expert-Level AI Writing Emerges through Fine-Tuning on High-Quality Books26 Jan 2026