Can Good Writing Be Generative? Expert-Level AI Writing Emerges through Fine-Tuning on High-Quality Books
Not on the map. Why?
Abstract (arXiv)
Creative writing has long been considered a uniquely human endeavor, requiring voice and style that machines could not replicate. This assumption is challenged by Generative AI that can emulate thousands of author styles in seconds with negligible marginal labor. To understand this better, we conducted a behavioral experiment where 28 MFA writers (experts) competed against three LLMs in emulating 50 critically acclaimed authors. Based on blind pairwise comparisons by 28 expert judges and 131 lay judges, we find that experts preferred human writing in 82.7% of cases under the in-context prompting condition but this reversed to 62% preference for AI after fine-tuning on authors' complete works. Lay judges, however, consistently preferred AI writing. Debrief interviews with expert writers revealed that their preference for AI writing triggered an identity crisis, eroding aesthetic confidence and questioning what constitutes "good writing." These findings challenge discourse about AI's creative limitations and raise fundamental questions about the future of creative labor.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 30 of its 74 references that are in the map. First posted on arXiv 26 Jan 2026.
Builds on
30 of 74 references.
References · 30
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2022Co-Writing Screenplays and Theatre Scripts with Language Models: An Evaluation by Industry Professionalscited by 191
- 2023Art or Artifice? Large Language Models and the False Promise of Creativitycited by 168
- 2023Generative artificial intelligence enhances creativity but reduces the diversity of novel contentcited by 165
- 2024Homogenization Effects of Large Language Models on Human Creative Ideationcited by 127
- 2024Mapping the Increasing Use of LLMs in Scientific Paperscited by 112
- 2021Sparks: Inspiration for Science Writing using Language Modelscited by 80
- 2024A Design Space for Intelligent and Interactive Writing Assistantscited by 76
- 2024Delving into LLM-assisted writing in biomedical publications through excess vocabularycited by 75
- 2022Creative Writing with an AI-Powered Writing Assistant: Perspectives from Professional Writerscited by 69
- 2024Shaping Human-AI Collaboration: Varied Scaffolding Levels in Co-writing with Language Modelscited by 51
18 more
- 2025The Widespread Adoption of Large Language Model-Assisted Writing Across Societycited by 50
- 2024Can AI writing be salvaged? Mitigating Idiosyncrasies and Improving Human-AI Alignment in the Writing Process through Editscited by 49
- 2025People who frequently use ChatGPT for writing tasks are accurate and robust detectors of AI-generated textcited by 39
- 2024The Effects of Generative AI on Design Fixation and Divergent Thinkingcited by 37
- 2024A Robot Walks into a Bar: Can Language Models Serve as Creativity Support Tools for Comedy? An Evaluation of LLMs' Humour Alignment with Comedianscited by 29
- 2024PostMark: A Robust Blackbox Watermark for Large Language Modelscited by 24
- 2024From Pen to Prompt: How Creative Writers Integrate AI into their Writing Practicecited by 14
- 2024"It was 80% me, 20% AI": Seeking Authenticity in Co-Writing with Large Language Modelscited by 14
- 2025Governance of Generative AI in Creative Work: Consent, Credit, Compensation, and Beyondcited by 13
- 2025Which Contributions Deserve Credit? Perceptions of Attribution in Human-AI Co-Creationcited by 13
- 2024How Does the Disclosure of AI Assistance Affect the Perceptions of Writing?cited by 12
- 2024Copying style, Extracting value: Illustrators' Perception of AI Style Transfer and its Impact on Creative Laborcited by 8
- 2025Readers Prefer Outputs of AI Trained on Copyrighted Books over Expert Human Writerscited by 8
- 2025Making the Write Connections: Linking Writing Support Tools with Writer's Needscited by 7
- 2024Creative Writers' Attitudes on Writing as Training Data for Large Language Modelscited by 4
- 2025Phraselette: A Poet's Procedural Palettecited by 4
- 2024Public Opinions About Copyright for AI-Generated Art: The Role of Egocentricity, Competition, and Experiencecited by 2
- 2026Who Owns the Text? Design Patterns for Preserving Authorship in AI-Assisted Writingcited by 1
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026Alignment Whack-a-Mole : Finetuning Activates Verbatim Recall of Copyrighted Books in Large Language Modelscited by 6
- 2026AI Fiction in the Wildcited by 2
- 2026Generative AI floods and dilutes the market for bookscited by 2
- 2026The Ultimate Tutorial for AI-driven Scale Development in Generative Psychometrics: Releasing AIGENIE from its Bottlecited by 1
- 2026Ex Ante Evaluation of AI-Induced Idea Diversity Collapsecited by 1
- 2026Narrative Flattening: How Post-Training Compresses Thematic, Affective, and Stylistic Variation in LLM Fictioncited by 1
- 2026Do Large Language Models Always Tell The Same Stories?cited by 1
- 2026Characterizing Cultural Localization in AI-Generated Storiescited by 0
- 2026Weightless Fine-Tuning: Personalizing LLMs via Logit-Space Transportcited by 0
- 2026Weightless Fine-Tuning: Personalizing LLMs via Logit-Space Transport11 Aug 2026
- 2026Generative AI floods and dilutes the market for books22 Jul 2026
- 2026AI Fiction in the Wild22 Jun 2026
- 2026Do Large Language Models Always Tell The Same Stories?15 Jun 2026
- 2026Characterizing Cultural Localization in AI-Generated Stories12 Jun 2026
- 2026Narrative Flattening: How Post-Training Compresses Thematic, Affective, and Stylistic Variation in LLM Fiction27 May 2026
- 2026Ex Ante Evaluation of AI-Induced Idea Diversity Collapse7 May 2026
- 2026The Ultimate Tutorial for AI-driven Scale Development in Generative Psychometrics: Releasing AIGENIE from its Bottle30 Mar 2026
- 2026Alignment Whack-a-Mole : Finetuning Activates Verbatim Recall of Copyrighted Books in Large Language Models21 Mar 2026