mlsanityData to 7 Oct 2026

Creative Writing with an AI-Powered Writing Assistant: Perspectives from Professional Writers

arXiv 2211.05030 ↗First posted 9 Nov 2022cs.HC cs.CLcited by 69

Not on the map. Why?

Abstract (arXiv)

Recent developments in natural language generation (NLG) using neural language models have brought us closer than ever to the goal of building AI-powered creative writing tools. However, most prior work on human-AI collaboration in the creative writing domain has evaluated new systems with amateur writers, typically in contrived user studies of limited scope. In this work, we commissioned 13 professional, published writers from a diverse set of creative writing backgrounds to craft stories using Wordcraft, a text editor with built-in AI-powered writing assistance tools. Using interviews and participant journals, we discuss the potential of NLG to have significant impact in the creative writing domain--especially with respect to brainstorming, generation of story details, world-building, and research assistance. Experienced writers, more so than amateurs, typically have well-developed systems and methodologies for writing, as well as distinctive voices and target audiences. Our work highlights the challenges in building for these writers; NLG technologies struggle to preserve style and authorial voice, and they lack deep understanding of story contents. In order for AI-powered writing assistants to realize their full potential, it is essential that they take into account the diverse goals and expertise of human writers.

Key facts. Cited by 69 papers in the map (data through 7 Oct 2026). Builds on 24 of its 45 references that are in the map. First posted on arXiv 9 Nov 2022.

Builds on

24 of 45 references.

References · 24

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  3. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
  4. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  5. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
  6. 2020Longformer: The Long-Document Transformercited by 3,362
  7. 2020Extracting Training Data from Large Language Modelscited by 2,144
  8. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,970
  9. 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,830
  10. 2022LaMDA: Language Models for Dialog Applicationscited by 1,218
  11. 2018Hierarchical Neural Story Generationcited by 1,182
  12. 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,122
12 more
  1. 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 890
  2. 2022Quantifying Memorization Across Neural Language Modelscited by 755
  3. 2021Do Prompt-Based Models Really Understand the Meaning of their Prompts?cited by 324
  4. 2022Co-Writing Screenplays and Theatre Scripts with Language Models: An Evaluation by Industry Professionalscited by 191
  5. 2021A Recipe For Arbitrary Text Style Transfer with Large Language Modelscited by 107
  6. 2022Block-Recurrent Transformerscited by 107
  7. 2022General-purpose, long-context autoregressive modeling with Perceiver ARcited by 60
  8. 2020STORIUM: A Dataset and Evaluation Platform for Machine-in-the-Loop Story Generationcited by 56
  9. 2021Wordcraft: a Human-AI Collaborative Editor for Story Writingcited by 41
  10. 2020Collaborative Storytelling with Large-scale Neural Language Modelscited by 21
  11. 2021Inspiration through Observation: Demonstrating the Influence of Automatically Generated Text on Creative Writingcited by 14
  12. 2021Addressing Inquiries about History: An Efficient and Practical Framework for Evaluating Open-domain Chatbot Consistencycited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 1; 2023: 19; 2024: 23; 2025: 14; 2026: 12.

69 papers.

Sort:

By area:

  1. 2023Challenges and Applications of Large Language Modelscited by 251
  2. 2023Does Writing with Language Models Reduce Content Diversity?cited by 190
  3. 2023Art or Artifice? Large Language Models and the False Promise of Creativitycited by 168
  4. 2023FederatedScope-LLM: A Comprehensive Package for Fine-tuning Large Language Models in Federated Learningcited by 146
  5. 2022Evaluating Human-Language Model Interactioncited by 90
  6. 2024A Design Space for Intelligent and Interactive Writing Assistantscited by 76
  7. 2024Building Machines that Learn and Think with Peoplecited by 73
  8. 2024LLM Discussion: Enhancing the Creativity of Large Language Models via Discussion Framework and Role-Playcited by 65
  9. 2023AI-Generated Content (AIGC): A Surveycited by 59
  10. 2023On the Creativity of Large Language Modelscited by 57
  11. 2024Can AI writing be salvaged? Mitigating Idiosyncrasies and Improving Human-AI Alignment in the Writing Process through Editscited by 49
  12. 2023VISAR: A Human-AI Argumentative Writing Assistant with Visual Programming and Rapid Draft Prototypingcited by 46
38 more
  1. 2024AI as Humanity's Salieri: Quantifying Linguistic Creativity of Language Models via Systematic Attribution of Machine Text against Web Textcited by 40
  2. 2023Creativity Support in the Age of Large Language Models: An Empirical Study Involving Emerging Writerscited by 32
  3. 2023Interactive Natural Language Processingcited by 31
  4. 2024Adaptable Logical Control for Large Language Modelscited by 30
  5. 2024A Robot Walks into a Bar: Can Language Models Serve as Creativity Support Tools for Comedy? An Evaluation of LLMs' Humour Alignment with Comedianscited by 29
  6. 2023Experimental Narratives: A Comparison of Human Crowdsourced Storytelling and AI Storytellingcited by 26
  7. 2023Building Socio-culturally Inclusive Stereotype Resources with Community Engagementcited by 25
  8. 2025AI-Slop to AI-Polish? Aligning Language Models through Edit-Based Writing Rewards and Test-time Computationcited by 24
  9. 2023CALYPSO: LLMs as Dungeon Masters' Assistantscited by 23
  10. 2023RELIC: Investigating Large Language Model Responses using Self-Consistencycited by 23
  11. 2024CS4: Measuring the Creativity of Large Language Models Automatically by Controlling the Number of Story-Writing Constraintscited by 22
  12. 2024Reading Subtext: Evaluating Large Language Models on Short Story Summarization with Writerscited by 19
  13. 2024GhostWriter: Augmenting Collaborative Human-AI Writing Experiences Through Personalization and Agencycited by 18
  14. 2024What Makes a Good Story and How Can We Measure It? A Comprehensive Survey of Story Evaluationcited by 17
  15. 2024Player-Driven Emergence in LLM-Driven Game Narrativecited by 16
  16. 2024Does Liking Yellow Imply Driving a School Bus? Semantic Leakage in Language Modelscited by 14
  17. 2024"It was 80% me, 20% AI": Seeking Authenticity in Co-Writing with Large Language Modelscited by 14
  18. 2025Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Processcited by 14
  19. 2025Which Contributions Deserve Credit? Perceptions of Attribution in Human-AI Co-Creationcited by 13
  20. 2023ArtWhisperer: A Dataset for Characterizing Human-AI Interactions in Artistic Creationscited by 10
  21. 2024Subtle Biases Need Subtler Measures: Dual Metrics for Evaluating Representative and Affinity Bias in Large Language Modelscited by 10
  22. 2025Help Me Write a Story: Evaluating LLMs' Ability to Generate Writing Feedbackcited by 10
  23. 2026Can Good Writing Be Generative? Expert-Level AI Writing Emerges through Fine-Tuning on High-Quality Bookscited by 9
  24. 2025Frankentext: Stitching random text fragments into long-form narrativescited by 8
  25. 2023End-to-end Story Plot Generatorcited by 7
  26. 2024Customizing Large Language Model Generation Style using Parameter-Efficient Finetuningcited by 7
  27. 2025Where Do I 'Add the Egg'?: Exploring Agency and Ownership in AI Creative Co-Writing Systemscited by 7
  28. 2025Poor Alignment and Steerability of Large Language Models: Evidence from College Admission Essayscited by 6
  29. 2024Gazelle: An Instruction Dataset for Arabic Writing Assistancecited by 4
  30. 2024Game Plot Design with an LLM-powered Assistant: An Empirical Study with Game Designerscited by 4
  31. 2024Using Machine Learning to Distinguish Human-written from Machine-generated Creative Fictioncited by 4
  32. 2025Constella: Supporting Storywriters' Interconnected Character Creation through LLM-based Multi-Agentscited by 4
  33. 2026LLMs Exhibit Significantly Lower Uncertainty in Creative Writing Than Professional Writerscited by 4
  34. 2023Exploring EFL students' prompt engineering in human-AI story writing: an Activity Theory perspectivecited by 3
  35. 2025Composable Prompting Workspaces for Creative Writing: Exploration and Iteration Using Dynamic Widgetscited by 3
  36. 2023Conveying the Predicted Future to Users: A Case Study of Story Plot Predictioncited by 2
  37. 2024Evaluation of Instruction-Following Ability for Large Language Models on Story-Ending Generationcited by 2
  38. 2024Human-AI Collaborative Taxonomy Construction: A Case Study in Profession-Specific Writing Assistantscited by 2

50 most cited of 69 All 69 (JSON)