mlsanityData to 7 Oct 2026

The Next Chapter: A Study of Large Language Models in Storytelling

arXiv 2301.09790 ↗First posted 24 Jan 2023cs.CLcited by 58

Not on the map. Why?

Abstract (arXiv)

To enhance the quality of generated stories, recent story generation models have been investigating the utilization of higher-level attributes like plots or commonsense knowledge. The application of prompt-based learning with large language models (LLMs), exemplified by GPT-3, has exhibited remarkable performance in diverse natural language processing (NLP) tasks. This paper conducts a comprehensive investigation, utilizing both automatic and human evaluation, to compare the story generation capacity of LLMs with recent models across three datasets with variations in style, register, and length of stories. The results demonstrate that LLMs generate stories of significantly higher quality compared to other story generation models. Moreover, they exhibit a level of performance that competes with human authors, albeit with the preliminary observation that they tend to replicate real stories in situations involving world knowledge, resembling a form of plagiarism.

Key facts. Cited by 58 papers in the map (data through 7 Oct 2026). Builds on 40 of its 64 references that are in the map. First posted on arXiv 24 Jan 2023.

Builds on

40 of 64 references.

References · 40

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  4. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  5. 2019The Curious Case of Neural Text Degenerationcited by 2,881
  6. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
  7. 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,829
  8. 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,196
  9. 2021What Makes Good In-Context Examples for GPT-3?cited by 1,184
  10. 2018Hierarchical Neural Story Generationcited by 1,182
  11. 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,122
  12. 2015A Diversity-Promoting Objective Function for Neural Conversation Modelscited by 1,068
28 more
  1. 2015Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Bookscited by 1,041
  2. 2015Teaching Machines to Read and Comprehendcited by 1,039
  3. 2021BARTScore: Evaluating Generated Text as Text Generationcited by 719
  4. 2018Texygen: A Benchmarking Platform for Text Generation Modelscited by 484
  5. 2019MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distancecited by 415
  6. 2021All That's 'Human' Is Not Gold: Evaluating Human Evaluation of Generated Textcited by 287
  7. 2021Reframing Instructional Prompts to GPTk's Languagecited by 176
  8. 2022Revisiting the Gold Standard: Grounding Summarization Evaluation with Robust Human Evaluationcited by 141
  9. 2021How much do language models copy from their training data? Evaluating linguistic novelty in text generation using RAVENcited by 124
  10. 2020A Knowledge-Enhanced Pretraining Model for Commonsense Story Generationcited by 116
  11. 2020PlotMachines: Outline-Conditioned Generation with Dynamic Plot State Trackingcited by 104
  12. 2018Language GANs Falling Shortcited by 97
  13. 2021The Perils of Using Mechanical Turk to Evaluate Open-Ended Text Generationcited by 96
  14. 2020Content Planning for Neural Story Generation with Aristotelian Rescoringcited by 92
  15. 2019Do Massively Pretrained Language Models Make Better Storytellers?cited by 90
  16. 2022Of Human Criteria and Automatic Metrics: A Benchmark of the Evaluation of Story Generationcited by 73
  17. 2016A Joint Many-Task Model: Growing a Neural Network for Multiple NLP Taskscited by 62
  18. 2019Long and Diverse Text Generation with Planning-based Hierarchical Variational Modelcited by 62
  19. 2019Jointly Measuring Diversity and Quality in Text Generation Modelscited by 61
  20. 2021OpenMEVA: A Benchmark for Evaluating Open-ended Story Generation Metricscited by 61
  21. 2020UNION: An Unreferenced Metric for Evaluating Open-ended Story Generationcited by 60
  22. 2021Long Text Generation by Modeling Sentence-Level and Discourse-Level Coherencecited by 45
  23. 2018Toward Diverse Text Generation with Inverse Reinforcement Learningcited by 41
  24. 2020Automated Storytelling via Causal, Commonsense Plot Orderingcited by 38
  25. 2021Inferring the Reader: Guiding Automated Story Generation with Commonsense Reasoningcited by 29
  26. 2020How Furiously Can Colourless Green Ideas Sleep? Sentence Acceptability in Contextcited by 26
  27. 2022The Authenticity Gap in Human Evaluationcited by 24
  28. 2021Exploring Story Generation with Multi-task Objectives in Variational Autoencoderscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 3; 2024: 25; 2025: 17; 2026: 13.

58 papers.

Sort:

By area:

  1. 2024Agents' Room: Narrative Generation through Multi-step Collaborationcited by 57
  2. 2024M4GT-Bench: Evaluation Benchmark for Black-Box Machine-Generated Text Detectioncited by 43
  3. 2024FIRE: Fact-checking with Iterative Retrieval and Verificationcited by 39
  4. 2024Are LLM-based Evaluators Confusing NLG Quality Criteria?cited by 35
  5. 2024Evaluating the Evaluator: Measuring LLMs' Adherence to Task Evaluation Instructionscited by 34
  6. 2024On the Impact of Fine-Tuning on Chain-of-Thought Reasoningcited by 32
  7. 2024SemEval-2024 Task 8: Multidomain, Multimodel and Multilingual Machine-Generated Text Detectioncited by 30
  8. 2024Generating Long-form Story Using Dynamic Hierarchical Outlining with Memory-Enhancementcited by 30
  9. 2024Leveraging Large Language Models for Learning Complex Legal Concepts through Storytellingcited by 23
  10. 2025Automated Creativity Evaluation for Large Language Models: A Reference-Based Approachcited by 20
  11. 2023ReelFramer: Human-AI Co-Creation for News-to-Video Translationcited by 19
  12. 2024Themis: A Reference-free NLG Evaluation Language Model with Flexibility and Interpretabilitycited by 19
38 more
  1. 2024Automatic Metrics in Natural Language Generation: A Survey of Current Evaluation Practicescited by 19
  2. 2024Long-Form Speech Generation with Spoken Language Modelscited by 19
  3. 2024When LLMs Play the Telephone Game: Cultural Attractors as Conceptual Tools to Evaluate LLMs in Multi-turn Settingscited by 17
  4. 2024What Makes a Good Story and How Can We Measure It? A Comprehensive Survey of Story Evaluationcited by 17
  5. 2024On the Intrinsic Self-Correction Capability of LLMs: Uncertainty and Latent Conceptcited by 16
  6. 2025A Cognitive Writing Perspective for Constrained Long-Form Text Generationcited by 14
  7. 2024A Survey to Recent Progress Towards Understanding In-Context Learningcited by 12
  8. 2023Event Causality Is Key to Computational Story Understandingcited by 11
  9. 2025Once Upon a Time: Interactive Learning for Storytelling with Small Language Modelscited by 11
  10. 2024PLAYER*: Enhancing LLM-based Multi-Agent Communication and Interaction in Murder Mystery Gamescited by 10
  11. 2025TALES: A Taxonomy and Analysis of Cultural Representations in LLM-generated Storiescited by 10
  12. 2023DeltaScore: Fine-Grained Story Evaluation with Perturbationscited by 9
  13. 2024Recent Advancement of Emotion Cognition in Large Language Modelscited by 9
  14. 2024The GPT-WritingPrompts Dataset: A Comparative Analysis of Character Portrayal in Short Storiescited by 8
  15. 2025Frankentext: Stitching random text fragments into long-form narrativescited by 8
  16. 2024Jailbreaking LLMs with Arabic Transliteration and Arabizicited by 7
  17. 2024Creativity in AI: Progresses and Challengescited by 7
  18. 2025Can LLMs Automate Fact-Checking Article Writing?cited by 7
  19. 2026Lost in Stories: Consistency Bugs in Long Story Generation by LLMscited by 6
  20. 2025DAMASHA: Detecting AI in Mixed Adversarial Texts via Segmentation with Human-interpretable Attributioncited by 5
  21. 2025What Matters in Evaluating Book-Length Stories? A Systematic Study of Long Story Evaluationcited by 5
  22. 2026Segmenting Human-LLM Co-authored Text via Change Point Detectioncited by 5
  23. 2024CLUE: Concept-Level Uncertainty Estimation for Large Language Modelscited by 4
  24. 2024MLD-EA: Check and Complete Narrative Coherence by Introducing Emotions and Actionscited by 4
  25. 2025OpeNLGauge: An Explainable Metric for NLG Evaluation with Open-Weights LLMscited by 4
  26. 2025LLM-driven Constrained Copy Generation through Iterative Refinementcited by 3
  27. 2026The CLEF-2026 CheckThat! Lab: Advancing Multilingual Fact-Checkingcited by 3
  28. 2026Narrative Theory-Driven LLM Methods for Automatic Story Generation and Understanding: A Surveycited by 3
  29. 2025Evaluating LLM Story Generation through Large-scale Network Analysis of Social Structurescited by 2
  30. 2026Rewarding Creativity: A Human-Aligned Generative Reward Model for Reinforcement Learning in Storytellingcited by 2
  31. 2026The CLEF-2026 FinMMEval Lab: Multilingual and Multimodal Evaluation of Financial AI Systemscited by 2
  32. 2024Rule or Story, Which is a Better Commonsense Expression for Talking with Large Language Models?cited by 1
  33. 2025Enhancing multimodal analogical reasoning with Logic Augmented Generationcited by 1
  34. 2025Human-AI Narrative Synthesis to Foster Shared Understanding in Civic Decision-Makingcited by 1
  35. 2025On the Convergence of Moral Self-Correction in Large Language Modelscited by 1
  36. 2025Engagement Undermines Safety: How Stereotypes and Toxicity Shape Humor in Language Modelscited by 1
  37. 2024WHAT-IF: Exploring Branching Narratives by Meta-Prompting Large Language Modelscited by 0
  38. 2025Measuring Information Distortion in Hierarchical Ultra long Novel Reconstruction:The Optimal Expansion Ratiocited by 0

50 most cited of 58 All 58 (JSON)