mlsanityData to 7 Oct 2026

What is Wrong with Language Models that Can Not Tell a Story?

arXiv 2211.05044 ↗First posted 9 Nov 2022cs.CL cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

This paper argues that a deeper understanding of narrative and the successful generation of longer subjectively interesting texts is a vital bottleneck that hinders the progress in modern Natural Language Processing (NLP) and may even be in the whole field of Artificial Intelligence. We demonstrate that there are no adequate datasets, evaluation methods, and even operational concepts that could be used to start working on narrative processing.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 27 of its 46 references that are in the map. First posted on arXiv 9 Nov 2022.

Builds on

27 of 46 references.

References · 27

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  4. 2018Hierarchical Neural Story Generationcited by 1,182
  5. 2022Socratic Models: Composing Zero-Shot Multimodal Reasoning with Languagecited by 513
  6. 2016A Corpus and Evaluation Framework for Deeper Understanding of Commonsense Storiescited by 413
  7. 2021QuALITY: Question Answering with Long Input Texts, Yes!cited by 204
  8. 2022Re3: Generating Longer Stories With Recursive Reprompting and Revisioncited by 193
  9. 2021Pretrained Transformers as Universal Computation Enginescited by 162
  10. 2017Controlling Linguistic Style Aspects in Neural Language Generationcited by 147
  11. 2019Strategies for Structuring Story Generationcited by 124
  12. 2020Content Planning for Neural Story Generation with Aristotelian Rescoringcited by 92
15 more
  1. 2019An Annotated Dataset of Coreference in English Literaturecited by 57
  2. 2022Semantic Exploration from Language Abstractions and Pretrained Representationscited by 51
  3. 2022SQuALITY: Building a Long-Document Summarization Dataset the Hard Waycited by 50
  4. 2019Story Realization: Expanding Plot Events into Sentencescited by 35
  5. 2020Style-transfer and Paraphrase: Looking for a Sensible Semantic Similarity Metriccited by 23
  6. 2019MCScript2.0: A Machine Comprehension Corpus Focused on Script Events and Participantscited by 20
  7. 2022METRO: Efficient Denoising Pretraining of Large Scale Autoencoding Language Models with Model Generated Signalscited by 20
  8. 2021Human Evaluation of Creative NLG Systems: An Interdisciplinary Survey on Recent Paperscited by 18
  9. 2018MPST: A Corpus of Movie Plot Synopses with Tagscited by 11
  10. 2017InScript: Narrative texts annotated with script informationcited by 9
  11. 2020Paranoid Transformer: Reading Narrative of Madness as Computational Approach to Creativitycited by 8
  12. 2021StoryDB: Broad Multi-language Narrative Datasetcited by 5
  13. 2021DYPLODOC: Dynamic Plots for Document Classificationcited by 4
  14. 2019Detecting Everyday Scenarios in Narrative Textscited by 2
  15. 2021Rethinking Crowd Sourcing for Semantic Similaritycited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 2; 2025: 0; 2026: 1.

4 papers.

  1. 2024Agents' Room: Narrative Generation through Multi-step Collaborationcited by 57
  2. 2023Post Turing: Mapping the landscape of LLM Evaluationcited by 4
  3. 2026Narrative Theory-Driven LLM Methods for Automatic Story Generation and Understanding: A Surveycited by 3
  4. 2024Branching Narratives: Character Decision Points Detectioncited by 1