mlsanityData to 7 Oct 2026

A Survey of Machine Narrative Reading Comprehension Assessments

arXiv 2205.00299 ↗First posted 30 Apr 2022cs.AIcited by 10

Not on the map. Why?

Abstract (arXiv)

As the body of research on machine narrative comprehension grows, there is a critical need for consideration of performance assessment strategies as well as the depth and scope of different benchmark tasks. Based on narrative theories, reading comprehension theories, as well as existing machine narrative reading comprehension tasks and datasets, we propose a typology that captures the main similarities and differences among assessment tasks; and discuss the implications of our typology for new task design and the challenges of narrative reading comprehension.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 26 of its 71 references that are in the map. First posted on arXiv 30 Apr 2022.

Builds on

26 of 71 references.

References · 26

  1. 2016The LAMBADA dataset: Word prediction requiring a broad discourse contextcited by 960
  2. 2017The NarrativeQA Reading Comprehension Challengecited by 590
  3. 2016A Corpus and Evaluation Framework for Deeper Understanding of Commonsense Storiescited by 413
  4. 2021BookSum: A Collection of Datasets for Long-form Narrative Summarizationcited by 184
  5. 2015The Goldilocks Principle: Reading Children's Books with Explicit Memory Representationscited by 108
  6. 2018Event2Mind: Commonsense Inference on Events, Intents, and Reactionscited by 82
  7. 2021SummScreen: A Dataset for Abstractive Screenplay Summarizationcited by 80
  8. 2022Fantastic Questions and Where to Find Them: FairytaleQA -- An Authentic Dataset for Narrative Comprehensioncited by 79
  9. 2016A Thorough Examination of the CNN/Daily Mail Reading Comprehension Taskcited by 71
  10. 2020TORQUE: A Reading Comprehension Dataset of Temporal Ordering Questionscited by 65
  11. 2019An Annotated Dataset of Coreference in English Literaturecited by 57
  12. 2021"Let Your Characters Tell Their Story": A Dataset for Character-Centric Narrative Understandingcited by 48
14 more
  1. 2019Movie Plot Analysis via Turning Point Identificationcited by 33
  2. 2020To Test Machine Comprehension, Start by Defining Comprehensioncited by 31
  3. 2018MCScript: A Novel Dataset for Assessing Machine Comprehension Using Script Knowledgecited by 30
  4. 2021ESTER: A Machine Reading Comprehension Dataset for Event Semantic Relation Reasoningcited by 30
  5. 2020Exploring Content Selection in Summarization of Novel Chapterscited by 29
  6. 2021TellMeWhy: A Dataset for Answering Why-Questions in Narrativescited by 27
  7. 2021English Machine Reading Comprehension Datasets: A Surveycited by 26
  8. 2020Screenplay Summarization Using Latent Narrative Structurecited by 22
  9. 2022TVShowGuess: Character Comprehension in Stories as Speaker Guessingcited by 17
  10. 2016Embracing data abundance: BookTest Dataset for Reading Comprehensioncited by 15
  11. 2021Narrative Question Answering with Cutting-Edge Open-Domain QA Techniques: A Comprehensive Studycited by 15
  12. 2020Exploring aspects of similarity between spoken personal narratives by disentangling them into narrative clause typescited by 9
  13. 2015Annotating Character Relationships in Literary Textscited by 7
  14. 2020CompRes: A Dataset for Narrative Structure in Newscited by 3

Built on by

Cited by year

Citing papers per year: 2022: 2; 2023: 5; 2024: 2; 2025: 1.

10 papers.

  1. 2022Training language models to summarize narratives improves brain alignmentcited by 26
  2. 2023Personality Understanding of Fictional Characters during Book Readingcited by 20
  3. 2023Multi-level Contrastive Learning for Script-based Character Understandingcited by 15
  4. 2022MBTI Personality Prediction for Fictional Characters Using Movie Scriptscited by 14
  5. 2024Beyond Math: Stories as a Testbed for Memorization-Constrained Reasoning in LLMscited by 11
  6. 2023Plot Retrieval as an Assessment of Abstract Semantic Associationcited by 3
  7. 2024Previously on the Stories: Recap Snippet Identification for Story Readingcited by 3
  8. 2023Transferring Procedural Knowledge across Commonsense Taskscited by 2
  9. 2025Characterizing the Effects of Translation on Intertextuality using Multilingual Embedding Spacescited by 2
  10. 2023Whats New? Identifying the Unfolding of New Events in Narrativescited by 1