mlsanityData to 14 Oct 2026

Are NLP Models Good at Tracing Thoughts: An Overview of Narrative Understanding

arXiv 2310.18783 ↗First posted 28 Oct 2023cs.CLcited by 9

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Narrative understanding involves capturing the author's cognitive processes, providing insights into their knowledge, intentions, beliefs, and desires. Although large language models (LLMs) excel in generating grammatically coherent text, their ability to comprehend the author's thoughts remains uncertain. This limitation hinders the practical applications of narrative understanding. In this paper, we conduct a comprehensive survey of narrative understanding tasks, thoroughly examining their key features, definitions, taxonomy, associated datasets, training objectives, evaluation metrics, and limitations. Furthermore, we explore the potential of expanding the capabilities of modularized LLMs to address novel narrative understanding tasks. By framing narrative understanding as the retrieval of the author's imaginative cues that outline the narrative structure, our study introduces a fresh perspective on enhancing narrative comprehension.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 18 of its 188 references that are in the map. First posted on arXiv 28 Oct 2023.

Builds on

18 of 188 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023PaLM 2 Technical Report17 May
  2. 2023Dissociating language and thought in large language models16 Jan

Other references · 16

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  3. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
  4. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
  5. 2016SPICE: Semantic Propositional Image Caption Evaluationcited by 824
  6. 2023GPTScore: Evaluate as You Desirecited by 361
  7. 2022ScienceWorld: Is your Agent Smarter than a 5th Grader?cited by 327
  8. 2018TextWorld: A Learning Environment for Text-based Gamescited by 310
  9. 2022Towards a Unified Multi-Dimensional Evaluator for Text Generationcited by 264
  10. 2023Evaluating Large Language Models in Theory of Mind Taskscited by 222
  11. 2018WikiHow: A Large Scale Text Summarization Datasetcited by 204
  12. 2015The Goldilocks Principle: Reading Children's Books with Explicit Memory Representationscited by 108
4 more
  1. 2022Adapting Pretrained Text-to-Text Models for Long Text Sequencescited by 21
  2. 2016Embracing data abundance: BookTest Dataset for Reading Comprehensioncited by 15
  3. 2019The Shmoop Corpus: A Dataset of Stories with Loosely Aligned Summariescited by 8
  4. 2023AbLit: A Resource for Analyzing and Generating Abridged Versions of English Literaturecited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 3; 2025: 1; 2026: 5.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025How LLMs Comprehend Temporal Meaning in Narratives: A Case Study in Cognitive Evaluation of LLMs
  2. 2025EvolvTrip: Enhancing Literary Character Understanding with Temporal Theory-of-Mind Graphs
  3. 2023M-SENSE: Modeling Narrative Structure in Short Personal Narratives Using Protagonist's Mental Representations
  4. 2026SwanNLP at SemEval-2026 Task 5: An LLM-based Framework for Plausibility Scoring in Narrative Word Sense Disambiguation
  5. 2024Are Large Language Models Capable of Generating Human-Level Narratives?
  6. 2026Language Models Have Interpretable Narrative Mechanisms
  7. 2026Narrative World Model: Narratology-Grounded Writer Memory for Long-Form Fiction
  8. 2022Training language models to summarize narratives improves brain alignment