mlsanityData to 14 Oct 2026

EvolvTrip: Enhancing Literary Character Understanding with Temporal Theory-of-Mind Graphs

arXiv 2506.13641 ↗First posted 16 Jun 2025cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

A compelling portrayal of characters is essential to the success of narrative writing. For readers, appreciating a character's traits requires the ability to infer their evolving beliefs, desires, and intentions over the course of a complex storyline, a cognitive skill known as Theory-of-Mind (ToM). Performing ToM reasoning in prolonged narratives requires readers to integrate historical context with current narrative information, a task at which humans excel but Large Language Models (LLMs) often struggle. To systematically evaluate LLMs' ToM reasoning capability in long narratives, we construct LitCharToM, a benchmark of character-centric questions across four ToM dimensions from classic literature. Further, we introduce EvolvTrip, a perspective-aware temporal knowledge graph that tracks psychological development throughout narratives. Our experiments demonstrate that EvolvTrip consistently enhances performance of LLMs across varying scales, even in challenging extended-context scenarios. EvolvTrip proves to be particularly valuable for smaller models, partially bridging the performance gap with larger LLMs and showing great compatibility with lengthy narratives. Our findings highlight the importance of explicit representation of temporal character mental states in narrative comprehension and offer a foundation for more sophisticated character understanding. Our data and code are publicly available at https://github.com/Bernard-Yang/EvolvTrip.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 39 references that are in the map. First posted on arXiv 16 Jun 2025.

Builds on

21 of 39 references.

References · 21

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  3. 2017The NarrativeQA Reading Comprehension Challengecited by 597
  4. 2019COMET: Commonsense Transformers for Automatic Knowledge Graph Constructioncited by 450
  5. 2019Unmasking Clever Hans Predictors and Assessing What Machines Really Learncited by 365
  6. 2023Large Language Models Fail on Trivial Alterations to Theory-of-Mind Taskscited by 292
  7. 2023Understanding Social Reasoning in Language Models with Language Modelscited by 172
  8. 2023FANToM: A Benchmark for Stress-testing Machine Theory of Mind in Interactionscited by 171
  9. 2023Think Twice: Perspective-Taking Improves Large Language Models' Theory-of-Mind Capabilitiescited by 89
  10. 2018Event2Mind: Commonsense Inference on Events, Intents, and Reactionscited by 82
  11. 2022Fantastic Questions and Where to Find Them: FairytaleQA -- An Authentic Dataset for Narrative Comprehensioncited by 80
  12. 2018Evaluating Theory of Mind in Question Answeringcited by 64
9 more
  1. 2019An Annotated Dataset of Coreference in English Literaturecited by 58
  2. 2024OpenToM: A Comprehensive Benchmark for Evaluating Theory-of-Mind Reasoning Capabilities of Large Language Modelscited by 54
  3. 2021"Let Your Characters Tell Their Story": A Dataset for Character-Centric Narrative Understandingcited by 48
  4. 2020A Dataset for Tracking Entities in Open Domain Procedural Textcited by 37
  5. 2024Perceptions to Beliefs: Exploring Precursory Inferences for Theory of Mind in Large Language Modelscited by 22
  6. 2024TimeToM: Temporal Space is the Key to Unlocking the Door of Large Language Models' Theory-of-Mindcited by 21
  7. 2024A Notion of Complexity for Theory of Mind via Discrete World Modelscited by 16
  8. 2023OpenPI2.0: An Improved Dataset for Entity Tracking in Textscited by 8
  9. 2025EnigmaToM: Improve LLMs' Theory-of-Mind Reasoning Capabilities with Neural Knowledge Base of Entity Statescited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025The Essence of Contextual Understanding in Theory of Mind: A Study on Question Answering with Story Characters
  2. 2026Narrative World Model: Narratology-Grounded Writer Memory for Long-Form Fiction
  3. 2025Language Models Might Not Understand You: Evaluating Theory of Mind via Story Prompting
  4. 2023Are NLP Models Good at Tracing Thoughts: An Overview of Narrative Understanding
  5. 2025How LLMs Comprehend Temporal Meaning in Narratives: A Case Study in Cognitive Evaluation of LLMs
  6. 2024Are Large Language Models Capable of Generating Human-Level Narratives?
  7. 2025PRELUDE: A Benchmark Designed to Require Global Comprehension and Reasoning over Long Contexts
  8. 2023M-SENSE: Modeling Narrative Structure in Short Personal Narratives Using Protagonist's Mental Representations