mlsanityData to 14 Oct 2026

LitVISTA: A Benchmark for Narrative Orchestration in Literary Text

arXiv 2601.06445 ↗First posted 10 Jan 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Computational narrative analysis aims to capture rhythm, tension, and emotional dynamics in literary texts. Existing large language models can generate long stories but overly focus on causal coherence, neglecting the complex story arcs and orchestration inherent in human narratives. This suggests a structural misalignment between model- and human-generated narratives. We therefore position narrative analysis as a diagnostic proxy for generation and propose VISTA Space, a high-dimensional framework for narrative orchestration that unifies human and model perspectives while jointly characterizing narrative function and structure in a common space. We further introduce LitVISTA, a structurally annotated benchmark grounded in literary texts, which operationalizes VISTA Space for systematic evaluation of models' narrative orchestration capabilities. Under an oracle setting with gold event anchors, we evaluate frontier LLMs including GPT, Claude, Grok, and Gemini. Results reveal systematic deficiencies, as current models struggle to jointly capture narrative function and structure and fail to form an integrated global view of literary narrative orchestration. End-to-end analysis further shows that failures are dominated by anchor identification and localization errors. Even advanced thinking modes yield mixed and often limited gains for literary narrative understanding.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 40 references that are in the map. First posted on arXiv 10 Jan 2026.

Builds on

9 of 40 references.

References · 9

  1. 2023MuSR: Testing the Limits of Chain-of-thought with Multistep Soft Reasoningcited by 201
  2. 2024Are Large Language Models Capable of Generating Human-Level Narratives?cited by 79
  3. 2019An Annotated Dataset of Coreference in English Literaturecited by 58
  4. 2025SCORE: Story Coherence and Retrieval Enhancement for AI Narrativescited by 42
  5. 2024Reading Subtext: Evaluating Large Language Models on Short Story Summarization with Writerscited by 19
  6. 2025StoryWriter: A Multi-Agent Framework for Long Story Generationcited by 19
  7. 2023LongStory: Coherent, Complete and Length Controlled Long story Generationcited by 12
  8. 2023Are NLP Models Good at Tracing Thoughts: An Overview of Narrative Understandingcited by 9
  9. 2023M-SENSE: Modeling Narrative Structure in Short Personal Narratives Using Protagonist's Mental Representationscited by 3

Built on by

Not cited yet.