mlsanityData to 14 Oct 2026

KathaTrace: Diagnosing Semantic Trajectory Collapse in Generated Visual Narratives

arXiv 2607.01312 ↗First posted 1 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Visual narratives are central to storyboards, comics, children's media, and film previsualization, where viewers understand stories from images alone. Recent generators such as StoryDiffusion produce coherent sequences, but visual coherence does not guarantee that source-story transition meaning remains recoverable. Existing benchmarks assess visual quality, content faithfulness, and scene coherence, but miss a critical failure mode: storyboards where scenes appear visually coherent while the semantic link between scenes disappears. We introduce KathaTrace, a generator-agnostic protocol for diagnosing semantic trajectory collapse, defined as the loss of transition meaning needed to understand how one scene follows another. KathaTrace evaluates transitions under three evidence conditions: text-only, image-only, and text-plus-image, and filters ambiguous items. We contribute KathaBench-25K, with 5,000 narratives from classical collections including Aesop, Panchatantra, and Kathasaritasagara, 20,000 transitions, and 28,712 recoverability questions. We define Semantic Trajectory Gap, or STG, as text-only minus image-only recoverability, measuring transition meaning lost during visualization. Human validation yields Fleiss' kappa = 0.845. Experiments across state-of-the-art generators show substantial STG of 23.5 +/- 1.3. Semantic Compass, an actionability probe, uses KathaTrace signals for post-generation repair and improves storyboard selection.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 42 references that are in the map. First posted on arXiv 1 Jul 2026.

Builds on

15 of 42 references.

References · 15

  1. 2024GenAI-Bench: Evaluating and Improving Compositional Text-to-Visual Generationcited by 135
  2. 2025GenEval 2: Addressing Benchmark Drift in Text-to-Image Evaluationcited by 52
  3. 2025StoryMem: Multi-shot Long Video Storytelling with Memorycited by 40
  4. 2024StoryAgent: Customized Storytelling Video Generation via Multi-Agent Collaborationcited by 31
  5. 2025MM-StoryAgent: Immersive Narrated Storybook Video Generation with a Multi-Agent Paradigm across Text, Image and Audiocited by 27
  6. 2026VideoMemory: Toward Consistent Video Generation via Memory Integrationcited by 25
  7. 2025Story2Board: A Training-Free Approach for Expressive Storyboard Generationcited by 17
  8. 2026MSVBench: Towards Human-Level Evaluation of Multi-Shot Video Generationcited by 12
  9. 2026MuSS: A Large-Scale Dataset and Cinematic Narrative Benchmark for Multi-Shot Subject-to-Video Generationcited by 9
  10. 2026InfinityStory: Unlimited Video Generation with World Consistency and Character-Aware Shot Transitionscited by 7
  11. 2025ViStoryBench: Comprehensive Benchmark Suite for Story Visualizationcited by 5
  12. 2024Openstory++: A Large-scale Dataset and Benchmark for Instance-aware Open-domain Visual Storytellingcited by 4
3 more
  1. 2026LogiStory: A Logic-Aware Framework for Multi-Image Story Visualizationcited by 2
  2. 2026ReDiStory: Region-Disentangled Diffusion for Consistent Visual Story Generationcited by 1
  3. 2026AttriStory: Fine-grained Attribute Realization for Visual Storytelling with Diffusion Modelscited by 1

Built on by

Not cited yet.