mlsanityData to 14 Oct 2026

StoryEngine: A State-Grounded Agentic Framework for Video Storytelling

arXiv 2609.33627 ↗First posted 27 Sep 2026cs.CV cs.AIcited by 0

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Despite recent progress in agentic multi-shot video generation, producing coherent and consistent long-form stories remains challenging. Existing agentic pipelines typically rely on textual shot plans or previously generated pixels, yet lack an explicit mechanism for propagating the consequences of story events and maintaining the video world state across shots. As a result, missing visual details may be reconstructed inaccurately, while visual drift may propagate across subsequent shots, undermining both narrative coherence and visual consistency. To address these challenges, we propose StoryEngine, a state-grounded agentic framework for video storytelling. StoryEngine establishes a separation between authoritative semantic plans and unreliable visual observations. Specifically, StoryEngine maintains a structured representation of entity placement and story-relevant states, and propagates event-induced changes to define the intended start and end states of each shot. To visually realize these states, StoryEngine constructs canonical references for recurring entities and environments, and compiles state and visual constraints into executable render plans. Meanwhile, to realize these states correctly, a bounded evaluation-guided repair loop further corrects local state inconsistencies. Together, these mechanisms preserve causal story progression and prevent local visual errors from propagating across shots. To comprehensively evaluate long-form storytelling, we construct a benchmark across diverse scenarios and visual styles, with metrics assessing storytelling quality, narrative coherence, and visual consistency. Experimental results demonstrate that StoryEngine consistently outperforms state-of-the-art methods across all evaluation dimensions, validating its effectiveness for coherent and consistent video storytelling.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 17 of its 24 references that are in the map. First posted on arXiv 27 Sep 2026.

Builds on

17 of 24 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026A2RD: Agentic Autoregressive Diffusion for Long Video Consistency7 May
  2. 2025Automated Movie Generation via Multi-Agent CoT Planning10 Mar

Other references · 15

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  2. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  3. 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,161
  4. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  5. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  6. 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 259
  7. 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 247
  8. 2019MAGSAC++, a fast, reliable and accurate robust estimatorcited by 161
  9. 2025Long Context Tuning for Video Generationcited by 113
  10. 2021Sample and Computation Redistribution for Efficient Face Detectioncited by 89
  11. 2025ShotAdapter: Text-to-Multi-Shot Video Generation with Diffusion Modelscited by 38
  12. 2024StoryAgent: Customized Storytelling Video Generation via Multi-Agent Collaborationcited by 31
3 more
  1. 2024Video-Infinity: Distributed Long Video Generationcited by 30
  2. 2025STAGE: Storyboard-Anchored Generation for Cinematic Multi-shot Narrativecited by 23
  3. 2025Minute-Long Videos with Dual Parallelismscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026ViMax: Agentic Video Generation
  2. 2026Camera Artist: A Multi-Agent Framework for Cinematic Language Storytelling Video Generation
  3. 2026LogiStory: A Logic-Aware Framework for Multi-Image Story Visualization
  4. 2026FilmWorld: Agentic Novel-to-Film Generation through Dynamic Cinematic World Modeling
  5. 2026CANVAS: Continuity-Aware Narratives via Visual Agentic Storyboarding
  6. 2026CineForge: Self-Improving Agents for Long-Horizon Video Generation
  7. 2025StoryMem: Multi-shot Long Video Storytelling with Memory
  8. 2026DreamShot: Personalized Storyboard Synthesis with Video Diffusion Prior