mlsanityData to 7 Oct 2026

DramaAgent: Agentic Storytelling Video Generation

arXiv 2610.00097 ↗First posted 8 Sep 2026cs.CV cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent diffusion and autoregressive models have substantially improved text-to-video generation, yet producing coherent long-form story videos with consistent characters and aligned audio remains challenging. Existing methods often suffer from narrative drift, unstable character identity, weak cross-scene continuity, and audio-visual mismatch over extended sequences. We propose DramaAgent, a hierarchical, agentic, and model-agnostic framework for long-form text-to-video-and-audio generation. Rather than improving the underlying video backbone itself, DramaAgent introduces an upper-level control layer that decomposes generation into story planning, persistent character conditioning, scene-wise synthesis, and reflection-guided targeted repair. The framework maintains reusable story and character states across scenes, diagnoses failures such as identity drift, missing scene semantics, temporal discontinuity, and cross-modal mismatch, and repairs problematic clips in a stage-specific manner. Experiments across multiple video generation backbones show that DramaAgent improves long-horizon coherence, character consistency, narrative fidelity, and scene-level audio-visual consistency over direct generation and strong baselines. These results suggest that hierarchical agentic control is a practical direction for controllable long-form audiovisual generation. Code: https://github.com/AIGeeksGroup/DramaAgent. Website: https://aigeeksgroup.github.io/DramaAgent.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 21 references that are in the map. First posted on arXiv 8 Sep 2026.

Builds on

18 of 21 references.

References · 18

  1. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  2. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  3. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  4. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  5. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
  6. 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 651
  7. 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
  8. 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 479
  9. 2023I2VGen-XL: High-Quality Image-to-Video Synthesis via Cascaded Diffusion Modelscited by 343
  10. 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 240
  11. 2023SEINE: Short-to-Long Video Diffusion Model for Generative Transition and Predictioncited by 231
  12. 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 186
6 more
  1. 2025Automated Movie Generation via Multi-Agent CoT Planningcited by 82
  2. 2024VideoStudio: Generating Consistent-Content and Multi-Scene Videoscited by 62
  3. 2024Magic-Me: Identity-Specific Video Customized Diffusioncited by 58
  4. 2023MovieFactory: Automatic Movie Creation from Text using Large Generative Models for Language and Imagescited by 42
  5. 2023AutoStory: Generating Diverse Storytelling Images with Minimal Human Effortcited by 38
  6. 2024MovieBench: A Hierarchical Movie Level Dataset for Long Video Generationcited by 35

Built on by

Not cited yet.