DramaAgent: Agentic Storytelling Video Generation
Not on the map. Why?
Abstract (arXiv)
Recent diffusion and autoregressive models have substantially improved text-to-video generation, yet producing coherent long-form story videos with consistent characters and aligned audio remains challenging. Existing methods often suffer from narrative drift, unstable character identity, weak cross-scene continuity, and audio-visual mismatch over extended sequences. We propose DramaAgent, a hierarchical, agentic, and model-agnostic framework for long-form text-to-video-and-audio generation. Rather than improving the underlying video backbone itself, DramaAgent introduces an upper-level control layer that decomposes generation into story planning, persistent character conditioning, scene-wise synthesis, and reflection-guided targeted repair. The framework maintains reusable story and character states across scenes, diagnoses failures such as identity drift, missing scene semantics, temporal discontinuity, and cross-modal mismatch, and repairs problematic clips in a stage-specific manner. Experiments across multiple video generation backbones show that DramaAgent improves long-horizon coherence, character consistency, narrative fidelity, and scene-level audio-visual consistency over direct generation and strong baselines. These results suggest that hierarchical agentic control is a practical direction for controllable long-form audiovisual generation. Code: https://github.com/AIGeeksGroup/DramaAgent. Website: https://aigeeksgroup.github.io/DramaAgent.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 21 references that are in the map. First posted on arXiv 8 Sep 2026.
Builds on
18 of 21 references.
References · 18
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
- 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 651
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
- 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 479
- 2023I2VGen-XL: High-Quality Image-to-Video Synthesis via Cascaded Diffusion Modelscited by 343
- 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 240
- 2023SEINE: Short-to-Long Video Diffusion Model for Generative Transition and Predictioncited by 231
- 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 186
6 more
- 2025Automated Movie Generation via Multi-Agent CoT Planningcited by 82
- 2024VideoStudio: Generating Consistent-Content and Multi-Scene Videoscited by 62
- 2024Magic-Me: Identity-Specific Video Customized Diffusioncited by 58
- 2023MovieFactory: Automatic Movie Creation from Text using Large Generative Models for Language and Imagescited by 42
- 2023AutoStory: Generating Diverse Storytelling Images with Minimal Human Effortcited by 38
- 2024MovieBench: A Hierarchical Movie Level Dataset for Long Video Generationcited by 35
Built on by
Not cited yet.