The Script is All You Need: An Agentic Framework for Long-Horizon Dialogue-to-Cinematic Video Generation
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Recent advances in video generation have produced models capable of synthesizing stunning visual content from simple text prompts. However, these models struggle to generate long-form, coherent narratives from high-level concepts like dialogue, revealing a ``semantic gap'' between a creative idea and its cinematic execution. To bridge this gap, we introduce a novel, end-to-end agentic framework for dialogue-to-cinematic-video generation. Central to our framework is ScripterAgent, a model trained to translate coarse dialogue into a fine-grained, executable cinematic script. To enable this, we construct ScriptBench, a new large-scale benchmark with rich multimodal context, annotated via an expert-guided pipeline. The generated script then guides DirectorAgent, which orchestrates state-of-the-art video models using a cross-scene continuous generation strategy to ensure long-horizon coherence. Our comprehensive evaluation, featuring an AI-powered CriticAgent and a new Visual-Script Alignment (VSA) metric, shows our framework significantly improves script faithfulness and temporal fidelity across all tested video models. Furthermore, our analysis uncovers a crucial trade-off in current SOTA models between visual spectacle and strict script adherence, providing valuable insights for the future of automated filmmaking.
Key facts. Cited by 8 papers in the map (data through 13 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 33 of its 40 references that are in the map. First posted on arXiv 25 Jan 2026.
Builds on
33 of 40 references.
Closest ancestors · 1
Same direction, newest first
Other references · 32
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,091
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,610
- 2022Emergent Abilities of Large Language Modelscited by 2,499
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,775
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,768
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,732
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,467
- 2022MaskGIT: Masked Generative Image Transformercited by 1,090
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 975
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 871
- 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 667
20 more
- 2023Muse: Text-To-Image Generation via Masked Generative Transformerscited by 641
- 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 482
- 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 477
- 2022Latent Video Diffusion Models for High-Fidelity Long Video Generationcited by 386
- 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 241
- 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 221
- 2024Vidu: a Highly Consistent, Dynamic and Skilled Text-to-Video Generator with Diffusion Modelscited by 160
- 2025HunyuanVideo 1.5 Technical Reportcited by 152
- 2023VideoDirectorGPT: Consistent Multi-scene Video Generation via LLM-Guided Planningcited by 139
- 2018StoryGAN: A Sequential Conditional GAN for Story Visualizationcited by 137
- 2025Seedance 1.5 pro: A Native Audio-Visual Joint Generation Foundation Modelcited by 74
- 2024SEED-Story: Multimodal Long Story Generation with Large Language Modelcited by 70
- 2024Magic-Me: Identity-Specific Video Customized Diffusioncited by 59
- 2024Anim-Director: A Large Multimodal Model Powered Agent for Controllable Animation Video Generationcited by 35
- 2025FilMaster: Bridging Cinematic Principles and Generative AI for Automated Film Generationcited by 28
- 2025MathSmith: Towards Extremely Hard Mathematical Reasoning by Forging Synthetic Problems with a Reinforced Policycited by 24
- 2024MoPS: Modular Story Premise Synthesis for Open-Ended Automatic Story Generationcited by 13
- 2022CHAE: Fine-Grained Controllable Story Generation with Characters, Actions and Emotionscited by 6
- 2025LexSemBridge: Fine-Grained Dense Representation Enhancement through Token-Aware Embedding Augmentationcited by 5
- 2025TRACE: Evaluating Execution Efficiency of LLM-Based Code Translationcited by 3
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026One Sentence, One Drama: Personalized Short-Form Drama Generation via Multi-Agent Systemscited by 6
- 2026VideoWeaver: Evaluating and Evolving Skills for Agentic Long Video Generationcited by 5
- 2026MTAVG-Bench 2.0: Diagnosing Failure Modes of Cinematic Expressiveness in Multi-Talker Audio-Video Generationcited by 4
- 2026Co-Director: Agentic Generative Video Storytellingcited by 3
- 2026FilmWorld: Agentic Novel-to-Film Generation through Dynamic Cinematic World Modelingcited by 2
- 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 1
- 2026CineForge: Self-Improving Agents for Long-Horizon Video Generationcited by 0
- 2026VideoGen-Agent: Reinforcing Video Generation Agentscited by 0
- 2026VideoGen-Agent: Reinforcing Video Generation Agents21 Sep 2026
- 2026Agentic Visual Generation: From Generative Models to Agentic Control6 Sep 2026
- 2026CineForge: Self-Improving Agents for Long-Horizon Video Generation30 Aug 2026
- 2026FilmWorld: Agentic Novel-to-Film Generation through Dynamic Cinematic World Modeling21 Jul 2026
- 2026VideoWeaver: Evaluating and Evolving Skills for Agentic Long Video Generation6 Jun 2026
- 2026MTAVG-Bench 2.0: Diagnosing Failure Modes of Cinematic Expressiveness in Multi-Talker Audio-Video Generation27 May 2026
- 2026One Sentence, One Drama: Personalized Short-Form Drama Generation via Multi-Agent Systems21 May 2026
- 2026Co-Director: Agentic Generative Video Storytelling27 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026Camera Artist: A Multi-Agent Framework for Cinematic Language Storytelling Video Generation
- 2026CamPilot: A Multi-Agent Cinematic Assistant for Camera-Controlled Movie Generation
- 2026OmniScript: Towards Audio-Visual Script Generation for Long-Form Cinematic Video
- 2026ViMax: Agentic Video Generation
- 2025Captain Cinema: Towards Short Movie Generation
- 2024Dialogue Director: Bridging the Gap in Dialogue Visualization for Multimodal Storytelling
- 2026DirectorBench: Diagnosing Long-Form Video Generation with Personalized Multi-Agent Evaluation
- 2025Prompt-Driven Agentic Video Editing System: Autonomous Comprehension of Long-Form, Story-Driven Media