mlsanityData to 13 Oct 2026

The Script is All You Need: An Agentic Framework for Long-Horizon Dialogue-to-Cinematic Video Generation

arXiv 2601.17737 ↗First posted 25 Jan 2026cs.CV cs.AIcited by 8

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Recent advances in video generation have produced models capable of synthesizing stunning visual content from simple text prompts. However, these models struggle to generate long-form, coherent narratives from high-level concepts like dialogue, revealing a ``semantic gap'' between a creative idea and its cinematic execution. To bridge this gap, we introduce a novel, end-to-end agentic framework for dialogue-to-cinematic-video generation. Central to our framework is ScripterAgent, a model trained to translate coarse dialogue into a fine-grained, executable cinematic script. To enable this, we construct ScriptBench, a new large-scale benchmark with rich multimodal context, annotated via an expert-guided pipeline. The generated script then guides DirectorAgent, which orchestrates state-of-the-art video models using a cross-scene continuous generation strategy to ensure long-horizon coherence. Our comprehensive evaluation, featuring an AI-powered CriticAgent and a new Visual-Script Alignment (VSA) metric, shows our framework significantly improves script faithfulness and temporal fidelity across all tested video models. Furthermore, our analysis uncovers a crucial trade-off in current SOTA models between visual spectacle and strict script adherence, providing valuable insights for the future of automated filmmaking.

Key facts. Cited by 8 papers in the map (data through 13 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 33 of its 40 references that are in the map. First posted on arXiv 25 Jan 2026.

Builds on

33 of 40 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Automated Movie Generation via Multi-Agent CoT Planning10 Mar

Other references · 32

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,091
  3. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,610
  4. 2022Emergent Abilities of Large Language Modelscited by 2,499
  5. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,775
  6. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,768
  7. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,732
  8. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,467
  9. 2022MaskGIT: Masked Generative Image Transformercited by 1,090
  10. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 975
  11. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 871
  12. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 667
20 more
  1. 2023Muse: Text-To-Image Generation via Masked Generative Transformerscited by 641
  2. 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 482
  3. 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 477
  4. 2022Latent Video Diffusion Models for High-Fidelity Long Video Generationcited by 386
  5. 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 241
  6. 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 221
  7. 2024Vidu: a Highly Consistent, Dynamic and Skilled Text-to-Video Generator with Diffusion Modelscited by 160
  8. 2025HunyuanVideo 1.5 Technical Reportcited by 152
  9. 2023VideoDirectorGPT: Consistent Multi-scene Video Generation via LLM-Guided Planningcited by 139
  10. 2018StoryGAN: A Sequential Conditional GAN for Story Visualizationcited by 137
  11. 2025Seedance 1.5 pro: A Native Audio-Visual Joint Generation Foundation Modelcited by 74
  12. 2024SEED-Story: Multimodal Long Story Generation with Large Language Modelcited by 70
  13. 2024Magic-Me: Identity-Specific Video Customized Diffusioncited by 59
  14. 2024Anim-Director: A Large Multimodal Model Powered Agent for Controllable Animation Video Generationcited by 35
  15. 2025FilMaster: Bridging Cinematic Principles and Generative AI for Automated Film Generationcited by 28
  16. 2025MathSmith: Towards Extremely Hard Mathematical Reasoning by Forging Synthetic Problems with a Reinforced Policycited by 24
  17. 2024MoPS: Modular Story Premise Synthesis for Open-Ended Automatic Story Generationcited by 13
  18. 2022CHAE: Fine-Grained Controllable Story Generation with Characters, Actions and Emotionscited by 6
  19. 2025LexSemBridge: Fine-Grained Dense Representation Enhancement through Token-Aware Embedding Augmentationcited by 5
  20. 2025TRACE: Evaluating Execution Efficiency of LLM-Based Code Translationcited by 3

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2026: 8.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Camera Artist: A Multi-Agent Framework for Cinematic Language Storytelling Video Generation
  2. 2026CamPilot: A Multi-Agent Cinematic Assistant for Camera-Controlled Movie Generation
  3. 2026OmniScript: Towards Audio-Visual Script Generation for Long-Form Cinematic Video
  4. 2026ViMax: Agentic Video Generation
  5. 2025Captain Cinema: Towards Short Movie Generation
  6. 2024Dialogue Director: Bridging the Gap in Dialogue Visualization for Multimodal Storytelling
  7. 2026DirectorBench: Diagnosing Long-Form Video Generation with Personalized Multi-Agent Evaluation
  8. 2025Prompt-Driven Agentic Video Editing System: Autonomous Comprehension of Long-Form, Story-Driven Media