FilmWorld: Agentic Novel-to-Film Generation through Dynamic Cinematic World Modeling
On the map: World models → Video-generation world models and simulators
also in 1 more
Abstract (arXiv)
Translating novels into films poses a grand challenge for generative artificial intelligence, requiring conversion of abstract literary prose into long-form, multi-scene visual narratives. While current video generation models excel at short, single-scene clips within narrow temporal and spatial contexts, novel-to-film generation operates in a more complex regime, demanding long-duration content across diverse scenes with dynamically evolving entity states. To address this, we formalize novel-to-film generation as dynamic cinematic world modeling, decomposed into two phases: construction, which grounds abstract, underspecified literary narratives into concrete, stateful, and persistent world entities; and evolution, which governs how these entities dynamically update under plot progression to maintain causal consistency across scenes. We propose FilmWorld, an end-to-end agentic system where two groups of specialized agents collaborate to instantiate these phases. Construction-side agents perform narrative structured translation, world entity state modeling with visual anchoring, and state-driven shot planning, progressively projecting literary language into a cinematic blueprint. Evolution-side agents perform state-anchored visual generation, cross-shot dynamic state propagation, and closed-loop state verification to maintain causal consistency and visual coherence. To address the evaluation gap in long-form generation, we introduce FilmEval, a systematic evaluation framework that couples a difficulty-graded benchmark of 15 representative novels with an automated protocol of nine objective metrics spanning three dimensions: cinematic presentation, film consistency, and novel fidelity. Experiments demonstrate that FilmWorld consistently outperforms state-of-the-art video generation agent systems, with particularly pronounced improvements in narrative fidelity and cross-scene consistency.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 45 of its 53 references that are in the map. First posted on arXiv 21 Jul 2026.
Builds on
45 of 53 references.
Closest ancestors · 3
Same direction, newest first
- 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
- 2024WorldSimBench: Towards Video Generation Models as World Simulators23 Oct
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
Other references · 42
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 484
- 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 247
- 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 229
- 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generationcited by 192
- 2023VideoDirectorGPT: Consistent Multi-scene Video Generation via LLM-Guided Planningcited by 141
- 2018StoryGAN: A Sequential Conditional GAN for Story Visualizationcited by 138
- 2024Large Multimodal Agents: A Surveycited by 105
- 2025Automated Movie Generation via Multi-Agent CoT Planningcited by 89
- 2022StoryDALL-E: Adapting Pretrained Text-to-Image Transformers for Story Continuationcited by 74
- 2023TaleCrafter: Interactive Story Visualization with Multiple Characterscited by 73
- 2024VideoStudio: Generating Consistent-Content and Multi-Scene Videoscited by 64
30 more
- 2025HoloCine: Holistic Generation of Cinematic Multi-Shot Long Video Narrativescited by 54
- 2025StoryMem: Multi-shot Long Video Storytelling with Memorycited by 40
- 2025ShotAdapter: Text-to-Multi-Shot Video Generation with Diffusion Modelscited by 38
- 2024MovieBench: A Hierarchical Movie Level Dataset for Long Video Generationcited by 36
- 2025VideoGen-of-Thought: Step-by-step generating multi-shot video with minimal manual interventioncited by 36
- 2025OneStory: Coherent Multi-Shot Video Generation with Adaptive Memorycited by 35
- 2026Rolling Sink: Bridging Limited-Horizon Training and Open-Ended Testing in Autoregressive Video Diffusioncited by 32
- 2024StoryAgent: Customized Storytelling Video Generation via Multi-Agent Collaborationcited by 31
- 2025VISTA: A Test-Time Self-Improving Video Generation Agentcited by 31
- 2025VABench: A Comprehensive Benchmark for Audio-Video Generationcited by 30
- 2025FilMaster: Bridging Cinematic Principles and Generative AI for Automated Film Generationcited by 28
- 2025MM-StoryAgent: Immersive Narrated Storybook Video Generation with a Multi-Agent Paradigm across Text, Image and Audiocited by 27
- 2023StoryGPT-V: Large Language Models as Consistent Story Visualizerscited by 25
- 2026VideoMemory: Toward Consistent Video Generation via Memory Integrationcited by 25
- 2025STAGE: Storyboard-Anchored Generation for Cinematic Multi-shot Narrativecited by 23
- 2025MAViS: A Multi-Agent Framework for Long-Sequence Video Storytellingcited by 21
- 2026ViMax: Agentic Video Generationcited by 12
- 2025FilmWeaver: Weaving Consistent Multi-Shot Videos with Cache-Guided Autoregressive Diffusioncited by 10
- 2026MSAVBench: Towards Comprehensive and Reliable Evaluation of Multi-Shot Audio-Video Generationcited by 10
- 2026The Script is All You Need: An Agentic Framework for Long-Horizon Dialogue-to-Cinematic Video Generationcited by 8
- 2025AniME: Adaptive Multi-Agent Planning for Long Animation Generationcited by 7
- 2026InfinityStory: Unlimited Video Generation with World Consistency and Character-Aware Shot Transitionscited by 7
- 2025A Survey on Long-Video Storytelling Generation: Architectures, Consistency, and Cinematic Qualitycited by 6
- 2026One Sentence, One Drama: Personalized Short-Form Drama Generation via Multi-Agent Systemscited by 6
- 2026ReCA: Multi-Shot Long Video Extrapolation via Recursive Context Allocationcited by 6
- 2026MUSE: A Multi-agent Framework for Unconstrained Story Envisioning via Closed-Loop Cognitive Orchestrationcited by 5
- 2026EvalVerse: Pipeline-Aware and Expert-Calibrated Benchmarking for Professional Cinematic Video Generationcited by 5
- 2026Co-Director: Agentic Generative Video Storytellingcited by 3
- 2026EM-Vid: Training-Free Entity-Centric Memory for Efficient and Consistent Multi-Shot Video Generationcited by 3
- 2026Narrative Weaver: Towards Controllable Long-Range Visual Consistency with Multi-Modal Conditioningcited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Camera Artist: A Multi-Agent Framework for Cinematic Language Storytelling Video Generation
- 2026StoryEngine: A State-Grounded Agentic Framework for Video Storytelling
- 2025Captain Cinema: Towards Short Movie Generation
- 2024MovieDreamer: Hierarchical Generation for Coherent Long Visual Sequence
- 2026CamPilot: A Multi-Agent Cinematic Assistant for Camera-Controlled Movie Generation
- 2026CineForge: Self-Improving Agents for Long-Horizon Video Generation
- 2026SimWorlds: A Multi-Agent System for Dynamic 3D Scene Creation
- 2026Authoring for Living Worlds: Tool-Constrained LLM Agents for Executable Multi-Actor Scenarios