mlsanityData to 7 Oct 2026

DreamFactory: Pioneering Multi-Scene Long Video Generation with a Multi-Agent Framework

arXiv 2408.11788 ↗First posted 21 Aug 2024cs.AI cs.CL cs.CVcited by 31

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Current video generation models excel at creating short, realistic clips, but struggle with longer, multi-scene videos. We introduce textttDreamFactory, an LLM-based framework that tackles this challenge. textttDreamFactory leverages multi-agent collaboration principles and a Key Frames Iteration Design Method to ensure consistency and style across long videos. It utilizes Chain of Thought (COT) to address uncertainties inherent in large language models. textttDreamFactory generates long, stylistically coherent, and complex videos. Evaluating these long-form videos presents a challenge. We propose novel metrics such as Cross-Scene Face Distance Score and Cross-Scene Style Consistency Score. To further research in this area, we contribute the Multi-Scene Videos Dataset containing over 150 human-rated videos.

Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 20 of its 31 references that are in the map. First posted on arXiv 21 Aug 2024.

Builds on

20 of 31 references.

References · 20

  1. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  3. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  4. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  5. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  6. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
  7. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  8. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,722
  9. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  10. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
  11. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
  12. 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 589
8 more
  1. 2024Executable Code Actions Elicit Better LLM Agentscited by 537
  2. 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 450
  3. 2022Latent Video Diffusion Models for High-Fidelity Long Video Generationcited by 385
  4. 2023Auto-GPT for Online Decision Making: Benchmarks and Additional Opinionscited by 250
  5. 2023OpenAGI: When LLM Meets Domain Expertscited by 196
  6. 2022Generating Long Videos of Dynamic Scenescited by 113
  7. 2023Reuse and Diffuse: Iterative Denoising for Text-to-Video Generationcited by 49
  8. 2024CodePori: Large-Scale System for Autonomous Software Development Using Multi-Agent Technologycited by 21

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 18; 2026: 10.

31 papers.

Sort:

By area:

  1. 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Timecited by 209
  2. 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Surveycited by 176
  3. 2025Frame Context Packing and Drift Prevention in Next-Frame-Prediction Video Diffusion Modelscited by 126
  4. 2025Mixture of Contexts for Long Video Generationcited by 90
  5. 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Modelscited by 89
  6. 2025Automated Movie Generation via Multi-Agent CoT Planningcited by 82
  7. 2025HoloCine: Holistic Generation of Cinematic Multi-Shot Long Video Narrativescited by 51
  8. 2025VideoGen-of-Thought: Step-by-step generating multi-shot video with minimal manual interventioncited by 33
  9. 2025OneStory: Coherent Multi-Shot Video Generation with Adaptive Memorycited by 31
  10. 2025CineTrans: Learning to Generate Videos with Cinematic Transitions via Masked Diffusion Modelscited by 26
  11. 2025Code2Video: A Code-centric Paradigm for Educational Video Generationcited by 23
  12. 2025MAViS: A Multi-Agent Framework for Long-Sequence Video Storytellingcited by 19
19 more
  1. 2025Simulating the Visual World with Artificial Intelligence: A Roadmapcited by 15
  2. 2024Video Is Worth a Thousand Images: Exploring the Latest Trends in Long Video Generationcited by 7
  3. 2025CML-Bench: A Framework for Evaluating and Enhancing LLM-Powered Movie Scripts Generationcited by 6
  4. 2025LoCoT2V-Bench: Benchmarking Long-Form and Complex Text-to-Video Generationcited by 6
  5. 2026EntityBench: Towards Entity-Consistent Long-Range Multi-Shot Video Generationcited by 6
  6. 2024MatchDiffusion: Training-free Generation of Match-cutscited by 5
  7. 2026CineDance: Towards Next-Generation Multi-Shot Long-Form Cinematic Audio-Video Generationcited by 5
  8. 2025PersonaVlog: Personalized Multimodal Vlog Generation with Multi-Agent Collaboration and Iterative Self-Correctioncited by 4
  9. 2025AMUSE: Audio-Visual Benchmark and Alignment Framework for Agentic Multi-Speaker Understandingcited by 4
  10. 2026Memento: Reconstruct to Remember for Consistent Long Video Generationcited by 4
  11. 2026GroundShot: Visually Consistent Multi-Shot Long Video Generation via Entity-Grounded Shot Schedulingcited by 4
  12. 2026StoryBlender: Inter-Shot Consistent and Editable 3D Storyboard with Spatial-temporal Dynamicscited by 3
  13. 2026TIE: Time Interval Encoding for Video Generation over Eventscited by 2
  14. 2026Better Call CineCrew: Consistent Ultra-Long Narrative-to-Film Generationcited by 2
  15. 2024VideoGen-of-Thought: Step-by-step generating multi-shot video with minimal manual interventioncited by 1
  16. 2025LumosFlow: Motion-Guided Long Video Generationcited by 1
  17. 2026Bridging Creative Intent and Visual Quality: Creator-Driven Recurrent Video Generation with Agentic Feedback Loopscited by 1
  18. 2026SlotMem: Character-Addressable Internal Memory for Narrative Long Video Generationcited by 1
  19. 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026DirectorBench: Diagnosing Long-Form Video Generation with Personalized Multi-Agent Evaluation
  2. 2026ViMax: Agentic Video Generation
  3. 2024Kubrick: Multimodal Agent Collaborations for Synthetic Video Generation
  4. 2026A2RD: Agentic Autoregressive Diffusion for Long Video Consistency
  5. 2025Captain Cinema: Towards Short Movie Generation
  6. 2025Video-Bench: Human-Aligned Video Generation Benchmark
  7. 2026Camera Artist: A Multi-Agent Framework for Cinematic Language Storytelling Video Generation
  8. 2024VideoStudio: Generating Consistent-Content and Multi-Scene Videos