CoAgent: Collaborative Planning and Consistency Agent for Coherent Video Generation
Not on the map. Why?
Abstract (arXiv)
Maintaining narrative coherence and visual consistency remains a central challenge in open-domain video generation. Existing text-to-video models often treat each shot independently, resulting in identity drift, scene inconsistency, and unstable temporal structure. We propose CoAgent, a collaborative and closed-loop framework for coherent video generation that formulates the process as a plan-synthesize-verify pipeline. Given a user prompt, style reference, and pacing constraints, a Storyboard Planner decomposes the input into structured shot-level plans with explicit entities, spatial relations, and temporal cues. A Global Context Manager maintains entity-level memory to preserve appearance and identity consistency across shots. Each shot is then generated by a Synthesis Module under the guidance of a Visual Consistency Controller, while a Verifier Agent evaluates intermediate results using vision-language reasoning and triggers selective regeneration when inconsistencies are detected. Finally, a pacing-aware editor refines temporal rhythm and transitions to match the desired narrative flow. Extensive experiments demonstrate that CoAgent significantly improves coherence, visual consistency, and narrative quality in long-form video generation.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 32 of its 43 references that are in the map. First posted on arXiv 27 Dec 2025.
Builds on
32 of 43 references.
References · 32
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 436
- 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 328
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 315
- 2024VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generationcited by 197
- 2025Open-Sora 2.0: Training a Commercial-Level Video Generation Model in 200kcited by 163
- 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 158
- 2025Video World Models with Long-term Spatial Memorycited by 136
- 2023Self-correcting LLM-controlled Diffusion Modelscited by 113
20 more
- 2025CineMaster: A 3D-Aware and Controllable Framework for Cinematic Text-to-Video Generationcited by 74
- 2025CF-VLM:CounterFactual Vision-Language Fine-tuningcited by 59
- 2025GAM-Agent: Game-Theoretic and Uncertainty-Aware Collaboration for Complex Visual Reasoningcited by 58
- 2025HoloCine: Holistic Generation of Cinematic Multi-Shot Long Video Narrativescited by 54
- 2025KABB: Knowledge-Aware Bayesian Bandits for Dynamic Expert Coordination in Multi-Agent Systemscited by 37
- 2025MAT-Agent: Adaptive Multi-Agent Training Optimizationcited by 35
- 2025DrDiff: Dynamic Routing Diffusion with Hierarchical Attention for Breaking the Efficiency-Quality Trade-offcited by 34
- 2025MM-CoT:A Benchmark for Probing Visual Chain-of-Thought Reasoning in Multimodal Modelscited by 34
- 2023DepthSSC: Monocular 3D Semantic Scene Completion via Depth-Spatial Alignment and Voxel Adaptationcited by 32
- 2025VPO: Aligning Text-to-Video Generation Models with Prompt Optimizationcited by 30
- 2025Hybrid Token Compression for Vision-Language Modelscited by 20
- 2024GenMAC: Compositional Text-to-Video Generation with Multi-Agent Collaborationcited by 17
- 2025Story2Board: A Training-Free Approach for Expressive Storyboard Generationcited by 17
- 2024Kubrick: Multimodal Agent Collaborations for Synthetic Video Generationcited by 16
- 2025Top-Down Semantic Refinement for Image Captioningcited by 16
- 2025LLM-CAS: Dynamic Neuron Perturbation for Real-Time Hallucination Correctioncited by 15
- 2025RaCoT: Plug-and-Play Contrastive Example Generation Mechanism for Enhanced LLM Reasoning Reliabilitycited by 14
- 20253DAlign-DAER: Dynamic Attention Policy and Efficient Retrieval Strategy for Fine-grained 3D-Text Alignment at Scalecited by 12
- 2025FlashVLM: Text-Guided Visual Token Selection for Large Multimodal Modelscited by 11
- 2025Hollywood Town: Long-Video Generation via Cross-Modal Multi-Agent Orchestrationcited by 10
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026SPIRAL: Self-Evolving Action-Conditioned Video Generation via Reflective Planning Agentscited by 5
- 2026Soap2Soap: Long Cinematic Video Remaking via Multi-Agent Collaborationcited by 5
- 2026Bridging Creative Intent and Visual Quality: Creator-Driven Recurrent Video Generation with Agentic Feedback Loopscited by 1
- 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 1
- 2026Agentic Visual Generation: From Generative Models to Agentic Control6 Sep 2026
- 2026Bridging Creative Intent and Visual Quality: Creator-Driven Recurrent Video Generation with Agentic Feedback Loops17 Jun 2026
- 2026Soap2Soap: Long Cinematic Video Remaking via Multi-Agent Collaboration17 May 2026
- 2026SPIRAL: Self-Evolving Action-Conditioned Video Generation via Reflective Planning Agents9 Mar 2026