mlsanityData to 14 Oct 2026

MVAgent: Multi-Agent Video Generation via Consistent Condition Construction and Shot-Level Policy Optimization

arXiv 2609.30609 ↗First posted 24 Sep 2026cs.CVcited by 0

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Multi-shot agentic video generation requires consistent character appearance, stable spatial layout across camera angles, and continuous character state between shots. When every shot is a separate request to a frozen generator, repeated text does not determine appearance, layout or state. We therefore recast the problem as condition construction and present MVAgent, a multi-agent pipeline whose agents collaborate through typed conditioning inputs. Because an environment image shows one viewpoint, a Spatial Grounding agent samples views from generated camera-traversal clips and anchors each shot to the view matching its framing. As generated shots drift from the plan, an Observer records how each shot ends in a continuity memory, from which a Transition agent builds character action and spatial references for the next shot. An Orchestrator composes these inputs into each request. Since a request reveals its effect only after rendering, we train it by agentic reinforcement learning with Trunk-GDPO, which compares rendered candidates at every shot rather than once per video and continues the best as the trunk. With generator and judges frozen, MVAgent attains the highest cross-shot consistency and narrative-planning quality among the compared methods on ViMax-Bench and is preferred over the strongest agentic baseline in human evaluation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 23 of its 24 references that are in the map. First posted on arXiv 24 Sep 2026.

Builds on

23 of 24 references.

Closest ancestors · 4

Same direction, newest first

  1. 2026ViMax: Agentic Video Generation2 Jun
  2. 2026NEWTON: Agentic Planning for Physically Grounded Video Generation18 May
  3. 2025UniVA: Universal Video Agent towards Open-Source Next-Generation Video Generalist11 Nov
  4. 2025Automated Movie Generation via Multi-Agent CoT Planning10 Mar

Other references · 19

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2025Qwen3 Technical Reportcited by 8,820
  4. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
  5. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  6. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
  7. 2017The NarrativeQA Reading Comprehension Challengecited by 597
  8. 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 497
  9. 2025Group-in-Group Policy Optimization for LLM Agent Trainingcited by 497
  10. 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 341
  11. 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 247
  12. 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Surveycited by 205
7 more
  1. 2026GDPO: Group reward-Decoupled Normalization Policy Optimization for Multi-reward RL Optimizationcited by 193
  2. 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 158
  3. 2025In-the-Flow Agentic System Optimization for Effective Planning and Tool Usecited by 72
  4. 2024Asynchronous RLHF: Faster and More Efficient Off-Policy RL for Language Modelscited by 70
  5. 2025HoloCine: Holistic Generation of Cinematic Multi-Shot Long Video Narrativescited by 54
  6. 2025VISTA: A Test-Time Self-Improving Video Generation Agentcited by 31
  7. 2025AniMaker: Multi-Agent Animated Storytelling with MCTS-Driven Clip Generationcited by 19

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026VideoGen-Agent: Reinforcing Video Generation Agents
  2. 2026Camera Artist: A Multi-Agent Framework for Cinematic Language Storytelling Video Generation
  3. 2026Look Back to Move Forward: Learning to Revisit for Agentic Compositional Image Generation
  4. 2026GenAgent: Scaling Text-to-Image Generation via Agentic Multimodal Reasoning
  5. 2026VideoAgent: All-in-One Framework for Video Understanding and Editing
  6. 2026Beyond Trial-and-Error: Agentic Optimization for Image-to-Video Adherence
  7. 2026LynnReal-Omni: Native multi-modal Video Generation for Agentic Visual Workflows
  8. 2026SPIRAL: Self-Evolving Action-Conditioned Video Generation via Reflective Planning Agents