mlsanityData to 14 Oct 2026

AgentMV: A State-Guided Multi-Agent Framework for Budget-Aware Music Video Generation

arXiv 2605.10723 ↗First posted 11 May 2026cs.CV cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Generating a complete music video from a song requires more than synthesizing visually plausible clips for individual lyric prompts. A practical system must maintain long-range visual consistency, coordinate recurring motifs, synchronize edits with musical structure, and manage the cumulative cost of video generation. Existing approaches typically generate segments independently or adopt fixed generation strategies, limiting their ability to perform global planning over an entire song. We present AgentMV, a state-guided multi-agent framework for budget-aware music video generation. AgentMV decomposes the production process into specialized agents for music perception, script planning, visual asset provision, segment realization, and final assembly, coordinated through a Structured Persistent State that enables information exchange and state tracking throughout the generation process. To optimize generation resources, we formulate motif-aware segment realization as a group-level Multiple-Choice Knapsack Problem solved via dynamic programming, considering segment importance, generation quality, cost, and motif reuse under a global budget constraint. Experiments on song benchmarks demonstrate that AgentMV improves quality-cost trade-offs over existing MV generation frameworks, highlighting the potential of state-guided multi-agent coordination and budget-aware planning for long-form music video generation with improved quality and efficiency.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 25 references that are in the map. First posted on arXiv 11 May 2026.

Builds on

21 of 25 references.

References · 21

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  2. 2024Qwen2.5 Technical Reportcited by 4,942
  3. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  4. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  5. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
  6. 2025Qwen3-Omni Technical Reportcited by 497
  7. 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 485
  8. 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 464
  9. 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 259
  10. 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 247
  11. 2024Data Interpreter: An LLM Agent For Data Sciencecited by 225
  12. 2017BlockDrop: Dynamic Inference Paths in Residual Networkscited by 189
9 more
  1. 2024Agent S: An Open Agentic Framework that Uses Computers Like a Humancited by 187
  2. 2023FreeNoise: Tuning-Free Longer Video Diffusion via Noise Reschedulingcited by 180
  3. 2024MDAgents: An Adaptive Collaboration of LLMs for Medical Decision-Makingcited by 163
  4. 2025Seedream 3.0 Technical Reportcited by 154
  5. 2023Gen-L-Video: Multi-Text to Long Video Generation via Temporal Co-Denoisingcited by 139
  6. 2024Adaptive Caching for Faster Video Generation with Diffusion Transformerscited by 108
  7. 2025SongFormer: Scaling Music Structure Analysis with Heterogeneous Supervisioncited by 16
  8. 2025AutoMV: An Automatic Multi-Agent System for Music Video Generationcited by 8
  9. 2022Music2Video: Automatic Generation of Music Video with fusion of audio and textcited by 3

Built on by

Not cited yet.