GLANCE: A Global-Local Coordination Multi-Agent Framework for Music-Grounded Non-Linear Video Editing
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Music-grounded mashup video creation is a challenging form of video non-linear editing, where a system must compose a coherent timeline from large collections of source videos while aligning with music rhythm, user intent, story completeness, and long-range structural constraints. Existing approaches typically rely on fixed pipelines or simplified retrieval-and-concatenation paradigms, limiting their ability to adapt to diverse prompts and heterogeneous source materials. In this paper, we present GLANCE, a global-local coordination multi-agent framework for music-grounded nonlinear video editing. GLANCE adopts a bi-loop architecture for better editing practice: an outer loop performs long-horizon planning and task-graph construction, and an inner loop adopts the "Observe-Think-Act-Verify" flow for segment-wise editing tasks and their refinements. To address the cross-segment and global conflict emerging after subtimelines composition, we introduce a dedicated global-local coordination mechanism with both preventive and corrective components, which includes a novelly designed context controller, conflict region decomposition module, and a bottom-up dynamic negotiation mechanism. To support rigorous evaluation, we construct MVEBench, a new benchmark that factorizes editing difficulty along task type, prompt specificity, and music length, and propose an agent-as-a-judge evaluation framework for scalable multi-dimensional assessment. Experimental results show that GLANCE consistently outperforms prior research baselines and open-source product baselines under the same backbone models. With GPT-4o-mini as the backbone, GLANCE improves over the strongest baseline by 33.2% and 15.6% on two task settings, respectively. Human evaluation further confirms the quality of the generated videos and validates the effectiveness of the proposed evaluation framework.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 26 of its 45 references that are in the map. First posted on arXiv 6 Apr 2026.
Builds on
26 of 45 references.
Closest ancestors · 11
Same direction, newest first
- 2026GenAgent: Scaling Text-to-Image Generation via Agentic Multimodal Reasoning26 Jan
- 2025LongVideoAgent: Multi-Agent Reasoning with Long Videos23 Dec
- 2025Scaling Agentic Reinforcement Learning for Tool-Integrated Reasoning in VLMs24 Nov
- 2025EditDuet: A Multi-Agent System for Video Non-Linear Editing13 Sep
- 2025ReAgent-V: A Reward-Driven Multi-Agent Framework for Video Understanding2 Jun
- 2025Deep Video Discovery: Agentic Search with Tool Use for Long-form Video Understanding23 May
- 2025VideoAgent2: Enhancing the LLM-Based Agent System for Long-Form Video Understanding by Uncertainty-Aware CoT6 Apr
- 2024VCA: Video Curious Agent for Long Video Understanding12 Dec
- 2024GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editing8 Jul
- 2024VideoAgent: Long-form Video Understanding with Large Language Model as Agent15 Mar
- 2024VisionGPT: Vision-Language Understanding Agent Using Generalized Multimodal Framework14 Mar
Other references · 15
- 2023A Dynamic LLM-Powered Agent Network for Task-Oriented Agent Collaborationcited by 281
- 2024MMedAgent: Learning to Use Medical Tools with Multi-modal Agentcited by 108
- 2025OctoTools: An Agentic Framework with Extensible Tools for Complex Reasoningcited by 69
- 2025MMedAgent-RL: Optimizing Multi-Agent Collaboration for Multimodal Medical Reasoningcited by 37
- 2025Self-Improving LLM Agents at Test-Timecited by 30
- 2025Vgent: Graph-based Retrieval-Reasoning-Augmented Generation For Long Video Understandingcited by 30
- 2025StreamAgent: Towards Anticipatory Agents for Streaming Video Understandingcited by 29
- 2025ImAgent: A Unified Multimodal Agent Framework for Test-Time Scalable Image Generationcited by 14
- 2025Lotus: Creating Short Videos From Long Videos With Abstractive and Extractive Summarizationcited by 6
- 2025From Shots to Stories: LLM-Assisted Video Editing with Unified Language Representationscited by 6
- 2025From Long Videos to Engaging Clips: A Human-Inspired Video Editing Framework with Multimodal Narrative Understandingcited by 6
- 2025Shot Sequence Ordering for Video Editing: Benchmarks, Metrics, and Cinematology-Inspired Computing Methodscited by 5
3 more
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026CutClaw: Agentic Hours-Long Video Editing via Music Synchronization
- 2026VideoAgent: All-in-One Framework for Video Understanding and Editing
- 2025AutoMV: An Automatic Multi-Agent System for Music Video Generation
- 2026FRAMEWORKERS: A Dynamic Multi-Agent Framework for AI-Generated Video Production
- 2026Beyond Coherence: Benchmarking Professional Editing-Technique Execution in Multi-Shot Audio-Video Generation
- 2026AVE-Compass: Towards Holistic Evaluation for Audio-Video Editing Abilities
- 2025CoComposer: LLM Multi-agent Collaborative Music Composition
- 2026CutVerse: A Compositional GUI Agents Benchmark for Media Post-Production Editing