CutClaw: Agentic Hours-Long Video Editing via Music Synchronization
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Editing the video content with audio alignment forms a digital human-made art in current social media. However, the time-consuming and repetitive nature of manual video editing has long been a challenge for filmmakers and professional content creators alike. In this paper, we introduce CutClaw, an autonomous multi-agent framework designed to edit hours-long raw footage into meaningful short videos that leverages the capabilities of multiple Multimodal Language Models~(MLLMs) as an agent system. It produces videos with synchronized music, followed by instructions, and a visually appealing appearance. In detail, our approach begins by employing a hierarchical multimodal decomposition that captures both fine-grained details and global structures across visual and audio footage. Then, to ensure narrative consistency, a Playwriter Agent orchestrates the whole storytelling flow and structures the long-term narrative, anchoring visual scenes to musical shifts. Finally, to construct a short edited video, Editor and Reviewer Agents collaboratively optimize the final cut via selecting fine-grained visual content based on rigorous aesthetic and semantic criteria. We conduct detailed experiments to demonstrate that CutClaw significantly outperforms state-of-the-art baselines in generating high-quality, rhythm-aligned videos. The code is available at: https://github.com/GVCLab/CutClaw.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 19 of its 28 references that are in the map. First posted on arXiv 31 Mar 2026.
Builds on
19 of 28 references.
Closest ancestors · 1
Same direction, newest first
Other references · 18
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2020Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillationcited by 591
- 2025Qwen3-Omni Technical Reportcited by 451
- 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Groundingcited by 138
- 2024TRACE: Temporal Grounding Video LLM via Causal Event Modelingcited by 87
- 2023Intelligent Grimm -- Open-ended Visual Storytelling via Latent Diffusion Modelscited by 76
- 2016madmom: a new Python Audio and Music Signal Processing Librarycited by 63
- 2019Less is More: Learning Highlight Detection from Video Durationcited by 60
- 2024TR-DETR: Task-Reciprocal Transformer for Joint Moment Retrieval and Highlight Detectioncited by 59
- 2021Cross-category Video Highlight Detection via Set-based Learningcited by 38
6 more
- 2024SnAG: Scalable and Accurate Video Groundingcited by 36
- 2025Paper2Video: Automatic Video Generation from Scientific Paperscited by 23
- 2025Text-to-Edit: Controllable End-to-End Video Ad Creation via Multimodal LLMscited by 6
- 2024Generative Timelines for Instructed Visual Assemblycited by 5
- 2024Agent-based Video Trimmingcited by 4
- 2025ESA: Energy-Based Shot Assembly Optimization for Automatic Video Editingcited by 2
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Sandboxed Coding Agents are Competitive Omni-modal Task Solverscited by 2
- 2026BEAT: Rhythm-Elastic Alignment for Agentic Music-guided Movie Trailer Generationcited by 1
- 2026Crayotter: Traceable Multi-Agent Workflows for Long-Form Video Editingcited by 1
- 2026Crayotter: Learning Long-Horizon Video Editing Agents via Group-Relative Preference Backpropagationcited by 1
- 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 0
- 2026Unified Agentic Video Editing Across Levels of Complexity and Creativitycited by 0
- 2026Unified Agentic Video Editing Across Levels of Complexity and Creativity11 Sep 2026
- 2026Agentic Visual Generation: From Generative Models to Agentic Control6 Sep 2026
- 2026Crayotter: Learning Long-Horizon Video Editing Agents via Group-Relative Preference Backpropagation3 Aug 2026
- 2026Crayotter: Traceable Multi-Agent Workflows for Long-Form Video Editing31 May 2026
- 2026Sandboxed Coding Agents are Competitive Omni-modal Task Solvers30 May 2026
- 2026BEAT: Rhythm-Elastic Alignment for Agentic Music-guided Movie Trailer Generation26 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026VideoAgent: All-in-One Framework for Video Understanding and Editing
- 2026GLANCE: A Global-Local Coordination Multi-Agent Framework for Music-Grounded Non-Linear Video Editing
- 2025Prompt-Driven Agentic Video Editing System: Autonomous Comprehension of Long-Form, Story-Driven Media
- 2026Beyond Coherence: Benchmarking Professional Editing-Technique Execution in Multi-Shot Audio-Video Generation
- 2026Camera Artist: A Multi-Agent Framework for Cinematic Language Storytelling Video Generation
- 2026A Versatile Multimodal Agent for Multimedia Content Generation
- 2025AutoMV: An Automatic Multi-Agent System for Music Video Generation
- 2026Cutscene Agent: An LLM Agent Framework for Automated 3D Cutscene Generation