mlsanityData to 7 Oct 2026

CutClaw: Agentic Hours-Long Video Editing via Music Synchronization

arXiv 2603.29664 ↗First posted 31 Mar 2026cs.CVcited by 6

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Editing the video content with audio alignment forms a digital human-made art in current social media. However, the time-consuming and repetitive nature of manual video editing has long been a challenge for filmmakers and professional content creators alike. In this paper, we introduce CutClaw, an autonomous multi-agent framework designed to edit hours-long raw footage into meaningful short videos that leverages the capabilities of multiple Multimodal Language Models~(MLLMs) as an agent system. It produces videos with synchronized music, followed by instructions, and a visually appealing appearance. In detail, our approach begins by employing a hierarchical multimodal decomposition that captures both fine-grained details and global structures across visual and audio footage. Then, to ensure narrative consistency, a Playwriter Agent orchestrates the whole storytelling flow and structures the long-term narrative, anchoring visual scenes to musical shifts. Finally, to construct a short edited video, Editor and Reviewer Agents collaboratively optimize the final cut via selecting fine-grained visual content based on rigorous aesthetic and semantic criteria. We conduct detailed experiments to demonstrate that CutClaw significantly outperforms state-of-the-art baselines in generating high-quality, rhythm-aligned videos. The code is available at: https://github.com/GVCLab/CutClaw.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 19 of its 28 references that are in the map. First posted on arXiv 31 Mar 2026.

Builds on

19 of 28 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025EditDuet: A Multi-Agent System for Video Non-Linear Editing13 Sep

Other references · 18

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  3. 2025Qwen3-VL Technical Reportcited by 2,534
  4. 2020Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillationcited by 591
  5. 2025Qwen3-Omni Technical Reportcited by 451
  6. 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Groundingcited by 138
  7. 2024TRACE: Temporal Grounding Video LLM via Causal Event Modelingcited by 87
  8. 2023Intelligent Grimm -- Open-ended Visual Storytelling via Latent Diffusion Modelscited by 76
  9. 2016madmom: a new Python Audio and Music Signal Processing Librarycited by 63
  10. 2019Less is More: Learning Highlight Detection from Video Durationcited by 60
  11. 2024TR-DETR: Task-Reciprocal Transformer for Joint Moment Retrieval and Highlight Detectioncited by 59
  12. 2021Cross-category Video Highlight Detection via Set-based Learningcited by 38
6 more
  1. 2024SnAG: Scalable and Accurate Video Groundingcited by 36
  2. 2025Paper2Video: Automatic Video Generation from Scientific Paperscited by 23
  3. 2025Text-to-Edit: Controllable End-to-End Video Ad Creation via Multimodal LLMscited by 6
  4. 2024Generative Timelines for Instructed Visual Assemblycited by 5
  5. 2024Agent-based Video Trimmingcited by 4
  6. 2025ESA: Energy-Based Shot Assembly Optimization for Automatic Video Editingcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026VideoAgent: All-in-One Framework for Video Understanding and Editing
  2. 2026GLANCE: A Global-Local Coordination Multi-Agent Framework for Music-Grounded Non-Linear Video Editing
  3. 2025Prompt-Driven Agentic Video Editing System: Autonomous Comprehension of Long-Form, Story-Driven Media
  4. 2026Beyond Coherence: Benchmarking Professional Editing-Technique Execution in Multi-Shot Audio-Video Generation
  5. 2026Camera Artist: A Multi-Agent Framework for Cinematic Language Storytelling Video Generation
  6. 2026A Versatile Multimodal Agent for Multimedia Content Generation
  7. 2025AutoMV: An Automatic Multi-Agent System for Music Video Generation
  8. 2026Cutscene Agent: An LLM Agent Framework for Automated 3D Cutscene Generation