mlsanityData to 14 Oct 2026

MotionCoach: Constructing Multimodal Guidance for Video Professional Motion Editing

arXiv 2610.12963 ↗First posted 9 Oct 2026cs.CV cs.AI cs.MMcited by 0

Not on the map. Why?

Abstract (arXiv)

Video editing models achieve strong performance in modifying appearance, backgrounds, styles, and motions, empowered by large-scale training data. Beyond general scenarios, professional motions are significant in performance, sports, and martial arts. This paper focuses on professional motion editing, which involves fine-grained motion technique and temporal structure. Given professional motion names but lacking detailed descriptions, existing models often fail to generate professional motions, such as incorrectly lifting the front wheel under a Stoppie instruction. To address this challenge, we introduce MotionCoach, a trained multimodal agent that uses multi-turn tools and performs self-verification, producing a grounded prompt and a reference clip as reliable and sufficient multimodal guidance to inject external professional motion knowledge into video editing models. To supply training data, we build a data pipeline to construct trajectories. We cold-start the agent on MotionCoach-SFT-10k and apply Group Relative Policy Optimization (GRPO) on MotionCoach-RL-2k with rewards on the motion guidance prompt, the motion outcome video, and the format. For evaluation, we introduce VPMEBench, comprising 314 professional motion editing tasks with fine-grained references and annotations. Extensive experiments show that MotionCoach improves the overall score from 55.1 to 65.6 on Seedance 2.0 and from 51.2 to 64.5 on MiniMax-H3. Learning to construct multimodal guidance enables precise professional motion editing without retraining video editing models.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 43 references that are in the map. First posted on arXiv 9 Oct 2026.

Builds on

25 of 43 references.

References · 25

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  3. 2025Qwen3-VL Technical Reportcited by 2,793
  4. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
  5. 2025VACE: All-in-One Video Creation and Editingcited by 479
  6. 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
  7. 2025Automated Movie Generation via Multi-Agent CoT Planningcited by 89
  8. 2023Consistent Video-to-Video Transfer Using Synthetic Datasetcited by 81
  9. 2025Scaling Instruction-Based Video Editing with a High-Quality Synthetic Datasetcited by 79
  10. 2026Kiwi-Edit: Versatile Video Editing via Instruction and Reference Guidancecited by 36
  11. 2025JarvisEvo: Towards a Self-Evolving Photo Editing Agent with Synergistic Editor-Evaluator Optimizationcited by 31
  12. 2025IVEBench: Modern Benchmark Suite for Instruction-Guided Video Editing Assessmentcited by 28
13 more
  1. 2026GenAgent: Scaling Text-to-Image Generation via Agentic Multimodal Reasoningcited by 24
  2. 2026GEMS: Agent-Native Multimodal Generation with Memory and Skillscited by 21
  3. 2026Agent Banana: High-Fidelity Image Editing with Agentic Thinking and Toolingcited by 19
  4. 2026GenEvolve: Self-Evolving Image Generation Agents via Tool-Orchestrated Visual Experience Distillationcited by 19
  5. 2024VE-Bench: Subjective-Aligned Benchmark Suite for Text-Driven Video Editing Quality Assessmentcited by 11
  6. 2024EditBoard: Towards a Comprehensive Evaluation Benchmark for Text-Based Video Editing Modelscited by 11
  7. 2025TDVE-Assessor: Benchmarking and Evaluating the Quality of Text-Driven Video Editing with LMMscited by 11
  8. 2026RS-Gen: A Multi-Stage Agentic Framework for Reasoning and Search-Augmented Image Generationcited by 7
  9. 2026M3: High-fidelity Text-to-Image Generation via Multi-Modal, Multi-Agent and Multi-Round Visual Reasoningcited by 6
  10. 2026VideoAgent: All-in-One Framework for Video Understanding and Editingcited by 6
  11. 2026PhotoAgent: Exploratory Visual Aesthetic Planning with Large Vision Modelscited by 4
  12. 2026CoVEBench: Can Video Editing Models Handle Complex Instructions?cited by 3
  13. 2026WeAgent-MMGenEdit: A Full-Stack Recipe for Multimodal Agentic Image Generation and Editingcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Dynamic Motion Blending for Versatile Motion Editing
  2. 2025Point-to-Point: Sparse Motion Guidance for Controllable Video Editing
  3. 2024MotionFollower: Editing Video Motion via Lightweight Score-Guided Diffusion
  4. 2026VEBench:Benchmarking Large Multimodal Models for Real-World Video Editing
  5. 2025MotionV2V: Editing Motion in a Video
  6. 2024Instruction-based Image Manipulation by Watching How Things Move
  7. 2024MotionFix: Text-Driven 3D Human Motion Editing
  8. 2023MotionEditor: Editing Video Motion via Content-Aware Diffusion