MotionShop: Zero-Shot Motion Transfer in Video Diffusion Models with Mixture of Score Guidance
On the map: Diffusion models → Video generation
Abstract (arXiv)
In this work, we propose the first motion transfer approach in diffusion transformer through Mixture of Score Guidance (MSG), a theoretically-grounded framework for motion transfer in diffusion models. Our key theoretical contribution lies in reformulating conditional score to decompose motion score and content score in diffusion models. By formulating motion transfer as a mixture of potential energies, MSG naturally preserves scene composition and enables creative scene transformations while maintaining the integrity of transferred motion patterns. This novel sampling operates directly on pre-trained video diffusion models without additional training or fine-tuning. Through extensive experiments, MSG demonstrates successful handling of diverse scenarios including single object, multiple objects, and cross-object motion transfer as well as complex camera motion transfer. Additionally, we introduce MotionBench, the first motion transfer dataset consisting of 200 source videos and 1000 transferred motions, covering single/multi-object transfers, and complex camera motions.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 24 of its 40 references that are in the map. First posted on arXiv 6 Dec 2024.
Builds on
24 of 40 references.
Closest ancestors · 15
Same direction, newest first
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2024Efficient Video Diffusion Models via Content-Frame Motion-Latent Decomposition21 Mar
- 2024Animate Your Motion: Turning Still Images into Dynamic Videos15 Mar
- 2024Customize-A-Video: One-Shot Motion Customization of Text-to-Video Diffusion Models22 Feb
- 2024Latte: Latent Diffusion Transformer for Video Generation5 Jan
- 2023TrailBlazer: Trajectory Control for Diffusion-Based Video Generation31 Dec
- 2023MotionCrafter: One-Shot Motion Customization of Diffusion Models8 Dec
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
- 2023LLM-grounded Video Diffusion Models29 Sep
- 2023ModelScope Text-to-Video Technical Report12 Aug
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul
- 2023Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translation13 Jun
3 more
Other references · 9
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 440
- 2023DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectorycited by 260
- 2023VideoDirectorGPT: Consistent Multi-scene Video Generation via LLM-Guided Planningcited by 138
- 2024Boximator: Generating Rich and Controllable Motions for Video Synthesiscited by 107
- 2024Motion Inversion for Video Customizationcited by 30
Built on by
Citing papers per year: 2025: 7; 2026: 6.
13 papers.
Sort:
By area:
- 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuningcited by 81
- 2026FastVMT: Eliminating Redundancy in Video Motion Transfercited by 23
- 2025LoRAShop: Training-Free Multi-Concept Image Generation and Editing with Rectified Flow Transformerscited by 12
- 2025Dynamic View Synthesis as an Inverse Problemcited by 12
- 2025SynMotion: Semantic-Visual Adaptation for Motion Customized Video Generationcited by 7
- 2025JointTuner: Appearance-Motion Adaptive Joint Training for Customized Video Generationcited by 5
- 2026DreamVideo-Omni: Omni-Motion Controlled Multi-Subject Video Customization with Latent Identity Reinforcement Learningcited by 4
- 2025MultiMotion: Multi Subject Video Motion Transfer via Video Diffusion Transformercited by 3
- 2025Towards Efficient Real-Time Video Motion Transfer via Generative Time Series Modelingcited by 2
- 2026FlowMotion: Training-Free Flow Guidance for Video Motion Transfercited by 1
- 2026DTG-Restore: Training-Free Diffusion Refinement for Generative Video Super-Resolutioncited by 0
- 2026QWERTY: Training-Free Motion Control via Query-Warped Video Diffusion Transformerscited by 0
- 2026Motion Beyond Morphology: Bootstrapping Cross-Category Motion Transfer from Abstract Motion Representations3 Aug 2026
- 2026QWERTY: Training-Free Motion Control via Query-Warped Video Diffusion Transformers2 Jul 2026
- 2026DTG-Restore: Training-Free Diffusion Refinement for Generative Video Super-Resolution28 May 2026
- 2026DreamVideo-Omni: Omni-Motion Controlled Multi-Subject Video Customization with Latent Identity Reinforcement Learning12 Mar 2026
- 2026FlowMotion: Training-Free Flow Guidance for Video Motion Transfer6 Mar 2026
- 2026FastVMT: Eliminating Redundancy in Video Motion Transfer5 Feb 2026
- 2025MultiMotion: Multi Subject Video Motion Transfer via Video Diffusion Transformer8 Dec 2025
- 2025SynMotion: Semantic-Visual Adaptation for Motion Customized Video Generation30 Jun 2025
- 2025Dynamic View Synthesis as an Inverse Problem9 Jun 2025
- 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuning5 Jun 2025
- 2025LoRAShop: Training-Free Multi-Concept Image Generation and Editing with Rectified Flow Transformers29 May 2025
- 2025Towards Efficient Real-Time Video Motion Transfer via Generative Time Series Modeling7 Apr 2025
- 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuningcited by 81
- 2025LoRAShop: Training-Free Multi-Concept Image Generation and Editing with Rectified Flow Transformerscited by 12
- 2025Dynamic View Synthesis as an Inverse Problemcited by 12
- 2025SynMotion: Semantic-Visual Adaptation for Motion Customized Video Generationcited by 7
- 2025JointTuner: Appearance-Motion Adaptive Joint Training for Customized Video Generationcited by 5
- 2026DreamVideo-Omni: Omni-Motion Controlled Multi-Subject Video Customization with Latent Identity Reinforcement Learningcited by 4
- 2025MultiMotion: Multi Subject Video Motion Transfer via Video Diffusion Transformercited by 3
- 2026DTG-Restore: Training-Free Diffusion Refinement for Generative Video Super-Resolutioncited by 0
- 2026QWERTY: Training-Free Motion Control via Query-Warped Video Diffusion Transformerscited by 0
- 2026QWERTY: Training-Free Motion Control via Query-Warped Video Diffusion Transformers2 Jul 2026
- 2026DTG-Restore: Training-Free Diffusion Refinement for Generative Video Super-Resolution28 May 2026
- 2026DreamVideo-Omni: Omni-Motion Controlled Multi-Subject Video Customization with Latent Identity Reinforcement Learning12 Mar 2026
- 2025MultiMotion: Multi Subject Video Motion Transfer via Video Diffusion Transformer8 Dec 2025
- 2025SynMotion: Semantic-Visual Adaptation for Motion Customized Video Generation30 Jun 2025
- 2025Dynamic View Synthesis as an Inverse Problem9 Jun 2025
- 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuning5 Jun 2025
- 2025LoRAShop: Training-Free Multi-Concept Image Generation and Editing with Rectified Flow Transformers29 May 2025
- 2025JointTuner: Appearance-Motion Adaptive Joint Training for Customized Video Generation31 Mar 2025
- 2026FastVMT: Eliminating Redundancy in Video Motion Transfercited by 23
- 2025Towards Efficient Real-Time Video Motion Transfer via Generative Time Series Modelingcited by 2
- 2026FlowMotion: Training-Free Flow Guidance for Video Motion Transfercited by 1
- 2026Motion Beyond Morphology: Bootstrapping Cross-Category Motion Transfer from Abstract Motion Representationscited by 0
- 2026Motion Beyond Morphology: Bootstrapping Cross-Category Motion Transfer from Abstract Motion Representations3 Aug 2026
- 2026FlowMotion: Training-Free Flow Guidance for Video Motion Transfer6 Mar 2026
- 2026FastVMT: Eliminating Redundancy in Video Motion Transfer5 Feb 2026
- 2025Towards Efficient Real-Time Video Motion Transfer via Generative Time Series Modeling7 Apr 2025
Similar, not cited
Close in wording, no citation either way
- 2025Decouple and Track: Benchmarking and Improving Video Diffusion Transformers for Motion Transfer
- 2025LMP: Leveraging Motion Prior in Zero-Shot Video Generation with Diffusion Transformer
- 2026MotionGrounder: Grounded Multi-Object Motion Transfer via Diffusion Transformer
- 2026MotionAdapter: Video Motion Transfer via Content-Aware Attention Customization
- 2023Space-Time Diffusion Features for Zero-Shot Text-Driven Motion Transfer
- 2025EGVD: Event-Guided Video Diffusion Model for Physically Realistic Large-Motion Frame Interpolation
- 2025Taming Video Models for 3D and 4D Generation via Zero-Shot Camera Control
- 2024MotionFlow: Attention-Driven Motion Transfer in Video Diffusion Models