mlsanityData to 7 Oct 2026

MotionShop: Zero-Shot Motion Transfer in Video Diffusion Models with Mixture of Score Guidance

arXiv 2412.05355 ↗First posted 6 Dec 2024cs.CV cs.AIcited by 13

On the map: Diffusion models → Video generation

Abstract (arXiv)

In this work, we propose the first motion transfer approach in diffusion transformer through Mixture of Score Guidance (MSG), a theoretically-grounded framework for motion transfer in diffusion models. Our key theoretical contribution lies in reformulating conditional score to decompose motion score and content score in diffusion models. By formulating motion transfer as a mixture of potential energies, MSG naturally preserves scene composition and enables creative scene transformations while maintaining the integrity of transferred motion patterns. This novel sampling operates directly on pre-trained video diffusion models without additional training or fine-tuning. Through extensive experiments, MSG demonstrates successful handling of diverse scenarios including single object, multiple objects, and cross-object motion transfer as well as complex camera motion transfer. Additionally, we introduce MotionBench, the first motion transfer dataset consisting of 200 source videos and 1000 transferred motions, covering single/multi-object transfers, and complex camera motions.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 24 of its 40 references that are in the map. First posted on arXiv 6 Dec 2024.

Builds on

24 of 40 references.

Closest ancestors · 15

Same direction, newest first

  1. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  2. 2024Efficient Video Diffusion Models via Content-Frame Motion-Latent Decomposition21 Mar
  3. 2024Animate Your Motion: Turning Still Images into Dynamic Videos15 Mar
  4. 2024Customize-A-Video: One-Shot Motion Customization of Text-to-Video Diffusion Models22 Feb
  5. 2024Latte: Latent Diffusion Transformer for Video Generation5 Jan
  6. 2023TrailBlazer: Trajectory Control for Diffusion-Based Video Generation31 Dec
  7. 2023MotionCrafter: One-Shot Motion Customization of Diffusion Models8 Dec
  8. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
  9. 2023LLM-grounded Video Diffusion Models29 Sep
  10. 2023ModelScope Text-to-Video Technical Report12 Aug
  11. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul
  12. 2023Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translation13 Jun
3 more
  1. 2023ControlVideo: Training-free Controllable Text-to-Video Generation22 May
  2. 2023Motion-Conditioned Diffusion Model for Controllable Video Synthesis27 Apr
  3. 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editing16 Mar

Other references · 9

  1. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  2. 2022Classifier-Free Diffusion Guidancecited by 5,717
  3. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  4. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
  5. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 440
  6. 2023DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectorycited by 260
  7. 2023VideoDirectorGPT: Consistent Multi-scene Video Generation via LLM-Guided Planningcited by 138
  8. 2024Boximator: Generating Rich and Controllable Motions for Video Synthesiscited by 107
  9. 2024Motion Inversion for Video Customizationcited by 30

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 7; 2026: 6.

13 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2025Decouple and Track: Benchmarking and Improving Video Diffusion Transformers for Motion Transfer
  2. 2025LMP: Leveraging Motion Prior in Zero-Shot Video Generation with Diffusion Transformer
  3. 2026MotionGrounder: Grounded Multi-Object Motion Transfer via Diffusion Transformer
  4. 2026MotionAdapter: Video Motion Transfer via Content-Aware Attention Customization
  5. 2023Space-Time Diffusion Features for Zero-Shot Text-Driven Motion Transfer
  6. 2025EGVD: Event-Guided Video Diffusion Model for Physically Realistic Large-Motion Frame Interpolation
  7. 2025Taming Video Models for 3D and 4D Generation via Zero-Shot Camera Control
  8. 2024MotionFlow: Attention-Driven Motion Transfer in Video Diffusion Models