mlsanityData to 14 Oct 2026

MotionAdapter: Video Motion Transfer via Content-Aware Attention Customization

arXiv 2601.01955 ↗First posted 5 Jan 2026cs.CVcited by 0

On the map: Diffusion models → Video generation

Abstract (arXiv)

Recent advances in diffusion-based text-to-video models, particularly those built on the diffusion transformer architecture, have achieved remarkable progress in generating high-quality and temporally coherent videos. However, transferring complex motions between videos remains challenging. In this work, we present MotionAdapter, a content-aware motion transfer framework that enables robust and semantically aligned motion transfer within DiT-based video diffusion models. Our key insight is that effective motion transfer requires 1) explicit disentanglement of motion from appearance and 2) adaptive customization of motion to target content. MotionAdapter first isolates motion by analyzing cross-frame attention within 3D full-attention modules to extract attention-derived motion fields. To bridge the semantic gap between reference and target videos, we further introduce a DINO-guided motion customization module that rearranges and refines motion fields based on content correspondences. The customized motion field is then used to guide the DiT denoising process, ensuring that the synthesized video inherits the reference motion while preserving target appearance and semantics. Extensive experiments demonstrate that MotionAdapter outperforms state-of-the-art methods in both qualitative and quantitative evaluations. Moreover, MotionAdapter naturely support complex motion transfer and motion editing tasks such as zooming in/out and composition.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 47 of its 52 references that are in the map. First posted on arXiv 5 Jan 2026.

Builds on

47 of 52 references.

Closest ancestors · 23

Same direction, newest first

  1. 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuning5 Jun
  2. 2025RoPECraft: Training-Free Motion Transfer with Trajectory-Guided RoPE Optimization on Diffusion Transformers19 May
  3. 2025VideoMage: Multi-Subject and Motion Customization of Text-to-Video Diffusion Models27 Mar
  4. 2025Decouple and Track: Benchmarking and Improving Video Diffusion Transformers for Motion Transfer21 Mar
  5. 2025Goku: Flow Based Video Generative Foundation Models7 Feb
  6. 2025MotionCanvas: Cinematic Shot Design with Controllable Image-to-Video Generation6 Feb
  7. 2025FreqPrior: Improving Video Diffusion Models with Frequency Filtering Gaussian Noise5 Feb
  8. 2024LTX-Video: Realtime Video Latent Diffusion30 Dec
  9. 2024Video Motion Transfer with Diffusion Transformers10 Dec
  10. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  11. 2024FreeLong: Training-Free Long Video Generation with SpectralBlend Temporal Attention29 Jul
  12. 2024FreeTraj: Tuning-Free Trajectory Control in Video Diffusion Models24 Jun
11 more
  1. 2024Video Diffusion Models are Training-free Motion Interpreter and Controller23 May
  2. 2024Spectral Motion Alignment for Video Motion Transfer using Diffusion Models22 Mar
  3. 2024Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motion5 Feb
  4. 2024Lumiere: A Space-Time Diffusion Model for Video Generation23 Jan
  5. 2023TrailBlazer: Trajectory Control for Diffusion-Based Video Generation31 Dec
  6. 2023FreeInit: Bridging Initialization Gap in Video Diffusion Models12 Dec
  7. 2023VMC: Video Motion Customization using Temporal Attention Adaption for Text-to-Video Diffusion Models1 Dec
  8. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
  9. 2023MotionDirector: Motion Customization of Text-to-Video Diffusion Models12 Oct
  10. 2023ModelScope Text-to-Video Technical Report12 Aug
  11. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models18 Apr

Other references · 24

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2020Denoising Diffusion Implicit Modelscited by 9,781
  5. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  6. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  7. 2022Scalable Diffusion Models with Transformerscited by 6,054
  8. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  9. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  10. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  11. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  12. 2025Qwen-Image Technical Reportcited by 1,044
12 more
  1. 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 957
  2. 2023CoTracker: It is Better to Track Togethercited by 522
  3. 2023Emergent Correspondence from Image Diffusioncited by 446
  4. 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 314
  5. 2023A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondencecited by 301
  6. 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 178
  7. 2023Space-Time Diffusion Features for Zero-Shot Text-Driven Motion Transfercited by 124
  8. 2024MotionClone: Training-Free Motion Cloning for Controllable Video Generationcited by 105
  9. 2024SG-I2V: Self-Guided Trajectory Control in Image-to-Video Generationcited by 68
  10. 2024MemFlow: Optical Flow Estimation and Prediction with Memorycited by 55
  11. 2024Follow-Your-Click: Open-domain Regional Image Animation via Short Promptscited by 52
  12. 2024Motion Inversion for Video Customizationcited by 30

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Separate Motion from Appearance: Customizing Motion via Customizing Text-to-Video Diffusion Models
  2. 2024MotionFlow: Attention-Driven Motion Transfer in Video Diffusion Models
  3. 2025MotionMatcher: Motion Customization of Text-to-Video Diffusion Models via Motion Feature Matching
  4. 2024Customize-A-Video: One-Shot Motion Customization of Text-to-Video Diffusion Models
  5. 2024Animate Your Motion: Turning Still Images into Dynamic Videos
  6. 2023MotionEditor: Editing Video Motion via Content-Aware Diffusion
  7. 2025MultiMotion: Multi Subject Video Motion Transfer via Video Diffusion Transformer
  8. 2023MotionCrafter: One-Shot Motion Customization of Diffusion Models