mlsanityData to 7 Oct 2026

Controlling Motion Transfer in Diffusion Transformers via Attention Heads

arXiv 2607.11081 ↗First posted 13 Jul 2026cs.CV cs.AIcited by 0

On the map: Diffusion models → Video generation

Abstract (arXiv)

Diffusion Transformers (DiTs) have advanced video generation with high-quality, temporally coherent results. However, extending them to motion transfer, which requires following reference motion while aligning with a target prompt, remains challenging due to limited understanding of motion and structure representations within DiTs. We analyze video DiTs at the attention-head level and identify distinct heads specialized for motion and spatial structure. Based on this insight, we propose a head-aware controllable motion transfer framework that requires no parameter updates. Our method refines motion cues from motion-specialized heads via semantic correspondence guidance and preserves structure through selective feature injection. This head-level control not only enables accurate motion transfer but also provides an interpretable foundation for controllable video generation with DiTs.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 48 of its 49 references that are in the map. First posted on arXiv 13 Jul 2026.

Builds on

48 of 49 references.

Closest ancestors · 21

Same direction, newest first

  1. 2025Emergent Temporal Correspondences from Video Diffusion Transformers20 Jun
  2. 2025RoPECraft: Training-Free Motion Transfer with Trajectory-Guided RoPE Optimization on Diffusion Transformers19 May
  3. 2025Understanding Attention Mechanism in Video Diffusion Models16 Apr
  4. 2025Decouple and Track: Benchmarking and Improving Video Diffusion Transformers for Motion Transfer21 Mar
  5. 2025Sparse VideoGen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsity3 Feb
  6. 2025Go-with-the-Flow: Motion-Controllable Video Diffusion Models Using Real-Time Warped Noise14 Jan
  7. 2024LTX-Video: Realtime Video Latent Diffusion30 Dec
  8. 2024DiTCtrl: Exploring Attention Control in Multi-Modal Diffusion Transformer for Tuning-Free Multi-Prompt Longer Video Generation24 Dec
  9. 2024Video Motion Transfer with Diffusion Transformers10 Dec
  10. 2024Motion by Queries: Identity-Motion Trade-offs in Text-to-Video Generation10 Dec
  11. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  12. 2024COVE: Unleashing the Diffusion Feature Correspondence for Consistent Video Editing13 Jun
9 more
  1. 2024Video Diffusion Models are Training-free Motion Interpreter and Controller23 May
  2. 2024Spectral Motion Alignment for Video Motion Transfer using Diffusion Models22 Mar
  3. 2024Lumiere: A Space-Time Diffusion Model for Video Generation23 Jan
  4. 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Models17 Jan
  5. 2023VMC: Video Motion Customization using Temporal Attention Adaption for Text-to-Video Diffusion Models1 Dec
  6. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
  7. 2023MotionDirector: Motion Customization of Text-to-Video Diffusion Models12 Oct
  8. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul
  9. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generators23 Mar

Other references · 27

  1. 2024GPT-4o System Cardcited by 4,467
  2. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  3. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  4. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
  5. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  6. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  7. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  8. 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
  9. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
  10. 2023Emergent Correspondence from Image Diffusioncited by 437
  11. 2018Animating Arbitrary Objects via Deep Motion Transfercited by 206
  12. 2023Make-Your-Video: Customized Video Generation Using Textual and Structural Guidancecited by 129
15 more
  1. 2023Space-Time Diffusion Features for Zero-Shot Text-Driven Motion Transfercited by 124
  2. 2023Unsupervised Semantic Correspondence Using Stable Diffusioncited by 120
  3. 2024Stable Flow: Vital Layers for Training-Free Image Editingcited by 111
  4. 2024MotionClone: Training-Free Motion Cloning for Controllable Video Generationcited by 104
  5. 2025Controllable Video Generation: A Surveycited by 93
  6. 2023GenTron: Diffusion Transformers for Image and Video Generationcited by 80
  7. 2025Your Large Vision-Language Model Only Needs A Few Attention Heads For Visual Groundingcited by 78
  8. 2021DiffPD: Differentiable Projective Dynamicscited by 62
  9. 2024VideoDirector: Precise Video Editing via Text-to-Video Modelscited by 36
  10. 2024Motion Inversion for Video Customizationcited by 30
  11. 2025Seg4Diff: Unveiling Open-Vocabulary Segmentation in Text-to-Image Diffusion Transformerscited by 24
  12. 2023Active Visual Exploration Based on Attention-Map Entropycited by 13
  13. 2025ConMo: Controllable Motion Disentanglement and Recomposition for Zero-Shot Motion Transfercited by 12
  14. 2025VFXMaster: Unlocking Dynamic Visual Effect Generation via In-Context Learningcited by 12
  15. 2022Spatial Entropy as an Inductive Bias for Vision Transformerscited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025MultiMotion: Multi Subject Video Motion Transfer via Video Diffusion Transformer
  2. 2025LMP: Leveraging Motion Prior in Zero-Shot Video Generation with Diffusion Transformer
  3. 2026MotionAdapter: Video Motion Transfer via Content-Aware Attention Customization
  4. 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuning
  5. 2026Making Time Editable in Video Diffusion Transformers
  6. 2026QWERTY: Training-Free Motion Control via Query-Warped Video Diffusion Transformers
  7. 2024MotionFlow: Attention-Driven Motion Transfer in Video Diffusion Models
  8. 2025DiTraj: training-free trajectory control for video diffusion transformer