MultiMotion: Multi Subject Video Motion Transfer via Video Diffusion Transformer
On the map: Diffusion models → Video generation
Abstract (arXiv)
Multi-object video motion transfer poses significant challenges for Diffusion Transformer (DiT) architectures due to inherent motion entanglement and lack of object-level control. We present MultiMotion, a novel unified framework that overcomes these limitations. Our core innovation is Maskaware Attention Motion Flow (AMF), which utilizes SAM2 masks to explicitly disentangle and control motion features for multiple objects within the DiT pipeline. Furthermore, we introduce RectPC, a high-order predictor-corrector solver for efficient and accurate sampling, particularly beneficial for multi-entity generation. To facilitate rigorous evaluation, we construct the first benchmark dataset specifically for DiT-based multi-object motion transfer. MultiMotion demonstrably achieves precise, semantically aligned, and temporally coherent motion transfer for multiple distinct objects, maintaining DiT's high quality and scalability. The code is in the supp.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 74 of its 106 references that are in the map. First posted on arXiv 8 Dec 2025.
Builds on
74 of 106 references.
Closest ancestors · 11
Same direction, newest first
- 2025ContextFlow: Training-Free Video Object Editing via Adaptive Context Enrichment22 Sep
- 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuning5 Jun
- 2025CustomVideoX: 3D Reference Attention Driven Dynamic Adaptation for Zero-Shot Customized Video Diffusion Transformers10 Feb
- 2025FramePainter: Endowing Interactive Image Editing with Video Diffusion Priors14 Jan
- 2024MotionShop: Zero-Shot Motion Transfer in Video Diffusion Models with Mixture of Score Guidance6 Dec
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2024COVE: Unleashing the Diffusion Feature Correspondence for Consistent Video Editing13 Jun
- 2024Video Diffusion Models are Training-free Motion Interpreter and Controller23 May
- 2024MotionMaster: Training-free Camera Motion Transfer For Video Generation24 Apr
- 2023MotionCrafter: One-Shot Motion Customization of Diffusion Models8 Dec
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul
Other references · 63
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
- 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Modelscited by 441
- 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 312
- 2022EDICT: Exact Diffusion Inversion via Coupled Transformationscited by 256
- 2022CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusioncited by 222
- 2024Taming Rectified Flow for Inversion and Editingcited by 200
38 more
- 2023Negative-prompt Inversion: Fast Image Inversion for Editing with Text-guided Diffusion Modelscited by 172
- 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 172
- 2023DDFM: Denoising Diffusion Model for Multi-Modality Image Fusioncited by 153
- 2023SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generationcited by 142
- 2023Make-Your-Video: Customized Video Generation Using Textual and Structural Guidancecited by 129
- 2023Space-Time Diffusion Features for Zero-Shot Text-Driven Motion Transfercited by 124
- 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformercited by 118
- 2018ComDefend: An Efficient Image Compression Model to Defend Adversarial Examplescited by 104
- 2023Advancing Pose-Guided Image Synthesis with Progressive Conditional Diffusion Modelscited by 104
- 2024MotionClone: Training-Free Motion Cloning for Controllable Video Generationcited by 104
- 2024DiT4Edit: Diffusion Transformer for Image Editingcited by 100
- 2022LAS-AT: Adversarial Training with Learnable Attack Strategycited by 94
- 2024RingID: Rethinking Tree-Ring Watermarking for Enhanced Multi-Key Identificationcited by 87
- 2023Beyond First-Order Tweedie: Solving Inverse Problems using Latent Diffusioncited by 78
- 2023MagicStick: Controllable Video Editing via Control Handle Transformationscited by 62
- 2023Uni-paint: A Unified Framework for Multimodal Image Inpainting with Pretrained Diffusion Modelcited by 60
- 2025CF-VLM:CounterFactual Vision-Language Fine-tuningcited by 57
- 2025GAM-Agent: Game-Theoretic and Uncertainty-Aware Collaboration for Complex Visual Reasoningcited by 56
- 2025HunyuanPortrait: Implicit Condition Control for Enhanced Portrait Animationcited by 55
- 2025Long-Term TalkingFace Generation via Motion-Prior Conditional Diffusion Modelcited by 49
- 2024MultiBooth: Towards Generating All Your Concepts in an Image from Textcited by 45
- 2025EEdit: Rethinking the Spatial and Temporal Redundancy for Efficient Image Editingcited by 45
- 2024Image Watermarks are Removable Using Controllable Regeneration from Clean Noisecited by 43
- 2025LayerTracer: Cognitive-Aligned Layered SVG Synthesis via Diffusion Transformercited by 43
- 2025MakeAnything: Harnessing Diffusion Transformers for Multi-Domain Procedural Sequence Generationcited by 43
- 2025Follow-Your-Emoji-Faster: Towards Efficient, Fine-Controllable, and Expressive Freestyle Portrait Animationcited by 41
- 2021Boosting Fast Adversarial Training with Learnable Adversarial Initializationcited by 40
- 2024InstantSwap: Fast Customized Concept Swapping across Sharp Shape Differencescited by 34
- 2025MAT-Agent: Adaptive Multi-Agent Training Optimizationcited by 34
- 2025DrDiff: Dynamic Routing Diffusion with Hierarchical Attention for Breaking the Efficiency-Quality Trade-offcited by 33
- 2024SemTalk: Holistic Co-speech Motion Generation with Frame-level Semantic Emphasiscited by 32
- 2025OSC: Cognitive Orchestration through Dynamic Knowledge Alignment in Multi-Agent LLM Collaborationcited by 29
- 2025IMAGHarmony: Controllable Image Editing with Consistent Object Quantity and Layoutcited by 28
- 2022One Model to Edit Them All: Free-Form Text-Driven Image Manipulation with Semantic Modulationscited by 24
- 2024CharacterFactory: Sampling Consistent Characters with GANs for Diffusion Modelscited by 24
- 2025PhotoDoodle: Learning Artistic Image Editing from Few-Shot Pairwise Datacited by 23
- 2024IDProtector: An Adversarial Noise Encoder to Protect Against ID-Preserving Image Generationcited by 21
- 2023HeadArtist: Text-conditioned 3D Head Generation with Self Score Distillationcited by 20
50 most cited of 63 All 63 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2024Video Motion Transfer with Diffusion Transformers
- 2026MotionGrounder: Grounded Multi-Object Motion Transfer via Diffusion Transformer
- 2026MotionAdapter: Video Motion Transfer via Content-Aware Attention Customization
- 2025Decouple and Track: Benchmarking and Improving Video Diffusion Transformers for Motion Transfer
- 2026Controlling Motion Transfer in Diffusion Transformers via Attention Heads
- 2026FastVMT: Eliminating Redundancy in Video Motion Transfer
- 2025LMP: Leveraging Motion Prior in Zero-Shot Video Generation with Diffusion Transformer
- 2025Mask2DiT: Dual Mask-based Diffusion Transformer for Multi-Scene Long Video Generation