Let Your Image Move with Your Motion! -- Implicit Multi-Object Multi-Motion Transfer
Not on the map. Why?
Abstract (arXiv)
Motion transfer has emerged as a promising direction for controllable video generation, yet existing methods largely focus on single-object scenarios and struggle when multiple objects require distinct motion patterns. In this work, we present FlexiMMT, the first implicit image-to-video (I2V) motion transfer framework that explicitly enables multi-object, multi-motion transfer. Given a static multi-object image and multiple reference videos, FlexiMMT independently extracts motion representations and accurately assigns them to different objects, supporting flexible recombination and arbitrary motion-to-object mappings. To address the core challenge of cross-object motion entanglement, we introduce a Motion Decoupled Mask Attention Mechanism that uses object-specific masks to constrain attention, ensuring that motion and text tokens only influence their designated regions. We further propose a Differentiated Mask Propagation Mechanism that derives object-specific masks directly from diffusion attention and progressively propagates them across frames efficiently. Extensive experiments demonstrate that FlexiMMT achieves precise, compositional, and state-of-the-art performance in I2V-based multi-object multi-motion transfer. Our project page is: https://ethan-li123.github.io/FlexiMMT_page/
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 53 of its 55 references that are in the map. First posted on arXiv 1 Mar 2026.
Builds on
53 of 55 references.
References · 53
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023Segment Anythingcited by 8,158
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
- 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 942
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
38 more
- 2025VACE: All-in-One Video Creation and Editingcited by 467
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 463
- 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
- 2023ControlVideo: Training-free Controllable Text-to-Video Generationcited by 324
- 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 312
- 2023Common Diffusion Noise Schedules and Sample Steps are Flawedcited by 308
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
- 2022MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generationcited by 225
- 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modelingcited by 209
- 2022Listen, Denoise, Action! Audio-Driven Motion Synthesis with Diffusion Modelscited by 188
- 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 176
- 2023MotionDirector: Motion Customization of Text-to-Video Diffusion Modelscited by 172
- 2023SparseCtrl: Adding Sparse Controls to Text-to-Video Diffusion Modelscited by 172
- 2024DragAnything: Motion Control for Anything using Entity Representationcited by 159
- 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 151
- 2023DisCo: Disentangled Control for Realistic Human Dance Generationcited by 141
- 2023Space-Time Diffusion Features for Zero-Shot Text-Driven Motion Transfercited by 124
- 2025Go-with-the-Flow: Motion-Controllable Video Diffusion Models Using Real-Time Warped Noisecited by 114
- 2024MotionClone: Training-Free Motion Cloning for Controllable Video Generationcited by 104
- 2023FreeInit: Bridging Initialization Gap in Video Diffusion Modelscited by 93
- 2024MotionBooth: Motion-Aware Customized Text-to-Video Generationcited by 92
- 2024MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Modelcited by 87
- 2023VMC: Video Motion Customization using Temporal Attention Adaption for Text-to-Video Diffusion Modelscited by 86
- 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 83
- 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuningcited by 81
- 2023PEEKABOO: Interactive Video Generation via Masked-Diffusioncited by 76
- 2025Wan-Animate: Unified Character Animation and Replacement with Holistic Replicationcited by 76
- 2024ReVideo: Remake a Video with Motion and Content Controlcited by 74
- 2024Evaluation of Text-to-Video Generation Models: A Dynamics Perspectivecited by 66
- 2024I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Modelscited by 55
- 2024Video Motion Transfer with Diffusion Transformerscited by 39
- 2025MotionPro: A Precise Motion Controller for Image-to-Video Generationcited by 29
- 2025LoRA-Edit: Controllable First-Frame-Guided Video Editing via Mask-Aware LoRA Fine-Tuningcited by 27
- 2025FlexiAct: Towards Flexible Action Control in Heterogeneous Scenarioscited by 25
- 2024DIVE: Taming DINO for Subject-Driven Video Editingcited by 17
- 2024UniVST: A Unified Framework for Training-free Localized Video Style Transfercited by 16
- 2025VFXMaster: Unlocking Dynamic Visual Effect Generation via In-Context Learningcited by 12
- 2025O-DisCo-Edit: Object Distortion Control for Unified Realistic Video Editingcited by 10
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.