mlsanityData to 7 Oct 2026

Let Your Image Move with Your Motion! -- Implicit Multi-Object Multi-Motion Transfer

arXiv 2603.01000 ↗First posted 1 Mar 2026cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Motion transfer has emerged as a promising direction for controllable video generation, yet existing methods largely focus on single-object scenarios and struggle when multiple objects require distinct motion patterns. In this work, we present FlexiMMT, the first implicit image-to-video (I2V) motion transfer framework that explicitly enables multi-object, multi-motion transfer. Given a static multi-object image and multiple reference videos, FlexiMMT independently extracts motion representations and accurately assigns them to different objects, supporting flexible recombination and arbitrary motion-to-object mappings. To address the core challenge of cross-object motion entanglement, we introduce a Motion Decoupled Mask Attention Mechanism that uses object-specific masks to constrain attention, ensuring that motion and text tokens only influence their designated regions. We further propose a Differentiated Mask Propagation Mechanism that derives object-specific masks directly from diffusion attention and progressively propagates them across frames efficiently. Extensive experiments demonstrate that FlexiMMT achieves precise, compositional, and state-of-the-art performance in I2V-based multi-object multi-motion transfer. Our project page is: https://ethan-li123.github.io/FlexiMMT_page/

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 53 of its 55 references that are in the map. First posted on arXiv 1 Mar 2026.

Builds on

53 of 55 references.

References · 53

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2023Segment Anythingcited by 8,158
  3. 2022Scalable Diffusion Models with Transformerscited by 5,931
  4. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  5. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  6. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  7. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  8. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  9. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
  10. 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 942
  11. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
  12. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
38 more
  1. 2025VACE: All-in-One Video Creation and Editingcited by 467
  2. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 463
  3. 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
  4. 2023ControlVideo: Training-free Controllable Text-to-Video Generationcited by 324
  5. 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 312
  6. 2023Common Diffusion Noise Schedules and Sample Steps are Flawedcited by 308
  7. 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
  8. 2022MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generationcited by 225
  9. 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modelingcited by 209
  10. 2022Listen, Denoise, Action! Audio-Driven Motion Synthesis with Diffusion Modelscited by 188
  11. 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 176
  12. 2023MotionDirector: Motion Customization of Text-to-Video Diffusion Modelscited by 172
  13. 2023SparseCtrl: Adding Sparse Controls to Text-to-Video Diffusion Modelscited by 172
  14. 2024DragAnything: Motion Control for Anything using Entity Representationcited by 159
  15. 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 151
  16. 2023DisCo: Disentangled Control for Realistic Human Dance Generationcited by 141
  17. 2023Space-Time Diffusion Features for Zero-Shot Text-Driven Motion Transfercited by 124
  18. 2025Go-with-the-Flow: Motion-Controllable Video Diffusion Models Using Real-Time Warped Noisecited by 114
  19. 2024MotionClone: Training-Free Motion Cloning for Controllable Video Generationcited by 104
  20. 2023FreeInit: Bridging Initialization Gap in Video Diffusion Modelscited by 93
  21. 2024MotionBooth: Motion-Aware Customized Text-to-Video Generationcited by 92
  22. 2024MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Modelcited by 87
  23. 2023VMC: Video Motion Customization using Temporal Attention Adaption for Text-to-Video Diffusion Modelscited by 86
  24. 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 83
  25. 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuningcited by 81
  26. 2023PEEKABOO: Interactive Video Generation via Masked-Diffusioncited by 76
  27. 2025Wan-Animate: Unified Character Animation and Replacement with Holistic Replicationcited by 76
  28. 2024ReVideo: Remake a Video with Motion and Content Controlcited by 74
  29. 2024Evaluation of Text-to-Video Generation Models: A Dynamics Perspectivecited by 66
  30. 2024I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Modelscited by 55
  31. 2024Video Motion Transfer with Diffusion Transformerscited by 39
  32. 2025MotionPro: A Precise Motion Controller for Image-to-Video Generationcited by 29
  33. 2025LoRA-Edit: Controllable First-Frame-Guided Video Editing via Mask-Aware LoRA Fine-Tuningcited by 27
  34. 2025FlexiAct: Towards Flexible Action Control in Heterogeneous Scenarioscited by 25
  35. 2024DIVE: Taming DINO for Subject-Driven Video Editingcited by 17
  36. 2024UniVST: A Unified Framework for Training-free Localized Video Style Transfercited by 16
  37. 2025VFXMaster: Unlocking Dynamic Visual Effect Generation via In-Context Learningcited by 12
  38. 2025O-DisCo-Edit: Object Distortion Control for Unified Realistic Video Editingcited by 10

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.