IM-Animation: An Implicit Motion Representation for Identity-decoupled Character Animation
On the map: Diffusion models → Video generation
Abstract (arXiv)
Recent progress in video diffusion models has markedly advanced character animation, which synthesizes motioned videos by animating a static identity image according to a driving video. Explicit methods represent motion using skeleton, DWPose or other explicit structured signals, but struggle to handle spatial mismatches and varying body scales. %proportions. Implicit methods, on the other hand, capture high-level implicit motion semantics directly from the driving video, but suffer from identity leakage and entanglement between motion and appearance. To address the above challenges, we propose a novel implicit motion representation that compresses per-frame motion into compact 1D motion tokens. This design relaxes strict spatial constraints inherent in 2D representations and effectively prevents identity information leakage from the motion video. Furthermore, we design a temporally consistent mask token-based retargeting module that enforces a temporal training bottleneck, mitigating interference from the source images' motion and improving retargeting consistency. Our methodology employs a three-stage training strategy to enhance the training efficiency and ensure high fidelity. Extensive experiments demonstrate that our implicit motion representation and the propose IM-Animation's generative capabilities are achieve superior or competitive performance compared with state-of-the-art methods.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 74 of its 80 references that are in the map. First posted on arXiv 7 Feb 2026.
Builds on
74 of 80 references.
Closest ancestors · 35
Same direction, newest first
- 2025SynMotion: Semantic-Visual Adaptation for Motion Customized Video Generation30 Jun
- 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuning5 Jun
- 2025LMP: Leveraging Motion Prior in Zero-Shot Video Generation with Diffusion Transformer20 May
- 2025UniAnimate-DiT: Human Image Animation with Large-Scale Video Diffusion Transformer15 Apr
- 2025DynamiCtrl: Rethinking the Basic Structure and the Role of Text for High-quality Human Image Animation27 Mar
- 2025EfficientMT: Efficient Temporal Adaptation for Motion Transfer in Text-to-Video Diffusion Models25 Mar
- 2025Diffusion Adversarial Post-Training for One-Step Video Generation14 Jan
- 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Control7 Jan
- 2024MotionFlow: Attention-Driven Motion Transfer in Video Diffusion Models6 Dec
- 2024MoTrans: Customized Motion Transfer with Text-driven Video Diffusion Models2 Dec
- 2024High Quality Human Image Animation using Regional Supervision and Motion Blur Condition29 Sep
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
23 more
- 2024UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animation3 Jun
- 2024VividPose: Advancing Stable Video Diffusion for Realistic Human Image Animation28 May
- 2024Ctrl-Adapter: An Efficient and Versatile Framework for Adapting Diverse Controls to Any Diffusion Model15 Apr
- 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidance21 Mar
- 2024Lumiere: A Space-Time Diffusion Model for Video Generation23 Jan
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Models17 Jan
- 2023Photorealistic Video Generation with Diffusion Models11 Dec
- 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motion7 Dec
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animation28 Nov
- 2023SparseCtrl: Adding Sparse Controls to Text-to-Video Diffusion Models28 Nov
- 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Model27 Nov
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
- 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generation30 Oct
- 2023ModelScope Text-to-Video Technical Report12 Aug
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul
- 2023Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translation13 Jun
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models18 Apr
- 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generators23 Mar
- 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editing16 Mar
- 2023Structure and Content-Guided Video Synthesis with Diffusion Models6 Feb
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation22 Dec
- 2022MagicVideo: Efficient Video Generation With Latent Diffusion Models20 Nov
- 2022Video Diffusion Models7 Apr
Other references · 39
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
- 2020First Order Motion Model for Image Animationcited by 698
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
- 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 475
27 more
- 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 307
- 2024An Image is Worth 32 Tokens for Reconstruction and Generationcited by 295
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
- 2019Few-shot Video-to-Video Synthesiscited by 196
- 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 196
- 2024VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real Timecited by 186
- 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 176
- 2017Video Generation From Textcited by 153
- 2022Generating Long Videos of Dynamic Scenescited by 113
- 2024X-Portrait: Expressive Portrait Animation with Hierarchical Motion Attentioncited by 88
- 2024Animate-X: Universal Character Image Animation with Enhanced Motion Representationcited by 86
- 2025Wan-Animate: Unified Character Animation and Replacement with Holistic Replicationcited by 76
- 2024Allegro: Open the Black Box of Commercial-Level Video Generation Modelcited by 68
- 2024EMOPortraits: Emotion-enhanced Multimodal One-shot Head Avatarscited by 65
- 2025HunyuanPortrait: Implicit Condition Control for Enhanced Portrait Animationcited by 55
- 2024FLOAT: Generative Motion Latent Flow Matching for Audio-driven Talking Portraitcited by 40
- 2024RealisDance: Equip controllable character animation with realistic handscited by 37
- 2025DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidancecited by 36
- 2025RealisDance-DiT: Simple yet Strong Baseline towards Controllable Character Animation in the Wildcited by 28
- 2025X-NeMo: Expressive Neural Motion Reenactment via Disentangled Latent Attentioncited by 26
- 2025FlexiAct: Towards Flexible Action Control in Heterogeneous Scenarioscited by 25
- 2025CatV2TON: Taming Diffusion Transformers for Vision-Based Virtual Try-On with Temporal Concatenationcited by 22
- 2025X-UniMotion: Animating Human Images with Expressive, Unified and Identity-Agnostic Motion Latentscited by 13
- 2021Self-supervised 3D Representation Learning of Dressed Humans from Social Media Videoscited by 12
- 2025ConMo: Controllable Motion Disentanglement and Recomposition for Zero-Shot Motion Transfercited by 12
- 2025DreamVVT: Mastering Realistic Video Virtual Try-On in the Wild via a Stage-Wise Diffusion Transformer Frameworkcited by 12
- 2024Dynamic Try-On: Taming Video Virtual Try-on with Dynamic Attention Mechanismcited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026DreamActor-M2: Universal Character Image Animation via Spatiotemporal In-Context Learning
- 2026MultiAnimate: Pose-Guided Image Animation Made Extensible
- 2026Wan-Animate-2: Pushing the Application Boundaries of Character Animation
- 2026AnyCrowd: Instance-Isolated Identity-Pose Binding for Arbitrary Multi-Character Animation
- 2025Stable Video-Driven Portraits
- 2026RASA: Disentangled Spatial-Motional Priors for Cross-Identity Character Animation
- 2024Towards motion from video diffusion models
- 2025Multi-identity Human Image Animation with Structural Video Diffusion