X-UniMotion: Animating Human Images with Expressive, Unified and Identity-Agnostic Motion Latents
Not on the map. Why?
Abstract (arXiv)
We present X-UniMotion, a unified and expressive implicit latent representation for whole-body human motion, encompassing facial expressions, body poses, and hand gestures. Unlike prior motion transfer methods that rely on explicit skeletal poses and heuristic cross-identity adjustments, our approach encodes multi-granular motion directly from a single image into a compact set of four disentangled latent tokens -- one for facial expression, one for body pose, and one for each hand. These motion latents are both highly expressive and identity-agnostic, enabling high-fidelity, detailed cross-identity motion transfer across subjects with diverse identities, poses, and spatial configurations. To achieve this, we introduce a self-supervised, end-to-end framework that jointly learns the motion encoder and latent representation alongside a DiT-based video generative model, trained on large-scale, diverse human motion datasets. Motion-identity disentanglement is enforced via 2D spatial and color augmentations, as well as synthetic 3D renderings of cross-identity subject pairs under shared poses. Furthermore, we guide motion token learning with auxiliary decoders that promote fine-grained, semantically aligned, and depth-aware motion embeddings. Extensive experiments show that X-UniMotion outperforms state-of-the-art methods, producing highly expressive animations with superior motion fidelity and identity preservation.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 28 of its 44 references that are in the map. First posted on arXiv 12 Aug 2025.
Builds on
28 of 44 references.
References · 28
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
- 2020First Order Motion Model for Image Animationcited by 704
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
- 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 444
16 more
- 2021Motion Representations for Articulated Animationcited by 255
- 2024Sapiens: Foundation for Human Vision Modelscited by 229
- 2022Thin-Plate Spline Motion Model for Image Animationcited by 210
- 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 198
- 2025OmniHuman-1: Rethinking the Scaling-Up of One-Stage Conditioned Human Animation Modelscited by 129
- 2023MagicPose: Realistic Human Poses and Facial Expressions Retargeting with Identity-aware Diffusioncited by 117
- 2022Progressive Disentangled Representation Learning for Fine-Grained Controllable Talking Head Synthesiscited by 93
- 2024X-Portrait: Expressive Portrait Animation with Hierarchical Motion Attentioncited by 91
- 2025Autoregressive Adversarial Post-Training for Real-Time Interactive Video Generationcited by 90
- 2024Animate-X: Universal Character Image Animation with Enhanced Motion Representationcited by 88
- 2025Seaweed-7B: Cost-Effective Training of Video Generation Foundation Modelcited by 82
- 2025UniAnimate-DiT: Human Image Animation with Large-Scale Video Diffusion Transformercited by 42
- 2025DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidancecited by 36
- 2025X-NeMo: Expressive Neural Motion Reenactment via Disentangled Latent Attentioncited by 28
- 2024DragEntity: Trajectory Guided Video Generation using Entity and Positional Relationshipscited by 9
- 2024High Quality Human Image Animation using Regional Supervision and Motion Blur Conditioncited by 7
Built on by
Citing papers per year: 2025: 2; 2026: 11.
13 papers.
Sort:
By area:
- 2025SteadyDancer: Harmonized and Coherent Human Image Animation with First-Frame Preservationcited by 10
- 2026SCAIL-2: Unifying Controlled Character Animation with End-to-End In-Context Conditioningcited by 8
- 2026CoMoVi: Co-Generation of 3D Human Motions and Realistic Videoscited by 6
- 20263D-Aware Implicit Motion Control for View-Adaptive Human Video Generationcited by 6
- 2026DreamActor-M2: Universal Character Image Animation via Spatiotemporal In-Context Learningcited by 5
- 2026Kling-MotionControl Technical Reportcited by 4
- 2026Wan-Animate-2: Pushing the Application Boundaries of Character Animationcited by 4
- 2026Zero-Shot Reconstruction of Animatable 3D Avatars with Cloth Dynamics from a Single Imagecited by 3
- 2025High-Fidelity and Long-Duration Human Image Animation with Diffusion Transformercited by 1
- 2026IM-Animation: An Implicit Motion Representation for Identity-decoupled Character Animationcited by 1
- 2026HairWeaver: Few-Shot Photorealistic Hair Motion Synthesis with Sim-to-Real Guided Video Diffusioncited by 1
- 2026EMOSH: Expressive Motion and Shape Disentanglement for Human Animationcited by 0
1 more
- 2026Reimagine Video Dynamicscited by 0
- 2026Reimagine Video Dynamics29 Sep 2026
- 2026Wan-Animate-2: Pushing the Application Boundaries of Character Animation6 Aug 2026
- 2026EMOSH: Expressive Motion and Shape Disentanglement for Human Animation26 Jun 2026
- 2026SCAIL-2: Unifying Controlled Character Animation with End-to-End In-Context Conditioning9 Jun 2026
- 2026Zero-Shot Reconstruction of Animatable 3D Avatars with Cloth Dynamics from a Single Image16 Mar 2026
- 2026Kling-MotionControl Technical Report3 Mar 2026
- 2026HairWeaver: Few-Shot Photorealistic Hair Motion Synthesis with Sim-to-Real Guided Video Diffusion11 Feb 2026
- 2026IM-Animation: An Implicit Motion Representation for Identity-decoupled Character Animation7 Feb 2026
- 20263D-Aware Implicit Motion Control for View-Adaptive Human Video Generation3 Feb 2026
- 2026DreamActor-M2: Universal Character Image Animation via Spatiotemporal In-Context Learning29 Jan 2026
- 2026CoMoVi: Co-Generation of 3D Human Motions and Realistic Videos15 Jan 2026
- 2025High-Fidelity and Long-Duration Human Image Animation with Diffusion Transformer26 Dec 2025
- 2025High-Fidelity and Long-Duration Human Image Animation with Diffusion Transformercited by 1
- 2026IM-Animation: An Implicit Motion Representation for Identity-decoupled Character Animationcited by 1
- 2026HairWeaver: Few-Shot Photorealistic Hair Motion Synthesis with Sim-to-Real Guided Video Diffusioncited by 1
- 2026HairWeaver: Few-Shot Photorealistic Hair Motion Synthesis with Sim-to-Real Guided Video Diffusion11 Feb 2026
- 2026IM-Animation: An Implicit Motion Representation for Identity-decoupled Character Animation7 Feb 2026
- 2025High-Fidelity and Long-Duration Human Image Animation with Diffusion Transformer26 Dec 2025
- 2025SteadyDancer: Harmonized and Coherent Human Image Animation with First-Frame Preservationcited by 10
- 2026SCAIL-2: Unifying Controlled Character Animation with End-to-End In-Context Conditioningcited by 8
- 2026CoMoVi: Co-Generation of 3D Human Motions and Realistic Videoscited by 6
- 20263D-Aware Implicit Motion Control for View-Adaptive Human Video Generationcited by 6
- 2026DreamActor-M2: Universal Character Image Animation via Spatiotemporal In-Context Learningcited by 5
- 2026Kling-MotionControl Technical Reportcited by 4
- 2026Wan-Animate-2: Pushing the Application Boundaries of Character Animationcited by 4
- 2026Zero-Shot Reconstruction of Animatable 3D Avatars with Cloth Dynamics from a Single Imagecited by 3
- 2026EMOSH: Expressive Motion and Shape Disentanglement for Human Animationcited by 0
- 2026Reimagine Video Dynamicscited by 0
- 2026Reimagine Video Dynamics29 Sep 2026
- 2026Wan-Animate-2: Pushing the Application Boundaries of Character Animation6 Aug 2026
- 2026EMOSH: Expressive Motion and Shape Disentanglement for Human Animation26 Jun 2026
- 2026SCAIL-2: Unifying Controlled Character Animation with End-to-End In-Context Conditioning9 Jun 2026
- 2026Zero-Shot Reconstruction of Animatable 3D Avatars with Cloth Dynamics from a Single Image16 Mar 2026
- 2026Kling-MotionControl Technical Report3 Mar 2026
- 20263D-Aware Implicit Motion Control for View-Adaptive Human Video Generation3 Feb 2026
- 2026DreamActor-M2: Universal Character Image Animation via Spatiotemporal In-Context Learning29 Jan 2026
- 2026CoMoVi: Co-Generation of 3D Human Motions and Realistic Videos15 Jan 2026
- 2025SteadyDancer: Harmonized and Coherent Human Image Animation with First-Frame Preservation24 Nov 2025