mlsanityData to 14 Oct 2026

X-UniMotion: Animating Human Images with Expressive, Unified and Identity-Agnostic Motion Latents

arXiv 2508.09383 ↗First posted 12 Aug 2025cs.CV cs.AIcited by 13

Not on the map. Why?

Abstract (arXiv)

We present X-UniMotion, a unified and expressive implicit latent representation for whole-body human motion, encompassing facial expressions, body poses, and hand gestures. Unlike prior motion transfer methods that rely on explicit skeletal poses and heuristic cross-identity adjustments, our approach encodes multi-granular motion directly from a single image into a compact set of four disentangled latent tokens -- one for facial expression, one for body pose, and one for each hand. These motion latents are both highly expressive and identity-agnostic, enabling high-fidelity, detailed cross-identity motion transfer across subjects with diverse identities, poses, and spatial configurations. To achieve this, we introduce a self-supervised, end-to-end framework that jointly learns the motion encoder and latent representation alongside a DiT-based video generative model, trained on large-scale, diverse human motion datasets. Motion-identity disentanglement is enforced via 2D spatial and color augmentations, as well as synthetic 3D renderings of cross-identity subject pairs under shared poses. Furthermore, we guide motion token learning with auxiliary decoders that promote fine-grained, semantically aligned, and depth-aware motion embeddings. Extensive experiments show that X-UniMotion outperforms state-of-the-art methods, producing highly expressive animations with superior motion fidelity and identity preservation.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 28 of its 44 references that are in the map. First posted on arXiv 12 Aug 2025.

Builds on

28 of 44 references.

References · 28

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  3. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  4. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  5. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  6. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  7. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  8. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  9. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
  10. 2020First Order Motion Model for Image Animationcited by 704
  11. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
  12. 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 444
16 more
  1. 2021Motion Representations for Articulated Animationcited by 255
  2. 2024Sapiens: Foundation for Human Vision Modelscited by 229
  3. 2022Thin-Plate Spline Motion Model for Image Animationcited by 210
  4. 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 198
  5. 2025OmniHuman-1: Rethinking the Scaling-Up of One-Stage Conditioned Human Animation Modelscited by 129
  6. 2023MagicPose: Realistic Human Poses and Facial Expressions Retargeting with Identity-aware Diffusioncited by 117
  7. 2022Progressive Disentangled Representation Learning for Fine-Grained Controllable Talking Head Synthesiscited by 93
  8. 2024X-Portrait: Expressive Portrait Animation with Hierarchical Motion Attentioncited by 91
  9. 2025Autoregressive Adversarial Post-Training for Real-Time Interactive Video Generationcited by 90
  10. 2024Animate-X: Universal Character Image Animation with Enhanced Motion Representationcited by 88
  11. 2025Seaweed-7B: Cost-Effective Training of Video Generation Foundation Modelcited by 82
  12. 2025UniAnimate-DiT: Human Image Animation with Large-Scale Video Diffusion Transformercited by 42
  13. 2025DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidancecited by 36
  14. 2025X-NeMo: Expressive Neural Motion Reenactment via Disentangled Latent Attentioncited by 28
  15. 2024DragEntity: Trajectory Guided Video Generation using Entity and Positional Relationshipscited by 9
  16. 2024High Quality Human Image Animation using Regional Supervision and Motion Blur Conditioncited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 11.

13 papers.

Sort:

By area: