mlsanityData to 7 Oct 2026

EMOSH: Expressive Motion and Shape Disentanglement for Human Animation

arXiv 2606.28026 ↗First posted 26 Jun 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

High-fidelity and expressive controllable human animation is essential for content creation and digital avatar applications. However, existing methods face a dilemma between expressiveness and disentanglement. Mainstream 2D pose-conditioned approaches suffer from "motion-shape entanglement", leading to the leakage of the driving subject's body shape. Conversely, methods relying on 3D priors (e.g., SMPL) achieve geometric disentanglement but struggle to capture facial expressions and complex gestures, resulting in rigid animations. To this end, we propose EMOSH, a novel framework for high-fidelity controllable human video generation. First, an Expressive Human Model (EHM) is introduced as the core control representation. By explicitly disentangling shape and pose parameters, we fundamentally resolve the body shape leakage issue. Alongside this, a robust motion tracker is designed to accurately estimate EHM parameters from video. Second, we propose a Coarse-to-Fine Hybrid Motion Injection strategy, enabling more fine-grained control over expressions and gestures. Furthermore, we introduce a Spatially-Aligned Conditioning mechanism to bridge the domain gap between training and inference, improving identity consistency. Extensive experiments demonstrate that EMOSH outperforms previous methods in both self-driven and cross-driven scenarios, producing high-fidelity videos with vivid expressions while maintaining shape disentanglement.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 79 of its 90 references that are in the map. First posted on arXiv 26 Jun 2026.

Builds on

79 of 90 references.

References · 79

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  6. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  7. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  8. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  9. 2020Denoising Diffusion Implicit Modelscited by 9,655
  10. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  11. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  12. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
38 more
  1. 2022Scalable Diffusion Models with Transformerscited by 5,931
  2. 2022Generative Adversarial Networkscited by 5,603
  3. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  4. 2022Flow Matching for Generative Modelingcited by 5,426
  5. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  6. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  7. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  8. 2022Video Diffusion Modelscited by 2,280
  9. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  10. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  11. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
  12. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  13. 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,161
  14. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
  15. 2020First Order Motion Model for Image Animationcited by 698
  16. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
  17. 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 651
  18. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
  19. 2019MediaPipe: A Framework for Building Perception Pipelinescited by 572
  20. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
  21. 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 523
  22. 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 475
  23. 2025VACE: All-in-One Video Creation and Editingcited by 467
  24. 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 438
  25. 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
  26. 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 312
  27. 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 307
  28. 2023Reconstructing Hands in 3D with Transformerscited by 298
  29. 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 271
  30. 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 256
  31. 2017Pose Guided Person Image Generationcited by 251
  32. 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 247
  33. 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 196
  34. 2022Depth-Aware Generative Adversarial Network for Talking Head Video Generationcited by 177
  35. 2022VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolutioncited by 174
  36. 2017Deformable GANs for Pose-based Human Image Generationcited by 166
  37. 2023DisCo: Disentangled Control for Realistic Human Dance Generationcited by 141
  38. 2019Progressive Pose Attention Transfer for Person Image Generationcited by 138

50 most cited of 79 All 79 (JSON)

Built on by

Not cited yet.