EMOSH: Expressive Motion and Shape Disentanglement for Human Animation
Not on the map. Why?
Abstract (arXiv)
High-fidelity and expressive controllable human animation is essential for content creation and digital avatar applications. However, existing methods face a dilemma between expressiveness and disentanglement. Mainstream 2D pose-conditioned approaches suffer from "motion-shape entanglement", leading to the leakage of the driving subject's body shape. Conversely, methods relying on 3D priors (e.g., SMPL) achieve geometric disentanglement but struggle to capture facial expressions and complex gestures, resulting in rigid animations. To this end, we propose EMOSH, a novel framework for high-fidelity controllable human video generation. First, an Expressive Human Model (EHM) is introduced as the core control representation. By explicitly disentangling shape and pose parameters, we fundamentally resolve the body shape leakage issue. Alongside this, a robust motion tracker is designed to accurately estimate EHM parameters from video. Second, we propose a Coarse-to-Fine Hybrid Motion Injection strategy, enabling more fine-grained control over expressions and gestures. Furthermore, we introduce a Spatially-Aligned Conditioning mechanism to bridge the domain gap between training and inference, improving identity consistency. Extensive experiments demonstrate that EMOSH outperforms previous methods in both self-driven and cross-driven scenarios, producing high-fidelity videos with vivid expressions while maintaining shape disentanglement.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 79 of its 90 references that are in the map. First posted on arXiv 26 Jun 2026.
Builds on
79 of 90 references.
References · 79
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
38 more
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Generative Adversarial Networkscited by 5,603
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2022Video Diffusion Modelscited by 2,280
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,161
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
- 2020First Order Motion Model for Image Animationcited by 698
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
- 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 651
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
- 2019MediaPipe: A Framework for Building Perception Pipelinescited by 572
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
- 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 523
- 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 475
- 2025VACE: All-in-One Video Creation and Editingcited by 467
- 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 438
- 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
- 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 312
- 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 307
- 2023Reconstructing Hands in 3D with Transformerscited by 298
- 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 271
- 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 256
- 2017Pose Guided Person Image Generationcited by 251
- 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 247
- 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 196
- 2022Depth-Aware Generative Adversarial Network for Talking Head Video Generationcited by 177
- 2022VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolutioncited by 174
- 2017Deformable GANs for Pose-based Human Image Generationcited by 166
- 2023DisCo: Disentangled Control for Realistic Human Dance Generationcited by 141
- 2019Progressive Pose Attention Transfer for Person Image Generationcited by 138
50 most cited of 79 All 79 (JSON)
Built on by
Not cited yet.