mlsanityData to 7 Oct 2026

DanceHMR: Hand-Aware Whole-Body Human Mesh Recovery from Monocular Videos

arXiv 2605.18102 ↗First posted 18 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Monocular video human mesh recovery is essential for digital humans, avatar animation, and embodied simulation, where both temporal stability and expressive whole-body motion are required. Existing video HMR methods produce coherent body motion but often overlook detailed hand articulation, while image-based whole-body methods recover SMPL-X meshes independently per frame, often leading to jittery and inaccurate hand motion. We present a temporally coherent whole-body HMR framework for challenging in-the-wild monocular videos. Our model unifies body context and part-specific hand observations through residual body-hand fusion, enabling stable body motion and detailed hand recovery within a single temporal architecture. We further introduce close-up-aware augmentation to improve robustness under upper-body framing. Experiments on whole-body and body-only benchmarks demonstrate improved hand reconstruction and competitive body accuracy. Our method also produces temporally stable and 2D-consistent SMPL-X motion in challenging real-world videos.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 42 references that are in the map. First posted on arXiv 18 May 2026.

Builds on

38 of 42 references.

References · 38

  1. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  2. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
  3. 2019VIBE: Video Inference for Human Body Pose and Shape Estimationcited by 615
  4. 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 344
  5. 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 319
  6. 2022ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulationcited by 306
  7. 2023Reconstructing Hands in 3D with Transformerscited by 298
  8. 2023BEDLAM: A Synthetic Dataset of Bodies Exhibiting Detailed Lifelike Animated Motioncited by 229
  9. 2023WHAM: Reconstructing World-grounded Humans with Accurate 3D Motioncited by 200
  10. 2023RTMPose: Real-Time Multi-Person Pose Estimation based on MMPosecited by 170
  11. 2020Beyond Static Features for Temporally Consistent 3D Human Pose and Shape from a Videocited by 162
  12. 2020Monocular Expressive Body Regression through Body-Driven Attentioncited by 155
26 more
  1. 2023SMPLer-X: Scaling Up Expressive Human Pose and Shape Estimationcited by 154
  2. 2022PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Imagescited by 152
  3. 2021GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Camerascited by 151
  4. 2023Decoupling Human and Camera Motion from Videos in the Wildcited by 140
  5. 2021Collaborative Regression of Expressive Bodies using Moderationcited by 137
  6. 2021EgoBody: Human Body Shape and Motion of Interacting People from Head-Mounted Devicescited by 136
  7. 2023One-Stage 3D Whole-Body Mesh Recovery with Component Aware Transformercited by 128
  8. 2024World-Grounded Human Motion Recovery via Gravity-View Coordinatescited by 127
  9. 2024WiLoR: End-to-end 3D Hand Localization and Reconstruction in-the-wildcited by 117
  10. 2024TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videoscited by 105
  11. 20233D Human Pose Estimation via Intuitive Physicscited by 100
  12. 2024Multi-HMR: Multi-Person Whole-Body Human Mesh Recovery in a Single Shotcited by 98
  13. 2023EMDB: The Electromagnetic Database of Global 3D Human Pose and Shape in the Wildcited by 95
  14. 2023TRACE: 5D Temporal Regression of Avatars with Dynamic Cameras in 3D Environmentscited by 89
  15. 2020Accurate 3D Hand Pose Estimation for Whole-Body 3D Human Mesh Estimationcited by 81
  16. 2025PromptHMR: Promptable Human Mesh Recoverycited by 70
  17. 2025HaWoR: World-Space Hand Motion Reconstruction from Egocentric Videoscited by 62
  18. 2022Capturing Humans in Motion: Temporal-Attentive 3D Human Pose and Shape Estimation from Monocular Videocited by 59
  19. 2023Global-to-Local Modeling for Video-based 3D Human Pose and Shape Estimationcited by 46
  20. 2025GENMO: A GENeralist Model for Human MOtioncited by 43
  21. 2024AiOS: All-in-One-Stage Expressive Human Pose and Shape Estimationcited by 41
  22. 2025Human3R: Everyone Everywhere All at Oncecited by 35
  23. 2025SMPLest-X: Ultimate Scaling for Expressive Human Pose and Shape Estimationcited by 31
  24. 2024WHAC: World-grounded Humans and Camerascited by 29
  25. 2024RTMW: Real-Time Multi-Person 2D and 3D Whole-body Pose Estimationcited by 18
  26. 2026DuoMo: Dual Motion Diffusion for World-Space Human Reconstructioncited by 6

Built on by

Not cited yet.