mlsanityData to 14 Oct 2026

Camera-Space Hand Mesh Recovery via Semantic Aggregation and Adaptive 2D-1D Registration

arXiv 2103.02845 ↗First posted 4 Mar 2021cs.CVcited by 59

Not on the map. Why?

Abstract (arXiv)

Recent years have witnessed significant progress in 3D hand mesh recovery. Nevertheless, because of the intrinsic 2D-to-3D ambiguity, recovering camera-space 3D information from a single RGB image remains challenging. To tackle this problem, we divide camera-space mesh recovery into two sub-tasks, i.e., root-relative mesh recovery and root recovery. First, joint landmarks and silhouette are extracted from a single input image to provide 2D cues for the 3D tasks. In the root-relative mesh recovery task, we exploit semantic relations among joints to generate a 3D mesh from the extracted 2D cues. Such generated 3D mesh coordinates are expressed relative to a root position, i.e., wrist of the hand. In the root recovery task, the root position is registered to the camera space by aligning the generated 3D mesh back to 2D cues, thereby completing cameraspace 3D mesh recovery. Our pipeline is novel in that (1) it explicitly makes use of known semantic relations among joints and (2) it exploits 1D projections of the silhouette and mesh to achieve robust registration. Extensive experiments on popular datasets such as FreiHAND, RHD, and Human3.6M demonstrate that our approach achieves stateof-the-art performance on both root-relative mesh recovery and root recovery. Our code is publicly available at https://github.com/SeanChenxy/HandMesh.

Key facts. Cited by 59 papers in the map (data through 14 Oct 2026). Builds on 37 of its 48 references that are in the map. First posted on arXiv 4 Mar 2021.

Builds on

37 of 48 references.

References · 37

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2014Going Deeper with Convolutionscited by 4,241
  4. 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,089
  5. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
  6. 2016Stacked Hourglass Networks for Human Pose Estimationcited by 915
  7. 2017End-to-end Recovery of Human Shape and Posecited by 885
  8. 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 627
  9. 2019Learning joint reconstruction of hands and manipulated objectscited by 378
  10. 2018Learning 3D Human Dynamics from Videocited by 316
  11. 2020I2L-MeshNet: Image-to-Lixel Prediction Network for Accurate 3D Human Pose and Mesh Estimation from a Single RGB Imagecited by 274
  12. 2019FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Imagescited by 271
25 more
  1. 2019Convolutional Mesh Regression for Single-Image Human Shape Reconstructioncited by 270
  2. 2020Pose2Mesh: Graph Convolutional Network for 3D Human Pose and Mesh Recovery from a 2D Human Posecited by 248
  3. 2017Learning to Estimate 3D Hand Pose from Single RGB Imagescited by 234
  4. 2018Learning to Estimate 3D Human Pose and Shape from a Single Color Imagecited by 226
  5. 2016Coarse-to-Fine Volumetric Prediction for Single-Image 3D Human Posecited by 221
  6. 20193D Hand Shape and Pose from Images in the Wildcited by 190
  7. 20193D Hand Shape and Pose Estimation from a Single RGB Imagecited by 174
  8. 2020Weakly-Supervised Mesh-Convolutional Hand Reconstruction in the Wildcited by 146
  9. 2018BodyNet: Volumetric Inference of 3D Human Body Shapescited by 141
  10. 2019Camera Distance-aware Top-down Approach for 3D Multi-person Pose Estimation from a Single RGB Imagecited by 132
  11. 2019End-to-end Hand Mesh Recovery from a Monocular RGB Imagecited by 124
  12. 2017Towards 3D Human Pose Estimation in the Wild: a Weakly-supervised Approachcited by 115
  13. 2019Pushing the Envelope for RGB-based Dense 3D Hand Pose Estimation via Neural Renderingcited by 115
  14. 2020HOPE-Net: A Graph-based Model for Hand-Object Pose Estimationcited by 112
  15. 2018Hand Pose Estimation via Latent 2.5D Heatmap Regressioncited by 111
  16. 2020Monocular Real-time Hand Shape and Motion Capture using Multi-modal Datacited by 106
  17. 2017V2V-PoseNet: Voxel-to-Voxel Prediction Network for Accurate 3D Hand and Human Pose Estimation from a Single Depth Mapcited by 102
  18. 2020Weakly Supervised 3D Hand Pose Estimation via Biomechanical Constraintscited by 97
  19. 2018Cross-modal Deep Variational Hand Pose Estimationcited by 89
  20. 2019SpiralNet++: A Fast and Highly Efficient Mesh Convolution Operatorcited by 89
  21. 2019TexturePose: Supervising Human Mesh Estimation with Texture Consistencycited by 53
  22. 2018A Simple Approach to Intrinsic Correspondence Learning on Unstructured 3D Meshescited by 39
  23. 2019Single Image 3D Hand Reconstruction with Mesh Convolutionscited by 32
  24. 2017An Efficient Algebraic Solution to the Perspective-Three-Point Problemcited by 29
  25. 2020BiHand: Recovering Hand Mesh with Multi-stage Bisected Hourglass Networkscited by 23

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 7; 2022: 13; 2023: 14; 2024: 14; 2025: 4; 2026: 7.

59 papers.

Sort:

By area:

  1. 2021FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and Integrationcited by 169
  2. 2023FastViT: A Fast Hybrid Vision Transformer using Structural Reparameterizationcited by 162
  3. 2024TACO: Benchmarking Generalizable Bimanual Tool-ACtion-Object Understandingcited by 88
  4. 2022Interacting Attention Graph for Single Image Two-Hand Reconstructioncited by 87
  5. 2021ArtiBoost: Boosting Articulated 3D Hand-Object Pose Estimation via Online Exploration and Synthesiscited by 76
  6. 2021MobRecon: Mobile-Friendly Hand Mesh Reconstruction from Monocular Imagecited by 74
  7. 2022AlignSDF: Pose-Aligned Signed Distance Fields for Hand-Object Reconstructioncited by 59
  8. 2023gSDF: Geometry-Driven Signed Distance Functions for 3D Hand-Object Reconstructioncited by 50
  9. 2024Hamba: Single-view 3D Hand Reconstruction with Graph-guided Bi-Scanning Mambacited by 45
  10. 2021Towards Accurate Alignment in Real-time 3D Hand-Mesh Reconstructioncited by 44
  11. 2022Hierarchical Temporal Transformer for 3D Hand Pose Estimation and Action Recognition from Egocentric RGB Videoscited by 35
  12. 2021Lightweight Multi-person Total Motion Capture Using Sparse Multi-view Camerascited by 33
38 more
  1. 2021Hand Image Understanding via Deep Multi-Task Learningcited by 31
  2. 2022Consistent 3D Hand Reconstruction in Video via self-supervised Learningcited by 28
  3. 2024A Simple Baseline for Efficient Hand Mesh Reconstructioncited by 27
  4. 2022DART: Articulated Hand Model with Diverse Accessories and Rich Texturescited by 25
  5. 2022H3WB: Human3.6M 3D WholeBody Dataset and Benchmarkcited by 23
  6. 2023Reconstructing Interacting Hands with Interaction Prior from Monocular Imagescited by 18
  7. 2024HHMR: Holistic Hand Mesh Recovery by Enhancing the Multimodal Controllability of Graph Diffusion Modelscited by 14
  8. 2024HandBooster: Boosting 3D Hand-Mesh Reconstruction by Conditional Synthesis and Sampling of Hand-Object Interactionscited by 13
  9. 2022HiFECap: Monocular High-Fidelity and Expressive Capture of Human Performancescited by 12
  10. 2022Identity-Aware Hand Mesh Estimation and Personalization from RGB Imagescited by 11
  11. 2023CHORD: Category-level Hand-held Object Reconstruction via Shape Deformationcited by 11
  12. 2025HORT: Monocular Hand-held Objects Reconstruction with Transformerscited by 11
  13. 2023POEM: Reconstructing Hand in a Point Embedded Multi-view Stereocited by 10
  14. 2023Learning Explicit Contact for Implicit Reconstruction of Hand-held Objects from Monocular Imagescited by 10
  15. 2024HandOS: 3D Hand Reconstruction in One Stagecited by 9
  16. 2022Spatial-Temporal Parallel Transformer for Arm-Hand Dynamic Estimationcited by 8
  17. 2023Decoupled Iterative Refinement Framework for Interacting Hands Reconstruction from a Single RGB Imagecited by 8
  18. 2023MeMaHand: Exploiting Mesh-Mano Interaction for Single Image Two-Hand Reconstructioncited by 8
  19. 2023HaMuCo: Hand Pose Estimation via Multiview Collaborative Self-Supervised Learningcited by 7
  20. 2024HandDGP: Camera-Space Hand Mesh Prediction with Differentiable Global Positioningcited by 7
  21. 2022End-to-end Weakly-supervised Single-stage Multiple 3D Hand Mesh Reconstruction from a Single RGB Imagecited by 6
  22. 2023Neural Voting Field for Camera-Space 3D Hand Pose Estimationcited by 6
  23. 2024Multi-view Hand Reconstruction with a Point-Embedded Transformercited by 6
  24. 2025UniHOPE: A Unified Approach for Hand-Only and Hand-Object Pose Estimationcited by 6
  25. 2021RealisticHands: A Hybrid Model for 3D Hand Reconstructioncited by 5
  26. 2022LWA-HAND: Lightweight Attention Hand for Interacting Hand Reconstructioncited by 5
  27. 2023CLIP-Hand3D: Exploiting 3D Hand Pose Estimation via Context-Aware Promptingcited by 5
  28. 2024Weakly-Supervised 3D Hand Reconstruction with Knowledge Prior and Uncertainty Guidancecited by 5
  29. 20243D Visibility-aware Generalizable Neural Radiance Fields for Interacting Handscited by 4
  30. 2024MLPHand: Real Time Multi-View 3D Hand Mesh Reconstruction via MLP Modelingcited by 3
  31. 2026EgoHandICL: Egocentric 3D Hand Reconstruction with In-Context Learningcited by 3
  32. 2026HGGT: Robust and Flexible 3D Hand Mesh Reconstruction from Uncalibrated Imagescited by 3
  33. 2026EgoForce: Forearm-Guided Camera-Space 3D Hand Pose from a Monocular Egocentric Cameracited by 3
  34. 2023Semi-supervised Hand Appearance Recovery via Structure Disentanglement and Dual Adversarial Discriminationcited by 2
  35. 2023Pyramid Deep Fusion Network for Two-Hand Reconstruction from RGB-D Imagescited by 2
  36. 2024SiMA-Hand: Boosting 3D Hand-Mesh Reconstruction by Single-to-Multi-View Adaptationcited by 2
  37. 2026GeoHand: Unlocking Prior Geometry Knowledge for Monocular 3D Hand Reconstructioncited by 2
  38. 2025Interaction-Aware 4D Gaussian Splatting for Dynamic Hand-Object Interaction Reconstructioncited by 1

50 most cited of 59 All 59 (JSON)