mlsanityData to 7 Oct 2026

3D Hand Mesh Recovery from Monocular RGB in Camera Space

arXiv 2405.07167 ↗First posted 12 May 2024cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

With the rapid advancement of technologies such as virtual reality, augmented reality, and gesture control, users expect interactions with computer interfaces to be more natural and intuitive. Existing visual algorithms often struggle to accomplish advanced human-computer interaction tasks, necessitating accurate and reliable absolute spatial prediction methods. Moreover, dealing with complex scenes and occlusions in monocular images poses entirely new challenges. This study proposes a network model that performs parallel processing of root-relative grids and root recovery tasks. The model enables the recovery of 3D hand meshes in camera space from monocular RGB images. To facilitate end-to-end training, we utilize an implicit learning approach for 2D heatmaps, enhancing the compatibility of 2D cues across different subtasks. Incorporate the Inception concept into spectral graph convolutional network to explore relative mesh of root, and integrate it with the locally detailed and globally attentive method designed for root recovery exploration. This approach improves the model's predictive performance in complex environments and self-occluded scenes. Through evaluation on the large-scale hand dataset FreiHAND, we have demonstrated that our proposed model is comparable with state-of-the-art models. This study contributes to the advancement of techniques for accurate and reliable absolute spatial prediction in various human-computer interaction applications.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 35 of its 43 references that are in the map. First posted on arXiv 12 May 2024.

Builds on

35 of 43 references.

References · 35

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2017Squeeze-and-Excitation Networkscited by 4,763
  5. 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
  6. 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 972
  7. 2016Stacked Hourglass Networks for Human Pose Estimationcited by 913
  8. 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 721
  9. 2020AdaBins: Depth Estimation using Adaptive Binscited by 596
  10. 2020End-to-End Human Pose and Mesh Reconstruction with Transformerscited by 417
  11. 2019From Big to Small: Multi-Scale Local Planar Guidance for Monocular Depth Estimationcited by 379
  12. 2019Learning joint reconstruction of hands and manipulated objectscited by 377
23 more
  1. 2013DeepPose: Human Pose Estimation via Deep Neural Networkscited by 305
  2. 2020I2L-MeshNet: Image-to-Lixel Prediction Network for Accurate 3D Human Pose and Mesh Estimation from a Single RGB Imagecited by 274
  3. 2019FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Imagescited by 271
  4. 2020Pose2Mesh: Graph Convolutional Network for 3D Human Pose and Mesh Recovery from a 2D Human Posecited by 248
  5. 2017Learning to Estimate 3D Hand Pose from Single RGB Imagescited by 234
  6. 20193D Hand Shape and Pose from Images in the Wildcited by 190
  7. 2022Embodied Hands: Modeling and Capturing Hands and Bodies Togethercited by 179
  8. 20193D Hand Shape and Pose Estimation from a Single RGB Imagecited by 174
  9. 2020Weakly-Supervised Mesh-Convolutional Hand Reconstruction in the Wildcited by 146
  10. 2019Camera Distance-aware Top-down Approach for 3D Multi-person Pose Estimation from a Single RGB Imagecited by 131
  11. 2018Hand Pose Estimation via Latent 2.5D Heatmap Regressioncited by 111
  12. 2020Monocular Real-time Hand Shape and Motion Capture using Multi-modal Datacited by 106
  13. 2021Graph Stacked Hourglass Networks for 3D Human Pose Estimationcited by 94
  14. 2021MobRecon: Mobile-Friendly Hand Mesh Reconstruction from Monocular Imagecited by 74
  15. 2021Camera-Space Hand Mesh Recovery via Semantic Aggregation and Adaptive 2D-1D Registrationcited by 59
  16. 2022Global-Local Path Networks for Monocular Depth Estimation with Vertical CutDepthcited by 58
  17. 2021Towards unconstrained joint hand-object reconstruction from RGB videoscited by 57
  18. 2018A Simple Approach to Intrinsic Correspondence Learning on Unstructured 3D Meshescited by 39
  19. 2020HDNet: Human Depth Estimation for Multi-Person Camera-Space Localizationcited by 20
  20. 2022Identity-Aware Hand Mesh Estimation and Personalization from RGB Imagescited by 11
  21. 2020Detailed 3D Human Body Reconstruction from Multi-view Images Combining Voxel Super-Resolution and Learned Implicit Representationcited by 6
  22. 2023Neural Voting Field for Camera-Space 3D Hand Pose Estimationcited by 6
  23. 2019Pixel-wise Regression: 3D Hand Pose Estimation via Spatial-form Representation and Differentiable Decodercited by 2

Built on by

Not cited yet.