mlsanityData to 14 Oct 2026

Monocular 3D Hand Pose Estimation with Implicit Camera Alignment

arXiv 2506.11133 ↗First posted 10 Jun 2025cs.CV cs.GR cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Estimating the 3D hand articulation from a single color image is an important problem with applications in Augmented Reality (AR), Virtual Reality (VR), Human-Computer Interaction (HCI), and robotics. Apart from the absence of depth information, occlusions, articulation complexity, and the need for camera parameters knowledge pose additional challenges. In this work, we propose an optimization pipeline for estimating the 3D hand articulation from 2D keypoint input, which includes a keypoint alignment step and a fingertip loss to overcome the need to know or estimate the camera parameters. We evaluate our approach on the EgoDexter and Dexter+Object benchmarks to showcase that it performs competitively with the state-of-the-art, while also demonstrating its robustness when processing "in-the-wild" images without any prior camera knowledge. Our quantitative analysis highlights the sensitivity of the 2D keypoint estimation accuracy, despite the use of hand priors. Code is available at the project page https://cpantazop.github.io/HandRepo/

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 33 references that are in the map. First posted on arXiv 10 Jun 2025.

Builds on

19 of 33 references.

References · 19

  1. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
  2. 2019MediaPipe: A Framework for Building Perception Pipelinescited by 583
  3. 2019FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Imagescited by 271
  4. 2017Learning to Estimate 3D Hand Pose from Single RGB Imagescited by 234
  5. 2017Hand Keypoint Detection in Single Images using Multiview Bootstrappingcited by 231
  6. 20193D Hand Shape and Pose from Images in the Wildcited by 190
  7. 20193D Hand Shape and Pose Estimation from a Single RGB Imagecited by 174
  8. 2018Monocular Total Capture: Posing Face, Body, and Hands in the Wildcited by 162
  9. 2017GANerated Hands for Real-time 3D Hand Tracking from Monocular RGBcited by 147
  10. 2020Weakly-Supervised Mesh-Convolutional Hand Reconstruction in the Wildcited by 146
  11. 2019End-to-end Hand Mesh Recovery from a Monocular RGB Imagecited by 124
  12. 2015Capturing Hands in Action using Discriminative Salient Points and Physics Simulationcited by 115
7 more
  1. 2019Pushing the Envelope for RGB-based Dense 3D Hand Pose Estimation via Neural Renderingcited by 115
  2. 2018Hand Pose Estimation via Latent 2.5D Heatmap Regressioncited by 111
  3. 2020Monocular Real-time Hand Shape and Motion Capture using Multi-modal Datacited by 106
  4. 2018Cross-modal Deep Variational Hand Pose Estimationcited by 89
  5. 2017Real-time Hand Tracking under Occlusion from an Egocentric RGB-D Sensorcited by 84
  6. 2016Real-time Joint Tracking of a Hand Manipulating an Object from RGB-D Inputcited by 56
  7. 2017Using a single RGB frame for real time 3D hand pose estimation in the wildcited by 39

Built on by

Not cited yet.