GeoHand: Unlocking Prior Geometry Knowledge for Monocular 3D Hand Reconstruction
Not on the map. Why?
Abstract (arXiv)
Monocular 3D hand reconstruction is intrinsically a geometric problem, yet RGB appearance features alone often struggle to resolve severe ambiguities caused by self-occlusions and hand-object interactions. While introducing depth can explicitly provide spatial cues, raw sensor-captured depth maps are extensively noisy and incomplete, limiting their usefulness for fine-grained hand reconstruction. To bridge this gap, we propose GeoHand, a novel framework that unlocks high-quality geometric priors from a frozen foundational monocular geometry estimator (MoGe2). Recognizing that these priors are oriented toward general scenes, we introduce a map-level GeoAdapter to recalibrate the spatial features, specifically adapting them for detailed hand reconstruction. Furthermore, to systematically integrate these adapted priors without overwhelming intrinsic RGB appearance cues, we employ a gated cross-modal token fusion strategy. Finally, to secure precise local articulation, we design a Keypoint-Queried Iterative Refiner (KQIR) that uses projected joint locations to query geometry-aware image features for spatial correction. By combining global geometric disambiguation with local refinement in a unified pipeline, GeoHand achieves state-of-the-art performance on FreiHAND, DexYCB, and HO3Dv3, especially under severe occlusions and hand-object interactions.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 59 of its 69 references that are in the map. First posted on arXiv 17 May 2026.
Builds on
59 of 69 references.
References · 59
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
- 2017End-to-end Recovery of Human Shape and Posecited by 885
- 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 695
- 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 627
- 2018DensePose: Dense Human Pose Estimation In The Wildcited by 575
- 2020End-to-End Human Pose and Mesh Reconstruction with Transformerscited by 418
38 more
- 2020GRAB: A Dataset of Whole-Body Human Grasping of Objectscited by 405
- 2019Learning joint reconstruction of hands and manipulated objectscited by 378
- 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 327
- 2021DexYCB: A Benchmark for Capturing Hand Grasping of Objectscited by 325
- 2023Reconstructing Hands in 3D with Transformerscited by 306
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 299
- 2020I2L-MeshNet: Image-to-Lixel Prediction Network for Accurate 3D Human Pose and Mesh Estimation from a Single RGB Imagecited by 274
- 2019FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Imagescited by 271
- 2019Convolutional Mesh Regression for Single-Image Human Shape Reconstructioncited by 270
- 2021Mesh Graphormercited by 265
- 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 261
- 2021H2O: Two Hands Manipulating Objects for First Person Interaction Recognitioncited by 254
- 2020Pose2Mesh: Graph Convolutional Network for 3D Human Pose and Mesh Recovery from a 2D Human Posecited by 248
- 2017Learning to Estimate 3D Hand Pose from Single RGB Imagescited by 234
- 2017First-Person Hand Action Benchmark with RGB-D Videos and 3D Hand Pose Annotationscited by 230
- 20193D Hand Shape and Pose from Images in the Wildcited by 190
- 2020ContactPose: A Dataset of Grasps with Object Contact and Hand Posecited by 183
- 2020Grasping Field: Learning Implicit Representations for Human Graspscited by 179
- 20193D Hand Shape and Pose Estimation from a Single RGB Imagecited by 174
- 2021FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and Integrationcited by 169
- 2021Probabilistic Modeling for Human Mesh Recoverycited by 153
- 2017GANerated Hands for Real-time 3D Hand Tracking from Monocular RGBcited by 147
- 2020Weakly-Supervised Mesh-Convolutional Hand Reconstruction in the Wildcited by 146
- 2021ContactOpt: Optimizing Contact to Improve Graspscited by 139
- 2022DexGraspNet: A Large-Scale Robotic Dexterous Grasp Dataset for General Objects Based on Simulationcited by 137
- 2022OakInk: A Large-scale Knowledge Repository for Understanding Hand-Object Interactioncited by 131
- 2019End-to-end Hand Mesh Recovery from a Monocular RGB Imagecited by 124
- 2024WiLoR: End-to-end 3D Hand Localization and Reconstruction in-the-wildcited by 124
- 2019Pushing the Envelope for RGB-based Dense 3D Hand Pose Estimation via Neural Renderingcited by 115
- 2018Hand Pose Estimation via Latent 2.5D Heatmap Regressioncited by 111
- 2017V2V-PoseNet: Voxel-to-Voxel Prediction Network for Accurate 3D Hand and Human Pose Estimation from a Single Depth Mapcited by 102
- 2022HandOccNet: Occlusion-Robust 3D Hand Mesh Estimation Networkcited by 96
- 2018Cross-modal Deep Variational Hand Pose Estimationcited by 89
- 2022Interacting Attention Graph for Single Image Two-Hand Reconstructioncited by 87
- 2022Cross-Attention of Disentangled Modalities for 3D Human Mesh Recovery with Transformerscited by 81
- 2021Camera-Space Hand Mesh Recovery via Semantic Aggregation and Adaptive 2D-1D Registrationcited by 59
- 2022Collaborative Learning for Hand and Object Reconstruction with Attention-guided Graph Convolutioncited by 54
- 2024Hamba: Single-view 3D Hand Reconstruction with Graph-guided Bi-Scanning Mambacited by 45
50 most cited of 59 All 59 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.