mlsanityData to 14 Oct 2026

Efficient Annotation and Learning for 3D Hand Pose Estimation: A Survey

arXiv 2206.02257 ↗First posted 5 Jun 2022cs.CVcited by 17

Not on the map. Why?

Abstract (arXiv)

In this survey, we present a systematic review of 3D hand pose estimation from the perspective of efficient annotation and learning. 3D hand pose estimation has been an important research area owing to its potential to enable various applications, such as video understanding, AR/VR, and robotics. However, the performance of models is tied to the quality and quantity of annotated 3D hand poses. Under the status quo, acquiring such annotated 3D hand poses is challenging, e.g., due to the difficulty of 3D annotation and the presence of occlusion. To reveal this problem, we review the pros and cons of existing annotation methods classified as manual, synthetic-model-based, hand-sensor-based, and computational approaches. Additionally, we examine methods for learning 3D hand poses when annotated data are scarce, including self-supervised pretraining, semi-supervised learning, and domain adaptation. Based on the study of efficient annotation and learning, we further discuss limitations and possible future directions in this field.

Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Builds on 61 of its 115 references that are in the map. First posted on arXiv 5 Jun 2022.

Builds on

61 of 115 references.

References · 61

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  3. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  4. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
  5. 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,917
  6. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
  7. 2017Adversarial Discriminative Domain Adaptationcited by 1,311
  8. 2020GRAB: A Dataset of Whole-Body Human Grasping of Objectscited by 405
  9. 2019Learning joint reconstruction of hands and manipulated objectscited by 378
  10. 2021DexYCB: A Benchmark for Capturing Hand Grasping of Objectscited by 325
  11. 2022Assembly101: A Large-Scale Multi-View Video Dataset for Understanding Procedural Activitiescited by 287
  12. 2019FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Imagescited by 271
38 more
  1. 2021H2O: Two Hands Manipulating Objects for First Person Interaction Recognitioncited by 254
  2. 2020InterHand2.6M: A Dataset and Baseline for 3D Interacting Hand Pose Estimation from a Single RGB Imagecited by 245
  3. 2017Learning to Estimate 3D Hand Pose from Single RGB Imagescited by 234
  4. 2017Hand Keypoint Detection in Single Images using Multiview Bootstrappingcited by 231
  5. 2017First-Person Hand Action Benchmark with RGB-D Videos and 3D Hand Pose Annotationscited by 230
  6. 2021DexMV: Imitation Learning for Dexterous Manipulation from Human Videoscited by 206
  7. 20193D Hand Shape and Pose from Images in the Wildcited by 190
  8. 2022Embodied Hands: Modeling and Capturing Hands and Bodies Togethercited by 181
  9. 20193D Hand Shape and Pose Estimation from a Single RGB Imagecited by 174
  10. 2019Learnable Triangulation of Human Posecited by 161
  11. 2017GANerated Hands for Real-time 3D Hand Tracking from Monocular RGBcited by 147
  12. 2020Weakly-Supervised Mesh-Convolutional Hand Reconstruction in the Wildcited by 146
  13. 2019H+O: Unified Egocentric Recognition of 3D Hand-Object Poses and Interactionscited by 141
  14. 2021Semi-Supervised 3D Hand-Object Poses Estimation with Interactions in Timecited by 141
  15. 2021Keypoint Transformer: Solving Joint Identification in Challenging Hands and Object Interactions for Accurate 3D Pose Estimationcited by 123
  16. 2019DexPilot: Vision Based Teleoperation of Dexterous Robotic Hand-Arm Systemcited by 114
  17. 2018Hand Pose Estimation via Latent 2.5D Heatmap Regressioncited by 111
  18. 2020Weakly Supervised 3D Hand Pose Estimation via Biomechanical Constraintscited by 97
  19. 2018Cross-modal Deep Variational Hand Pose Estimationcited by 89
  20. 2022DexVIP: Learning Dexterous Grasping with Human Hand Pose Priors from Videocited by 89
  21. 2017Real-time Hand Tracking under Occlusion from an Egocentric RGB-D Sensorcited by 84
  22. 2021Real-time Pose and Shape Reconstruction of Two Interacting Hands With a Single Depth Cameracited by 70
  23. 2021Model-based 3D Hand Reconstruction via Self-Supervised Learningcited by 65
  24. 2016Real-time Joint Tracking of a Hand Manipulating an Object from RGB-D Inputcited by 56
  25. 2019A2J: Anchor-to-Joint Regression Network for 3D Articulated Pose Estimation from a Single Depth Imagecited by 56
  26. 2017BigHand2.2M Benchmark: Hand Pose Dataset and State of the Art Analysiscited by 46
  27. 2021Regressive Domain Adaptation for Unsupervised Keypoint Detectioncited by 34
  28. 2021Contrastive Representation Learning for Hand Shape Estimationcited by 34
  29. 2021Generalizable Human Pose Triangulationcited by 24
  30. 2016Training a Feedback Loop for Hand Pose Estimationcited by 21
  31. 2017Depth-Based 3D Hand Pose Estimation: From Current Achievements to Future Goalscited by 21
  32. 20143D Hand Pose Detection in Egocentric RGB-D Imagescited by 17
  33. 2020AWR: Adaptive Weighting Regression for 3D Hand Pose Estimationcited by 17
  34. 2015Depth-based hand pose estimation: methods, data, and challengescited by 16
  35. 2016Pose for Action - Action for Posecited by 16
  36. 2020MVHM: A Large-Scale Multi-View Hand Mesh Benchmark for Accurate 3D Hand Pose Estimationcited by 15
  37. 2022Domain Adaptive Hand Keypoint and Pixel Localization in the Wildcited by 14
  38. 2018Domain Transfer for 3D Pose Estimation from Color Images without Manual Annotationscited by 12

50 most cited of 61 All 61 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 3; 2024: 5; 2025: 5; 2026: 4.

17 papers.

Sort:

By area:

  1. 2023AssemblyHands: Towards Egocentric Activity Understanding via 3D Hand Pose Estimationcited by 64
  2. 2024Benchmarks and Challenges in Pose Estimation for Egocentric Hand Interactions with Objectscited by 35
  3. 2024Markerless Multi-view 3D Human Pose Estimation: a surveycited by 9
  4. 2025SiMHand: Mining Similar Hands for Large-Scale 3D Hand Pose Pre-trainingcited by 7
  5. 2023Deep Learning Approaches for Seizure Video Analysis: A Reviewcited by 6
  6. 2024Benchmarking 2D Egocentric Hand Pose Datasetscited by 3
  7. 2024Posture-Informed Muscular Force Learning for Robust Hand Pressure Estimationcited by 3
  8. 2025Leveraging RGB Images for Pre-Training of Event-Based Hand Pose Estimationcited by 3
  9. 2024Pre-Training for 3D Hand Pose Estimation with Contrastive Learning on Large-Scale Hand Images in the Wildcited by 2
  10. 2025Generative Modeling of Shape-Dependent Self-Contact Human Posescited by 2
  11. 2025Affordance-Guided Diffusion Prior for 3D Hand Reconstructioncited by 2
  12. 2026AVI-HT: Adaptive Vision-IMU Fusion for 3D Hand Trackingcited by 2
5 more
  1. 2026Towards in-the-wild Egocentric 3D Hand-Object Pose Estimationcited by 2
  2. 2026Hand Visibility Detector: Per-Keypoint Visibility Estimation for Handscited by 2
  3. 2026Hand-Object Interaction in the Age of Large Foundation Models:Reconstruction, Generation, and Embodied Transfercited by 1
  4. 2023Mesh Represented Recycle Learning for 3D Hand Pose and Mesh Estimationcited by 0
  5. 2025DF-Mamba: Deformable State Space Modeling for 3D Hand Pose Estimation in Interactionscited by 0