mlsanityData to 7 Oct 2026

HaMuCo: Hand Pose Estimation via Multiview Collaborative Self-Supervised Learning

arXiv 2302.00988 ↗First posted 2 Feb 2023cs.CVcited by 7

Not on the map. Why?

Abstract (arXiv)

Recent advancements in 3D hand pose estimation have shown promising results, but its effectiveness has primarily relied on the availability of large-scale annotated datasets, the creation of which is a laborious and costly process. To alleviate the label-hungry limitation, we propose a self-supervised learning framework, HaMuCo, that learns a single-view hand pose estimator from multi-view pseudo 2D labels. However, one of the main challenges of self-supervised learning is the presence of noisy labels and the ``groupthink'' effect from multiple views. To overcome these issues, we introduce a cross-view interaction network that distills the single-view estimator by utilizing the cross-view correlated features and enforcing multi-view consistency to achieve collaborative learning. Both the single-view estimator and the cross-view interaction network are trained jointly in an end-to-end manner. Extensive experiments show that our method can achieve state-of-the-art performance on multi-view self-supervised hand pose estimation. Furthermore, the proposed cross-view interaction network can also be applied to hand pose estimation from multi-view input and outperforms previous methods under the same settings.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 52 of its 69 references that are in the map. First posted on arXiv 2 Feb 2023.

Builds on

52 of 69 references.

References · 52

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,061
  3. 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 649
  4. 2020End-to-End Human Pose and Mesh Reconstruction with Transformerscited by 417
  5. 2022Assembly101: A Large-Scale Multi-View Video Dataset for Understanding Procedural Activitiescited by 284
  6. 2020I2L-MeshNet: Image-to-Lixel Prediction Network for Accurate 3D Human Pose and Mesh Estimation from a Single RGB Imagecited by 274
  7. 2019FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Imagescited by 271
  8. 2021Mesh Graphormercited by 264
  9. 2021H2O: Two Hands Manipulating Objects for First Person Interaction Recognitioncited by 251
  10. 2020Pose2Mesh: Graph Convolutional Network for 3D Human Pose and Mesh Recovery from a 2D Human Posecited by 248
  11. 2020InterHand2.6M: A Dataset and Baseline for 3D Interacting Hand Pose Estimation from a Single RGB Imagecited by 244
  12. 2017Learning to Estimate 3D Hand Pose from Single RGB Imagescited by 234
38 more
  1. 2017Hand Keypoint Detection in Single Images using Multiview Bootstrappingcited by 231
  2. 20193D Hand Shape and Pose from Images in the Wildcited by 190
  3. 20193D Hand Shape and Pose Estimation from a Single RGB Imagecited by 174
  4. 2019Learnable Triangulation of Human Posecited by 160
  5. 2017GANerated Hands for Real-time 3D Hand Tracking from Monocular RGBcited by 147
  6. 2020Weakly-Supervised Mesh-Convolutional Hand Reconstruction in the Wildcited by 146
  7. 2019End-to-end Hand Mesh Recovery from a Monocular RGB Imagecited by 124
  8. 2020Epipolar Transformerscited by 117
  9. 2019Pushing the Envelope for RGB-based Dense 3D Hand Pose Estimation via Neural Renderingcited by 115
  10. 2020HOPE-Net: A Graph-based Model for Hand-Object Pose Estimationcited by 112
  11. 2018Hand Pose Estimation via Latent 2.5D Heatmap Regressioncited by 111
  12. 2019Pixel2Mesh++: Multi-View 3D Mesh Generation via Deformationcited by 103
  13. 2017V2V-PoseNet: Voxel-to-Voxel Prediction Network for Accurate 3D Hand and Human Pose Estimation from a Single Depth Mapcited by 102
  14. 2019Self-Supervised Learning of 3D Human Pose using Multi-view Geometrycited by 98
  15. 2020Weakly Supervised 3D Hand Pose Estimation via Biomechanical Constraintscited by 97
  16. 2019Cross View Fusion for 3D Human Pose Estimationcited by 90
  17. 2018Cross-modal Deep Variational Hand Pose Estimationcited by 89
  18. 2022Interacting Attention Graph for Single Image Two-Hand Reconstructioncited by 87
  19. 2019Fast and Robust Multi-Person 3D Pose Estimation from Multiple Viewscited by 83
  20. 2021MobRecon: Mobile-Friendly Hand Mesh Reconstruction from Monocular Imagecited by 74
  21. 2018Learning Monocular 3D Human Pose Estimation from Multi-view Imagescited by 70
  22. 2020Weakly-Supervised 3D Human Pose Learning via Multi-view Images in the Wildcited by 66
  23. 2020CanonPose: Self-Supervised Monocular 3D Human Pose Estimation in the Wildcited by 65
  24. 2021Model-based 3D Hand Reconstruction via Self-Supervised Learningcited by 65
  25. 2021Camera-Space Hand Mesh Recovery via Semantic Aggregation and Adaptive 2D-1D Registrationcited by 59
  26. 2020Lightweight Multi-View 3D Pose Estimation through Camera-Disentangled Representationcited by 57
  27. 2021I2UV-HandNet: Image-to-UV Prediction Network for Accurate and High-fidelity 3D Hand Mesh Modelingcited by 52
  28. 2017Harvesting Multiple Views for Marker-less 3D Human Pose Annotationscited by 48
  29. 2022UmeTrack: Unified multi-view end-to-end hand tracking for VRcited by 48
  30. 2018Disentangling Latent Hands for Image Synthesis and Pose Estimationcited by 44
  31. 2021Towards Accurate Alignment in Real-time 3D Hand-Mesh Reconstructioncited by 44
  32. 2020AdaFuse: Adaptive Multiview Fusion for Accurate Human Pose Estimation in the Wildcited by 40
  33. 2021Learning to Disambiguate Strongly Interacting Hands via Probabilistic Per-pixel Part Segmentationcited by 40
  34. 2021Contrastive Representation Learning for Hand Shape Estimationcited by 34
  35. 2021Hand Image Understanding via Deep Multi-Task Learningcited by 31
  36. 2016Robust 3D Hand Pose Estimation in Single Depth Images: from Single-View CNN to Multi-View CNNscited by 29
  37. 2022PPT: token-Pruned Pose Transformer for monocular and multi-view human pose estimationcited by 27
  38. 2021Generalizable Human Pose Triangulationcited by 24

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 2; 2026: 4.

7 papers.

  1. 2024Dense Hand-Object(HO) GraspNet with Full Grasping Taxonomy and Dynamicscited by 15
  2. 2025SiMHand: Mining Similar Hands for Large-Scale 3D Hand Pose Pre-trainingcited by 7
  3. 2026Towards Egocentric 3D Hand Pose Estimation in Unseen Domainscited by 2
  4. 2025Learning Transformation-Isomorphic Latent Space for Accurate Hand Pose Estimationcited by 0
  5. 2026UST-Hand: An Uncertainty-aware Spatiotemporal Point Cloud Interaction Network for 3D Self-supervised Hand Pose Estimationcited by 0
  6. 2026VEPHand: View-Efficient Photometric Hand Performance Capture at Scalecited by 0
  7. 2026HandMvNet: Real-Time 3D Hand Pose Estimation Using Multi-View Cross-Attention Fusioncited by 0