mlsanityData to 7 Oct 2026

HandOccNet: Occlusion-Robust 3D Hand Mesh Estimation Network

arXiv 2203.14564 ↗First posted 28 Mar 2022cs.CVcited by 95

Not on the map. Why?

Abstract (arXiv)

Hands are often severely occluded by objects, which makes 3D hand mesh estimation challenging. Previous works often have disregarded information at occluded regions. However, we argue that occluded regions have strong correlations with hands so that they can provide highly beneficial information for complete 3D hand mesh estimation. Thus, in this work, we propose a novel 3D hand mesh estimation network HandOccNet, that can fully exploits the information at occluded regions as a secondary means to enhance image features and make it much richer. To this end, we design two successive Transformer-based modules, called feature injecting transformer (FIT) and self- enhancing transformer (SET). FIT injects hand information into occluded region by considering their correlation. SET refines the output of FIT by using a self-attention mechanism. By injecting the hand information to the occluded region, our HandOccNet reaches the state-of-the-art performance on 3D hand mesh benchmarks that contain challenging hand-object occlusions. The codes are available in: https://github.com/namepllet/HandOccNet.

Key facts. Cited by 95 papers in the map (data through 7 Oct 2026). Builds on 32 of its 41 references that are in the map. First posted on arXiv 28 Mar 2022.

Builds on

32 of 41 references.

References · 32

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  5. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  6. 2020End-to-End Object Detection with Transformerscited by 7,384
  7. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  8. 2016Stacked Hourglass Networks for Human Pose Estimationcited by 913
  9. 2020End-to-End Human Pose and Mesh Reconstruction with Transformerscited by 417
  10. 2019Learning joint reconstruction of hands and manipulated objectscited by 377
  11. 2021DexYCB: A Benchmark for Capturing Hand Grasping of Objectscited by 320
  12. 2020I2L-MeshNet: Image-to-Lixel Prediction Network for Accurate 3D Human Pose and Mesh Estimation from a Single RGB Imagecited by 274
20 more
  1. 20213D Human Pose Estimation with Spatial and Temporal Transformerscited by 271
  2. 2020Pose2Mesh: Graph Convolutional Network for 3D Human Pose and Mesh Recovery from a 2D Human Posecited by 248
  3. 2020InterHand2.6M: A Dataset and Baseline for 3D Interacting Hand Pose Estimation from a Single RGB Imagecited by 244
  4. 2017First-Person Hand Action Benchmark with RGB-D Videos and 3D Hand Pose Annotationscited by 229
  5. 20193D Hand Shape and Pose Estimation from a Single RGB Imagecited by 174
  6. 2020Beyond Static Features for Temporally Consistent 3D Human Pose and Shape from a Videocited by 162
  7. 2020Weakly-Supervised Mesh-Convolutional Hand Reconstruction in the Wildcited by 146
  8. 2021Semi-Supervised 3D Hand-Object Poses Estimation with Interactions in Timecited by 140
  9. 2020Leveraging Photometric Consistency over Time for Sparsely Supervised Hand-Object Reconstructioncited by 139
  10. 2020TransPose: Keypoint Localization via Transformercited by 126
  11. 2017V2V-PoseNet: Voxel-to-Voxel Prediction Network for Accurate 3D Hand and Human Pose Estimation from a Single Depth Mapcited by 102
  12. 2020Weakly Supervised 3D Hand Pose Estimation via Biomechanical Constraintscited by 97
  13. 2017Multi-Context Attention for Human Pose Estimationcited by 66
  14. 2021Learning to Estimate Robust 3D Human Mesh from In-the-Wild Crowded Scenescited by 64
  15. 20203D Human Pose Estimation using Spatio-Temporal Networks with Explicit Occlusion Trainingcited by 54
  16. 2020DeepHandMesh: A Weakly-supervised Deep Encoder-Decoder Framework for High-fidelity Hand Mesh Modelingcited by 49
  17. 2018Multi-Scale Structure-Aware Network for Human Pose Estimationcited by 37
  18. 20213D Human Texture Estimation from a Single Image with Transformerscited by 35
  19. 2018How Robust is 3D Human Pose Estimation to Occlusion?cited by 23
  20. 2017Holistic Planimetric prediction to Local Volumetric prediction for 3D Human Pose Estimationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 7; 2023: 23; 2024: 27; 2025: 18; 2026: 20.

95 papers.

Sort:

By area:

  1. 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 477
  2. 2023Reconstructing Hands in 3D with Transformerscited by 298
  3. 2024WiLoR: End-to-end 3D Hand Localization and Reconstruction in-the-wildcited by 117
  4. 2024TACO: Benchmarking Generalizable Bimanual Tool-ACtion-Object Understandingcited by 85
  5. 2024DINO-X: A Unified Vision Model for Open-World Object Detection and Understandingcited by 85
  6. 2025HaWoR: World-Space Hand Motion Reconstruction from Egocentric Videoscited by 62
  7. 2024Hamba: Single-view 3D Hand Reconstruction with Graph-guided Bi-Scanning Mambacited by 45
  8. 2023PMP: Learning to Physically Interact with Environments using Part-wise Motion Priorscited by 38
  9. 2022Hierarchical Temporal Transformer for 3D Hand Pose Estimation and Action Recognition from Egocentric RGB Videoscited by 35
  10. 2024Benchmarks and Challenges in Pose Estimation for Egocentric Hand Interactions with Objectscited by 35
  11. 20233D Hand Pose Estimation in Everyday Egocentric Imagescited by 33
  12. 2023A Probabilistic Attention Model with Occlusion-aware Texture Regression for 3D Hand Reconstruction from a Single RGB Imagecited by 32
38 more
  1. 2022State of the Art in Dense Monocular Non-Rigid 3D Reconstructioncited by 30
  2. 2024A Simple Baseline for Efficient Hand Mesh Reconstructioncited by 27
  3. 2023HMP: Hand Motion Priors for Pose and Shape Estimation from Videocited by 23
  4. 2024Reconstructing Hand-Held Objects in 3D from Images and Videoscited by 23
  5. 2022Interacting Hand-Object Pose Estimation via Dense Mutual Attentioncited by 22
  6. 2025Learning Occlusion-Robust Vision Transformers for Real-Time UAV Trackingcited by 22
  7. 2023Deformer: Dynamic Fusion Transformer for Robust Hand Pose Estimationcited by 21
  8. 2025Predicting 4D Hand Trajectory from Monocular Videoscited by 19
  9. 2023Diverse 3D Hand Gesture Prediction from Body Dynamics by Bilateral Hand Disentanglementcited by 18
  10. 2022THOR-Net: End-to-end Graformer-based Realistic Two Hands and Object Reconstruction with Self-supervisioncited by 16
  11. 2023SHOWMe: Benchmarking Object-agnostic Hand-Object 3D Reconstructioncited by 16
  12. 2025The Invisible EgoHand: 3D Hand Forecasting through EgoBody Pose Estimationcited by 16
  13. 2023POV-Surgery: A Dataset for Egocentric Hand and Tool Pose Estimation During Surgical Activitiescited by 14
  14. 2024HOISDF: Constraining 3D Hand-Object Pose Estimation with Global Signed Distance Fieldscited by 14
  15. 2024HandBooster: Boosting 3D Hand-Mesh Reconstruction by Conditional Synthesis and Sampling of Hand-Object Interactionscited by 13
  16. 2024HandDiff: 3D Hand Pose Estimation with Diffusion on Image-Point Cloudcited by 12
  17. 2025Learning Dense Hand Contact Estimation from Imbalanced Datacited by 12
  18. 2022Identity-Aware Hand Mesh Estimation and Personalization from RGB Imagescited by 11
  19. 2023Recovering 3D Hand Mesh Sequence from a Single Blurry Image: A New Dataset and Temporal Unfoldingcited by 10
  20. 2023HandNeRF: Learning to Reconstruct Hand-Object Interaction Scene from a Single RGB Imagecited by 10
  21. 2023POEM: Reconstructing Hand in a Point Embedded Multi-view Stereocited by 9
  22. 2024MS-MANO: Enabling Hand Pose Tracking with Biomechanical Constraintscited by 9
  23. 2024DICE: End-to-end Deformation Capture of Hand-Face Interactions from a Single Imagecited by 9
  24. 2024HandOS: 3D Hand Reconstruction in One Stagecited by 9
  25. 2023DiffHand: End-to-End Hand Mesh Reconstruction via Diffusion Modelscited by 7
  26. 2023Ins-HOI: Instance Aware Human-Object Interactions Recoverycited by 7
  27. 2024GestFormer: Multiscale Wavelet Pooling Transformer Network for Dynamic Hand Gesture Recognitioncited by 7
  28. 2024HandDGP: Camera-Space Hand Mesh Prediction with Differentiable Global Positioningcited by 7
  29. 2025SiMHand: Mining Similar Hands for Large-Scale 3D Hand Pose Pre-trainingcited by 7
  30. 2025Perceiving and Acting in First-Person: A Dataset and Benchmark for Egocentric Human-Object-Human Interactionscited by 7
  31. 2023Neural Voting Field for Camera-Space 3D Hand Pose Estimationcited by 6
  32. 2024Multi-view Hand Reconstruction with a Point-Embedded Transformercited by 6
  33. 2025UniHOPE: A Unified Approach for Hand-Only and Hand-Object Pose Estimationcited by 6
  34. 2023PHRIT: Parametric Hand Representation with Implicit Templatecited by 5
  35. 2023CLIP-Hand3D: Exploiting 3D Hand Pose Estimation via Context-Aware Promptingcited by 5
  36. 2024Weakly-Supervised 3D Hand Reconstruction with Knowledge Prior and Uncertainty Guidancecited by 5
  37. 2024MaskHand: Generative Masked Modeling for Robust Hand Mesh Reconstruction in the Wildcited by 5
  38. 2025Diffusion-based 3D Hand Motion Recovery with Intuitive Physicscited by 5

50 most cited of 95 All 95 (JSON)