mlsanityData to 14 Oct 2026

3D Interacting Hand Pose Estimation by Hand De-occlusion and Removal

arXiv 2207.11061 ↗First posted 22 Jul 2022cs.CVcited by 36

Not on the map. Why?

Abstract (arXiv)

Estimating 3D interacting hand pose from a single RGB image is essential for understanding human actions. Unlike most previous works that directly predict the 3D poses of two interacting hands simultaneously, we propose to decompose the challenging interacting hand pose estimation task and estimate the pose of each hand separately. In this way, it is straightforward to take advantage of the latest research progress on the single-hand pose estimation system. However, hand pose estimation in interacting scenarios is very challenging, due to (1) severe hand-hand occlusion and (2) ambiguity caused by the homogeneous appearance of hands. To tackle these two challenges, we propose a novel Hand De-occlusion and Removal (HDR) framework to perform hand de-occlusion and distractor removal. We also propose the first large-scale synthetic amodal hand dataset, termed Amodal InterHand Dataset (AIH), to facilitate model training and promote the development of the related research. Experiments show that the proposed method significantly outperforms previous state-of-the-art interacting hand pose estimation approaches. Codes and data are available at https://github.com/MengHao666/HDR.

Key facts. Cited by 36 papers in the map (data through 14 Oct 2026). Builds on 27 of its 41 references that are in the map. First posted on arXiv 22 Jul 2022.

Builds on

27 of 41 references.

References · 27

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
  3. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
  4. 2021PVT v2: Improved Baselines with Pyramid Vision Transformercited by 751
  5. 2018Image Inpainting for Irregular Holes Using Partial Convolutionscited by 505
  6. 2020End-to-End Human Pose and Mesh Reconstruction with Transformerscited by 418
  7. 2020Pose2Mesh: Graph Convolutional Network for 3D Human Pose and Mesh Recovery from a 2D Human Posecited by 248
  8. 2020InterHand2.6M: A Dataset and Baseline for 3D Interacting Hand Pose Estimation from a Single RGB Imagecited by 245
  9. 2017Learning to Estimate 3D Hand Pose from Single RGB Imagescited by 234
  10. 20193D Hand Shape and Pose from Images in the Wildcited by 190
  11. 2020Weakly-Supervised Mesh-Convolutional Hand Reconstruction in the Wildcited by 146
  12. 2015Capturing Hands in Action using Discriminative Salient Points and Physics Simulationcited by 115
15 more
  1. 2019Pushing the Envelope for RGB-based Dense 3D Hand Pose Estimation via Neural Renderingcited by 115
  2. 2018Hand Pose Estimation via Latent 2.5D Heatmap Regressioncited by 111
  3. 2020Monocular Real-time Hand Shape and Motion Capture using Multi-modal Datacited by 106
  4. 2015Semantic Amodal Segmentationcited by 103
  5. 2020Self-Supervised Scene De-occlusioncited by 96
  6. 2018Cross-modal Deep Variational Hand Pose Estimationcited by 89
  7. 2021Real-time Pose and Shape Reconstruction of Two Interacting Hands With a Single Depth Cameracited by 70
  8. 2016Amodal Instance Segmentationcited by 63
  9. 2017SeGAN: Segmenting and Generating the Invisiblecited by 60
  10. 2021Learning to Disambiguate Strongly Interacting Hands via Probabilistic Per-pixel Part Segmentationcited by 40
  11. 2021Human De-occlusion: Invisible Perception and Recovery for Humanscited by 31
  12. 2020Two-hand Global 3D Pose Estimation Using Monocular RGBcited by 27
  13. 2021Monocular 3D Reconstruction of Interacting Hands via Collision-Aware Factorized Refinementscited by 27
  14. 2019Visualizing the Invisible: Occluded Vehicle Segmentation and Recoverycited by 24
  15. 2020BiHand: Recovering Hand Mesh with Multi-stage Bisected Hourglass Networkscited by 23

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 1; 2023: 15; 2024: 8; 2025: 7; 2026: 5.

36 papers.

Sort:

By area:

  1. 2023Reconstructing Hands in 3D with Transformerscited by 306
  2. 2023HOLD: Category-agnostic 3D Reconstruction of Interacting Hands and Objects from Videocited by 78
  3. 2023gSDF: Geometry-Driven Signed Distance Functions for 3D Hand-Object Reconstructioncited by 50
  4. 2023Bringing Inputs to Shared Domains for 3D Interacting Hands Recovery in the Wildcited by 36
  5. 2022Hierarchical Temporal Transformer for 3D Hand Pose Estimation and Action Recognition from Egocentric RGB Videoscited by 35
  6. 2023A Dataset of Relighted 3D Interacting Handscited by 35
  7. 2024Benchmarks and Challenges in Pose Estimation for Egocentric Hand Interactions with Objectscited by 35
  8. 2024Reconstructing Hand-Held Objects in 3D from Images and Videoscited by 24
  9. 2023Reconstructing Interacting Hands with Interaction Prior from Monocular Imagescited by 18
  10. 2025MagicHOI: Leveraging 3D Priors for Accurate Hand-object Reconstruction from Short Monocular Video Clipscited by 17
  11. 2023RenderIH: A Large-scale Synthetic Dataset for 3D Interacting Hand Pose Estimationcited by 16
  12. 2023A2J-Transformer: Anchor-to-Joint Transformer Network for 3D Interacting Hand Pose Estimation from a Single RGB Imagecited by 15
24 more
  1. 2023HandDiffuse: Generative Controllers for Two-Hand Interactions via Diffusion Modelscited by 13
  2. 2025HORT: Monocular Hand-held Objects Reconstruction with Transformerscited by 11
  3. 2023Recovering 3D Hand Mesh Sequence from a Single Blurry Image: A New Dataset and Temporal Unfoldingcited by 10
  4. 2024AttentionHand: Text-driven Controllable Hand Image Generation for 3D Hand Reconstruction in the Wildcited by 10
  5. 2024PEAR: Phrase-Based Hand-Object Interaction Anticipationcited by 10
  6. 2023You Only Learn One Query: Learning Unified Human Query for Single-Stage Multi-Person Multi-Task Human-Centric Perceptioncited by 9
  7. 2023Decoupled Iterative Refinement Framework for Interacting Hands Reconstruction from a Single RGB Imagecited by 8
  8. 2024Weakly-Supervised 3D Hand Reconstruction with Knowledge Prior and Uncertainty Guidancecited by 5
  9. 20243D Visibility-aware Generalizable Neural Radiance Fields for Interacting Handscited by 4
  10. 2026PAD-Hand: Physics-Aware Diffusion for Hand Motion Recoverycited by 4
  11. 2023Denoising Diffusion for 3D Hand Pose Estimation from Imagescited by 2
  12. 2024V-Hands: Touchscreen-based Hand Tracking for Remote Whiteboard Interactioncited by 2
  13. 2025VM-BHINet:Vision Mamba Bimanual Hand Interaction Network for 3D Interacting Hand Mesh Recovery From a Single RGB Imagecited by 2
  14. 2026Hand Visibility Detector: Per-Keypoint Visibility Estimation for Handscited by 2
  15. 2023Exploiting Spatial-Temporal Context for Interacting Hand Reconstruction on Monocular RGB Videocited by 1
  16. 2024Two Hands Are Better Than One: Resolving Hand to Hand Intersections via Occupancy Networkscited by 1
  17. 2023Monocular 3D Hand Mesh Recovery via Dual Noise Estimationcited by 0
  18. 2025Learning Transformation-Isomorphic Latent Space for Accurate Hand Pose Estimationcited by 0
  19. 2025EHPE: A Segmented Architecture for Enhanced Hand Pose Estimationcited by 0
  20. 2025Learning Correlation-aware Aleatoric Uncertainty for 3D Hand Pose Estimationcited by 0
  21. 2025DF-Mamba: Deformable State Space Modeling for 3D Hand Pose Estimation in Interactionscited by 0
  22. 2026PHAC: Promptable Human Amodal Completioncited by 0
  23. 2026VEPHand: View-Efficient Photometric Hand Performance Capture at Scalecited by 0
  24. 2026WristMimic: Full-Body Humanoid Control with Wrist-Guided Manipulationcited by 0