mlsanityData to 7 Oct 2026

Interacting Attention Graph for Single Image Two-Hand Reconstruction

arXiv 2203.09364 ↗First posted 17 Mar 2022cs.CVcited by 87

Not on the map. Why?

Abstract (arXiv)

Graph convolutional network (GCN) has achieved great success in single hand reconstruction task, while interacting two-hand reconstruction by GCN remains unexplored. In this paper, we present Interacting Attention Graph Hand (IntagHand), the first graph convolution based network that reconstructs two interacting hands from a single RGB image. To solve occlusion and interaction challenges of two-hand reconstruction, we introduce two novel attention based modules in each upsampling step of the original GCN. The first module is the pyramid image feature attention (PIFA) module, which utilizes multiresolution features to implicitly obtain vertex-to-image alignment. The second module is the cross hand attention (CHA) module that encodes the coherence of interacting hands by building dense cross-attention between two hand vertices. As a result, our model outperforms all existing two-hand reconstruction methods by a large margin on InterHand2.6M benchmark. Moreover, ablation studies verify the effectiveness of both PIFA and CHA modules for improving the reconstruction accuracy. Results on in-the-wild images and live video streams further demonstrate the generalization ability of our network. Our code is available at https://github.com/Dw1010/IntagHand.

Key facts. Cited by 87 papers in the map (data through 7 Oct 2026). Builds on 40 of its 55 references that are in the map. First posted on arXiv 17 Mar 2022.

Builds on

40 of 55 references.

References · 40

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
  5. 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 649
  6. 2018Simple Baselines for Human Pose Estimation and Trackingcited by 502
  7. 2020End-to-End Human Pose and Mesh Reconstruction with Transformerscited by 417
  8. 2019FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Imagescited by 271
  9. 2019Convolutional Mesh Regression for Single-Image Human Shape Reconstructioncited by 270
  10. 2018Generating 3D faces using Convolutional Mesh Autoencoderscited by 267
  11. 2021Mesh Graphormercited by 264
  12. 2021PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loopcited by 250
28 more
  1. 2020InterHand2.6M: A Dataset and Baseline for 3D Interacting Hand Pose Estimation from a Single RGB Imagecited by 244
  2. 2018Total Capture: A 3D Deformation Model for Tracking Faces, Hands, and Bodiescited by 239
  3. 2017Learning to Estimate 3D Hand Pose from Single RGB Imagescited by 234
  4. 2017Hand Keypoint Detection in Single Images using Multiview Bootstrappingcited by 231
  5. 20193D Hand Shape and Pose from Images in the Wildcited by 190
  6. 2022Embodied Hands: Modeling and Capturing Hands and Bodies Togethercited by 179
  7. 20193D Hand Shape and Pose Estimation from a Single RGB Imagecited by 174
  8. 2016Panoptic Studio: A Massively Multiview System for Social Interaction Capturecited by 173
  9. 2018Monocular Total Capture: Posing Face, Body, and Hands in the Wildcited by 162
  10. 2020Monocular Expressive Body Regression through Body-Driven Attentioncited by 155
  11. 2017GANerated Hands for Real-time 3D Hand Tracking from Monocular RGBcited by 147
  12. 2020Weakly-Supervised Mesh-Convolutional Hand Reconstruction in the Wildcited by 146
  13. 2019End-to-end Hand Mesh Recovery from a Monocular RGB Imagecited by 124
  14. 2015Capturing Hands in Action using Discriminative Salient Points and Physics Simulationcited by 115
  15. 2019Pushing the Envelope for RGB-based Dense 3D Hand Pose Estimation via Neural Renderingcited by 115
  16. 2020Monocular Real-time Hand Shape and Motion Capture using Multi-modal Datacited by 106
  17. 2020Weakly Supervised 3D Hand Pose Estimation via Biomechanical Constraintscited by 97
  18. 2018Cross-modal Deep Variational Hand Pose Estimationcited by 89
  19. 2020FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and Integrationcited by 72
  20. 2021Real-time Pose and Shape Reconstruction of Two Interacting Hands With a Single Depth Cameracited by 70
  21. 2021Camera-Space Hand Mesh Recovery via Semantic Aggregation and Adaptive 2D-1D Registrationcited by 59
  22. 2020Monocular Real-time Full Body Capture with Inter-part Correlationscited by 53
  23. 2021Towards Accurate Alignment in Real-time 3D Hand-Mesh Reconstructioncited by 44
  24. 2021Learning to Disambiguate Strongly Interacting Hands via Probabilistic Per-pixel Part Segmentationcited by 40
  25. 2021Lightweight Multi-person Total Motion Capture Using Sparse Multi-view Camerascited by 32
  26. 2021Hand Image Understanding via Deep Multi-Task Learningcited by 31
  27. 2021Monocular 3D Reconstruction of Interacting Hands via Collision-Aware Factorized Refinementscited by 27
  28. 2021RGB2Hands: Real-Time Tracking of 3D Hand Interactions from Monocular RGB Videocited by 23

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 9; 2023: 36; 2024: 22; 2025: 12; 2026: 8.

87 papers.

Sort:

By area:

  1. 2022ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulationcited by 306
  2. 2023Reconstructing Hands in 3D with Transformerscited by 298
  3. 2022PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Imagescited by 152
  4. 2024TACO: Benchmarking Generalizable Bimanual Tool-ACtion-Object Understandingcited by 85
  5. 2023HOLD: Category-agnostic 3D Reconstruction of Interacting Hands and Objects from Videocited by 76
  6. 2022A Survey on Graph Neural Networks and Graph Transformers in Computer Vision: A Task-Oriented Perspectivecited by 56
  7. 2024Dyn-HaMR: Recovering 4D Interacting Hand Motion from a Dynamic Cameracited by 50
  8. 2023gSDF: Geometry-Driven Signed Distance Functions for 3D Hand-Object Reconstructioncited by 49
  9. 2023HybrIK-X: Hybrid Analytical-Neural Inverse Kinematics for Whole-body Mesh Recoverycited by 48
  10. 2023ACR: Attention Collaboration-based Regressor for Arbitrary Two-Hand Reconstructioncited by 37
  11. 2023Bringing Inputs to Shared Domains for 3D Interacting Hands Recovery in the Wildcited by 36
  12. 2022Hierarchical Temporal Transformer for 3D Hand Pose Estimation and Action Recognition from Egocentric RGB Videoscited by 35
38 more
  1. 2023A Dataset of Relighted 3D Interacting Handscited by 35
  2. 2024Benchmarks and Challenges in Pose Estimation for Egocentric Hand Interactions with Objectscited by 35
  3. 2022State of the Art in Dense Monocular Non-Rigid 3D Reconstructioncited by 30
  4. 2024InterHandGen: Two-Hand Interaction Generation via Cascaded Reverse Diffusioncited by 28
  5. 2023Im2Hands: Learning Attentive Implicit Representation of Interacting Two-Hand Shapescited by 26
  6. 2024Reconstructing Hand-Held Objects in 3D from Images and Videoscited by 23
  7. 2023RelightableHands: Efficient Neural Relighting of Articulated Hand Modelscited by 21
  8. 2023Diverse 3D Hand Gesture Prediction from Body Dynamics by Bilateral Hand Disentanglementcited by 18
  9. 2023Reconstructing Interacting Hands with Interaction Prior from Monocular Imagescited by 18
  10. 20233D Pose Estimation of Two Interacting Hands from a Monocular Event Cameracited by 17
  11. 2023RenderIH: A Large-scale Synthetic Dataset for 3D Interacting Hand Pose Estimationcited by 16
  12. 2023A2J-Transformer: Anchor-to-Joint Transformer Network for 3D Interacting Hand Pose Estimation from a Single RGB Imagecited by 15
  13. 2024Dense Hand-Object(HO) GraspNet with Full Grasping Taxonomy and Dynamicscited by 15
  14. 2025MagicHOI: Leveraging 3D Priors for Accurate Hand-object Reconstruction from Short Monocular Video Clipscited by 15
  15. 2024Complementing Event Streams and RGB Frames for Hand Mesh Reconstructioncited by 14
  16. 2024HHMR: Holistic Hand Mesh Recovery by Enhancing the Multimodal Controllability of Graph Diffusion Modelscited by 14
  17. 2023HandDiffuse: Generative Controllers for Two-Hand Interactions via Diffusion Modelscited by 13
  18. 2025HORT: Monocular Hand-held Objects Reconstruction with Transformerscited by 11
  19. 2023Delving Deep into Pixel Alignment Feature for Accurate Multi-view Human Mesh Recoverycited by 10
  20. 2023Learning Explicit Contact for Implicit Reconstruction of Hand-held Objects from Monocular Imagescited by 10
  21. 2023FourierHandFlow: Neural 4D Hand Representation Using Fourier Query Flowcited by 10
  22. 2024AttentionHand: Text-driven Controllable Hand Image Generation for 3D Hand Reconstruction in the Wildcited by 10
  23. 2024PEAR: Phrase-Based Hand-Object Interaction Anticipationcited by 10
  24. 2023ProxyCap: Real-time Monocular Full-body Capture in World Space via Human-Centric Proxy-to-Motion Learningcited by 9
  25. 2023Spectral Graphormer: Spectral Graph-based Transformer for Egocentric Two-Hand Reconstruction using Multi-View Color Imagescited by 9
  26. 2024DICE: End-to-end Deformation Capture of Hand-Face Interactions from a Single Imagecited by 9
  27. 2024HandOS: 3D Hand Reconstruction in One Stagecited by 9
  28. 2023Decoupled Iterative Refinement Framework for Interacting Hands Reconstruction from a Single RGB Imagecited by 8
  29. 2023MeMaHand: Exploiting Mesh-Mano Interaction for Single Image Two-Hand Reconstructioncited by 8
  30. 2024BiTT: Bi-directional Texture Reconstruction of Interacting Two Hands from a Single Imagecited by 8
  31. 2023HaMuCo: Hand Pose Estimation via Multiview Collaborative Self-Supervised Learningcited by 7
  32. 2023Extract-and-Adaptation Network for 3D Interacting Hand Mesh Recoverycited by 7
  33. 2023Ins-HOI: Instance Aware Human-Object Interactions Recoverycited by 7
  34. 2026EgoGrasp: World-Space Hand-Object Interaction Estimation from Egocentric Videoscited by 7
  35. 2022End-to-end Weakly-supervised Single-stage Multiple 3D Hand Mesh Reconstruction from a Single RGB Imagecited by 6
  36. 2022LWA-HAND: Lightweight Attention Hand for Interacting Hand Reconstructioncited by 5
  37. 2022HandFlow: Quantifying View-Dependent 3D Ambiguity in Two-Hand Reconstruction with Normalizing Flowcited by 5
  38. 2023PHRIT: Parametric Hand Representation with Implicit Templatecited by 5

50 most cited of 87 All 87 (JSON)