mlsanityData to 7 Oct 2026

A Dataset of Relighted 3D Interacting Hands

arXiv 2310.17768 ↗First posted 26 Oct 2023cs.CVcited by 35

Not on the map. Why?

Abstract (arXiv)

The two-hand interaction is one of the most challenging signals to analyze due to the self-similarity, complicated articulations, and occlusions of hands. Although several datasets have been proposed for the two-hand interaction analysis, all of them do not achieve 1) diverse and realistic image appearances and 2) diverse and large-scale groundtruth (GT) 3D poses at the same time. In this work, we propose Re:InterHand, a dataset of relighted 3D interacting hands that achieve the two goals. To this end, we employ a state-of-the-art hand relighting network with our accurately tracked two-hand 3D poses. We compare our Re:InterHand with existing 3D interacting hands datasets and show the benefit of it. Our Re:InterHand is available in https://mks0601.github.io/ReInterHand/.

Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). Builds on 46 of its 62 references that are in the map. First posted on arXiv 26 Oct 2023.

Builds on

46 of 62 references.

References · 46

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  2. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
  3. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
  4. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
  5. 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
  6. 2019Learning joint reconstruction of hands and manipulated objectscited by 377
  7. 2021DexYCB: A Benchmark for Capturing Hand Grasping of Objectscited by 320
  8. 2022ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulationcited by 306
  9. 2022Assembly101: A Large-Scale Multi-View Video Dataset for Understanding Procedural Activitiescited by 284
  10. 2019FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Imagescited by 271
  11. 2017Integral Human Pose Regressioncited by 255
  12. 2021H2O: Two Hands Manipulating Objects for First Person Interaction Recognitioncited by 251
34 more
  1. 2020InterHand2.6M: A Dataset and Baseline for 3D Interacting Hand Pose Estimation from a Single RGB Imagecited by 244
  2. 2017Learning to Estimate 3D Hand Pose from Single RGB Imagescited by 234
  3. 2017Hand Keypoint Detection in Single Images using Multiview Bootstrappingcited by 231
  4. 2017First-Person Hand Action Benchmark with RGB-D Videos and 3D Hand Pose Annotationscited by 229
  5. 2021AGORA: Avatars in Geography Optimized for Regression Analysiscited by 203
  6. 2020ContactPose: A Dataset of Grasps with Object Contact and Hand Posecited by 180
  7. 2020Whole-Body Human Pose Estimation in the Wildcited by 178
  8. 2017Learning to Predict Indoor Illumination from a Single Imagecited by 160
  9. 2019Single Image Portrait Relightingcited by 152
  10. 2017GANerated Hands for Real-time 3D Hand Tracking from Monocular RGBcited by 147
  11. 2020Weakly-Supervised Mesh-Convolutional Hand Reconstruction in the Wildcited by 146
  12. 2021Keypoint Transformer: Solving Joint Identification in Challenging Hands and Object Interactions for Accurate 3D Pose Estimationcited by 122
  13. 2015Capturing Hands in Action using Discriminative Salient Points and Physics Simulationcited by 115
  14. 2017V2V-PoseNet: Voxel-to-Voxel Prediction Network for Accurate 3D Hand and Human Pose Estimation from a Single Depth Mapcited by 102
  15. 2022Interacting Attention Graph for Single Image Two-Hand Reconstructioncited by 87
  16. 2017Real-time Hand Tracking under Occlusion from an Egocentric RGB-D Sensorcited by 84
  17. 2020Accurate 3D Hand Pose Estimation for Whole-Body 3D Human Mesh Estimationcited by 81
  18. 2020Neural Light Transport for Relighting and View Synthesiscited by 73
  19. 2021Real-time Pose and Shape Reconstruction of Two Interacting Hands With a Single Depth Cameracited by 70
  20. 2023AssemblyHands: Towards Egocentric Activity Understanding via 3D Hand Pose Estimationcited by 64
  21. 2020NeuralAnnot: Neural Annotator for 3D Human Mesh Training Setscited by 62
  22. 2016Real-time Joint Tracking of a Hand Manipulating an Object from RGB-D Inputcited by 56
  23. 2017BigHand2.2M Benchmark: Hand Pose Dataset and State of the Art Analysiscited by 46
  24. 2021Learning to Disambiguate Strongly Interacting Hands via Probabilistic Per-pixel Part Segmentationcited by 40
  25. 20223D Interacting Hand Pose Estimation by Hand De-occlusion and Removalcited by 36
  26. 2023Bringing Inputs to Shared Domains for 3D Interacting Hands Recovery in the Wildcited by 36
  27. 20163D Hand Pose Tracking and Estimation Using Stereo Matchingcited by 35
  28. 2020Two-hand Global 3D Pose Estimation Using Monocular RGBcited by 27
  29. 2021Monocular 3D Reconstruction of Interacting Hands via Collision-Aware Factorized Refinementscited by 27
  30. 2022DART: Articulated Hand Model with Diverse Accessories and Rich Texturescited by 25
  31. 2023RelightableHands: Efficient Neural Relighting of Articulated Hand Modelscited by 21
  32. 2021HUMBI: A Large Multiview Dataset of Human Body Expressions and Benchmark Challengecited by 17
  33. 2023Recovering 3D Hand Mesh Sequence from a Single Blurry Image: A New Dataset and Temporal Unfoldingcited by 10
  34. 2022LWA-HAND: Lightweight Attention Hand for Interacting Hand Reconstructioncited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 2; 2024: 15; 2025: 10; 2026: 8.

35 papers.

Sort:

By area:

  1. 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 274
  2. 2024WiLoR: End-to-end 3D Hand Localization and Reconstruction in-the-wildcited by 117
  3. 2023HOLD: Category-agnostic 3D Reconstruction of Interacting Hands and Objects from Videocited by 76
  4. 2026SAM 3D Body: Robust Full-Body Human Mesh Recoverycited by 61
  5. 2024Dyn-HaMR: Recovering 4D Interacting Hand Motion from a Dynamic Cameracited by 50
  6. 2024Benchmarks and Challenges in Pose Estimation for Egocentric Hand Interactions with Objectscited by 35
  7. 2024emg2pose: A Large and Diverse Benchmark for Surface Electromyographic Hand Pose Estimationcited by 20
  8. 2024URHand: Universal Relightable Handscited by 17
  9. 2024Dense Hand-Object(HO) GraspNet with Full Grasping Taxonomy and Dynamicscited by 15
  10. 2025MagicHOI: Leveraging 3D Priors for Accurate Hand-object Reconstruction from Short Monocular Video Clipscited by 15
  11. 2023HandDiffuse: Generative Controllers for Two-Hand Interactions via Diffusion Modelscited by 13
  12. 2024Giving a Hand to Diffusion Models: a Two-Stage Approach to Improving Conditional Human Image Generationcited by 13
23 more
  1. 2025DPoser-X: Diffusion Model as Robust 3D Whole-body Human Pose Priorcited by 13
  2. 2025Learning Dense Hand Contact Estimation from Imbalanced Datacited by 12
  3. 2024AttentionHand: Text-driven Controllable Hand Image Generation for 3D Hand Reconstruction in the Wildcited by 10
  4. 2024DICE: End-to-end Deformation Capture of Hand-Face Interactions from a Single Imagecited by 9
  5. 2024BiTT: Bi-directional Texture Reconstruction of Interacting Two Hands from a Single Imagecited by 8
  6. 2024FoundHand: Large-Scale Domain-Specific Learning for Controllable Hand Image Generationcited by 8
  7. 2024PianoMotion10M: Dataset and Benchmark for Hand Motion Generation in Piano Performancecited by 5
  8. 2024Weakly-Supervised 3D Hand Reconstruction with Knowledge Prior and Uncertainty Guidancecited by 5
  9. 2025Emergent Active Perception and Dexterity of Simulated Humanoids from Visual Reinforcement Learningcited by 5
  10. 2025PALM: A Dataset and Baseline for Learning Multi-subject Hand Priorcited by 3
  11. 2026StableHand: Quality-Aware Flow Matching for World-Space Dual-Hand Motion Estimation from Egocentric Videocited by 2
  12. 2024Two Hands Are Better Than One: Resolving Hand to Hand Intersections via Occupancy Networkscited by 1
  13. 2025HanDrawer: Leveraging Spatial Information to Render Realistic Hands Using a Conditional Diffusion Model in Single Stagecited by 1
  14. 2025Prompt Guidance and Human Proximal Perception for HOT Prediction with Regional Joint Losscited by 1
  15. 2025emg2tendon: From sEMG Signals to Tendon Control in Musculoskeletal Handscited by 1
  16. 2026FUSION: Full-Body Unified Motion Prior for Body and Hands via Diffusioncited by 1
  17. 2026AnyHand: A Large-Scale Synthetic Dataset for RGB(-D) Hand Pose Estimationcited by 1
  18. 2026ACE-Ego-Hand: Repurposing Video Diffusion Models for Occlusion-Robust Egocentric 3D Hand Motion Recoverycited by 1
  19. 2025From 2D Alignment to 3D Plausibility: Unifying Heterogeneous 2D Priors and Penetration-Free Diffusion for Occlusion-Robust Two-Hand Reconstructioncited by 0
  20. 20253D Hand Mesh-Guided AI-Generated Malformed Hand Refinement with Hand Pose Transformation via Diffusion Modelcited by 0
  21. 2026SesaHand: Enhancing 3D Hand Reconstruction via Controllable Generation with Semantic and Structural Alignmentcited by 0
  22. 2026Enhancing Hands in 3D Whole-Body Pose Estimation with Conditional Hands Modulatorcited by 0
  23. 2026TransHands: Repurposing Human Pose Encoders as Hand Pose Encoderscited by 0