mlsanityData to 14 Oct 2026

I2UV-HandNet: Image-to-UV Prediction Network for Accurate and High-fidelity 3D Hand Mesh Modeling

arXiv 2102.03725 ↗First posted 7 Feb 2021cs.CVcited by 52

Not on the map. Why?

Abstract (arXiv)

Reconstructing a high-precision and high-fidelity 3D human hand from a color image plays a central role in replicating a realistic virtual hand in human-computer interaction and virtual reality applications. The results of current methods are lacking in accuracy and fidelity due to various hand poses and severe occlusions. In this study, we propose an I2UV-HandNet model for accurate hand pose and shape estimation as well as 3D hand super-resolution reconstruction. Specifically, we present the first UV-based 3D hand shape representation. To recover a 3D hand mesh from an RGB image, we design an AffineNet to predict a UV position map from the input in an image-to-image translation fashion. To obtain a higher fidelity shape, we exploit an additional SRNet to transform the low-resolution UV map outputted by AffineNet into a high-resolution one. For the first time, we demonstrate the characterization capability of the UV-based hand shape representation. Our experiments show that the proposed method achieves state-of-the-art performance on several challenging benchmarks.

Key facts. Cited by 52 papers in the map (data through 14 Oct 2026). Builds on 39 of its 53 references that are in the map. First posted on arXiv 7 Feb 2021.

Builds on

39 of 53 references.

References · 39

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  5. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  6. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
  7. 2015Spatial Transformer Networkscited by 1,429
  8. 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,224
  9. 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,179
  10. 2016Geometric deep learning: going beyond Euclidean datacited by 1,048
  11. 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 651
  12. 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 627
27 more
  1. 2019Learning joint reconstruction of hands and manipulated objectscited by 378
  2. 2020I2L-MeshNet: Image-to-Lixel Prediction Network for Accurate 3D Human Pose and Mesh Estimation from a Single RGB Imagecited by 274
  3. 2019FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Imagescited by 271
  4. 2019Convolutional Mesh Regression for Single-Image Human Shape Reconstructioncited by 270
  5. 2020Pose2Mesh: Graph Convolutional Network for 3D Human Pose and Mesh Recovery from a 2D Human Posecited by 248
  6. 2017Learning to Estimate 3D Hand Pose from Single RGB Imagescited by 234
  7. 2017Hand Keypoint Detection in Single Images using Multiview Bootstrappingcited by 231
  8. 2018Joint 3D Face Reconstruction and Dense Alignment with Position Map Regression Networkcited by 195
  9. 20193D Hand Shape and Pose from Images in the Wildcited by 190
  10. 20193D Hand Shape and Pose Estimation from a Single RGB Imagecited by 174
  11. 2019Tex2Shape: Detailed Full Human Body Geometry From a Single Imagecited by 166
  12. 2020Weakly-Supervised Mesh-Convolutional Hand Reconstruction in the Wildcited by 146
  13. 2020Leveraging Photometric Consistency over Time for Sparsely Supervised Hand-Object Reconstructioncited by 139
  14. 2019End-to-end Hand Mesh Recovery from a Monocular RGB Imagecited by 124
  15. 2015Capturing Hands in Action using Discriminative Salient Points and Physics Simulationcited by 115
  16. 2017Towards 3D Human Pose Estimation in the Wild: a Weakly-supervised Approachcited by 115
  17. 2018Hand Pose Estimation via Latent 2.5D Heatmap Regressioncited by 111
  18. 2020Monocular Real-time Hand Shape and Motion Capture using Multi-modal Datacited by 106
  19. 2019DenseRaC: Joint 3D Pose and Shape Estimation by Dense Render-and-Comparecited by 100
  20. 2020Weakly Supervised 3D Hand Pose Estimation via Biomechanical Constraintscited by 97
  21. 20203D Human Mesh Regression with Dense Correspondencecited by 66
  22. 2020DeepHandMesh: A Weakly-supervised Deep Encoder-Decoder Framework for High-fidelity Hand Mesh Modelingcited by 49
  23. 2020Joint Hand-object 3D Reconstruction from a Single Image with Cross-branch Feature Fusioncited by 39
  24. 20163D Hand Pose Tracking and Estimation Using Stereo Matchingcited by 35
  25. 2020Measuring Generalisation to Unseen Viewpoints, Articulations, Shapes and Objects for 3D Hand Pose Estimation under Hand-Object Interactioncited by 24
  26. 2017Depth-Based 3D Hand Pose Estimation: From Current Achievements to Future Goalscited by 21
  27. 2019DenseBody: Directly Regressing Dense 3D Human Pose and Shape From a Single Color Imagecited by 20

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 2; 2022: 6; 2023: 17; 2024: 12; 2025: 10; 2026: 5.

52 papers.

Sort:

By area:

  1. 2023Reconstructing Hands in 3D with Transformerscited by 306
  2. 2023FastViT: A Fast Hybrid Vision Transformer using Structural Reparameterizationcited by 162
  3. 2024WiLoR: End-to-end 3D Hand Localization and Reconstruction in-the-wildcited by 124
  4. 2021Keypoint Transformer: Solving Joint Identification in Challenging Hands and Object Interactions for Accurate 3D Pose Estimationcited by 123
  5. 2021MobRecon: Mobile-Friendly Hand Mesh Reconstruction from Monocular Imagecited by 74
  6. 2022LISA: Learning Implicit Shape and Appearance of Handscited by 63
  7. 2023HybrIK-X: Hybrid Analytical-Neural Inverse Kinematics for Whole-body Mesh Recoverycited by 49
  8. 2024Hamba: Single-view 3D Hand Reconstruction with Graph-guided Bi-Scanning Mambacited by 45
  9. 2023A Probabilistic Attention Model with Occlusion-aware Texture Regression for 3D Hand Reconstruction from a Single RGB Imagecited by 32
  10. 2022Consistent 3D Hand Reconstruction in Video via self-supervised Learningcited by 28
  11. 2022HARP: Personalized Hand Reconstruction from a Monocular RGB Videocited by 28
  12. 2024A Simple Baseline for Efficient Hand Mesh Reconstructioncited by 27
38 more
  1. 2022DART: Articulated Hand Model with Diverse Accessories and Rich Texturescited by 25
  2. 2025Predicting 4D Hand Trajectory from Monocular Videoscited by 21
  3. 2022Tracking and Reconstructing Hand Object Interactions from Point Cloud Sequences in the Wildcited by 17
  4. 2024HHMR: Holistic Hand Mesh Recovery by Enhancing the Multimodal Controllability of Graph Diffusion Modelscited by 14
  5. 2024HandBooster: Boosting 3D Hand-Mesh Reconstruction by Conditional Synthesis and Sampling of Hand-Object Interactionscited by 13
  6. 2023Recovering 3D Hand Mesh Sequence from a Single Blurry Image: A New Dataset and Temporal Unfoldingcited by 10
  7. 2023POEM: Reconstructing Hand in a Point Embedded Multi-view Stereocited by 10
  8. 2022UV-Based 3D Hand-Object Reconstruction with Grasp Optimizationcited by 8
  9. 2023Decoupled Iterative Refinement Framework for Interacting Hands Reconstruction from a Single RGB Imagecited by 8
  10. 2023MeMaHand: Exploiting Mesh-Mano Interaction for Single Image Two-Hand Reconstructioncited by 8
  11. 2023Human Part-wise 3D Motion Context Learning for Sign Language Recognitioncited by 8
  12. 2023HaMuCo: Hand Pose Estimation via Multiview Collaborative Self-Supervised Learningcited by 7
  13. 2023DiffHand: End-to-End Hand Mesh Reconstruction via Diffusion Modelscited by 7
  14. 2024HandDGP: Camera-Space Hand Mesh Prediction with Differentiable Global Positioningcited by 7
  15. 2023Neural Voting Field for Camera-Space 3D Hand Pose Estimationcited by 6
  16. 2024Multi-view Hand Reconstruction with a Point-Embedded Transformercited by 6
  17. 2023PHRIT: Parametric Hand Representation with Implicit Templatecited by 5
  18. 2023CLIP-Hand3D: Exploiting 3D Hand Pose Estimation via Context-Aware Promptingcited by 5
  19. 2023Overcoming the Trade-off Between Accuracy and Plausibility in 3D Hand Shape Reconstructioncited by 4
  20. 2024HandGCAT: Occlusion-Robust 3D Hand Mesh Reconstruction from Monocular Imagescited by 4
  21. 2024MLPHand: Real Time Multi-View 3D Hand Mesh Reconstruction via MLP Modelingcited by 3
  22. 2025SRHand: Super-Resolving Hand Images and 3D Shapes via View/Pose-aware Neural Image Representations and Explicit 3D Meshescited by 3
  23. 2026HGGT: Robust and Flexible 3D Hand Mesh Reconstruction from Uncalibrated Imagescited by 3
  24. 2024XHand: Real-time Expressive Hand Avatarcited by 2
  25. 2025HandOcc: NeRF-based Hand Rendering with Occupancy Networkscited by 2
  26. 2025Rodrigues Network for Learning Robot Actionscited by 2
  27. 2026AnyHand: A Large-Scale Synthetic Dataset for RGB(-D) Hand Pose Estimationcited by 2
  28. 2023Lightweight Estimation of Hand Mesh and Biomechanically Feasible Kinematic Parameterscited by 0
  29. 2023HandMIM: Pose-Aware Self-Supervised Learning for 3D Hand Mesh Estimationcited by 0
  30. 2024HandS3C: 3D Hand Mesh Reconstruction with State Space Spatial Channel Attention from RGB imagescited by 0
  31. 2024STMR: Spiral Transformer for Hand Mesh Reconstructioncited by 0
  32. 2025Direction-Aware Hybrid Representation Learning for 3D Hand Pose and Shape Estimationcited by 0
  33. 2025M3DHMR: Monocular 3D Hand Mesh Recoverycited by 0
  34. 2025TIGeR: Text-Instructed Generation and Refinement for Template-Free Hand-Object Interactioncited by 0
  35. 2025Enhancing Monocular 3D Hand Reconstruction with Learned Texture Priorscited by 0
  36. 2025Learning Correlation-aware Aleatoric Uncertainty for 3D Hand Pose Estimationcited by 0
  37. 2025Cascaded Diffusion Framework for Probabilistic Coarse-to-Fine Hand Pose Estimationcited by 0
  38. 2026Beyond Geometry: Artistic Disparity Synthesis for Immersive 2D-to-3Dcited by 0

50 most cited of 52 All 52 (JSON)