mlsanityData to 7 Oct 2026

Im2Mesh GAN: Accurate 3D Hand Mesh Recovery from a Single RGB Image

arXiv 2101.11239 ↗First posted 27 Jan 2021cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

This work addresses hand mesh recovery from a single RGB image. In contrast to most of the existing approaches where the parametric hand models are employed as the prior, we show that the hand mesh can be learned directly from the input image. We propose a new type of GAN called Im2Mesh GAN to learn the mesh through end-to-end adversarial training. By interpreting the mesh as a graph, our model is able to capture the topological relationship among the mesh vertices. We also introduce a 3D surface descriptor into the GAN architecture to further capture the 3D features associated. We experiment two approaches where one can reap the benefits of coupled groundtruth data availability of images and the corresponding meshes, while the other combats the more challenging problem of mesh estimations without the corresponding groundtruth. Through extensive evaluations we demonstrate that the proposed method outperforms the state-of-the-art.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 26 of its 45 references that are in the map. First posted on arXiv 27 Jan 2021.

Builds on

26 of 45 references.

References · 26

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  4. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  5. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
  6. 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
  7. 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 649
  8. 2016Geometric deep learning on graphs and manifolds using mixture model CNNscited by 468
  9. 2019Learning joint reconstruction of hands and manipulated objectscited by 377
  10. 2020I2L-MeshNet: Image-to-Lixel Prediction Network for Accurate 3D Human Pose and Mesh Estimation from a Single RGB Imagecited by 274
  11. 2019FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Imagescited by 271
  12. 2020Pose2Mesh: Graph Convolutional Network for 3D Human Pose and Mesh Recovery from a 2D Human Posecited by 248
14 more
  1. 2017Learning to Estimate 3D Hand Pose from Single RGB Imagescited by 234
  2. 20193D Hand Shape and Pose from Images in the Wildcited by 190
  3. 20193D Hand Shape and Pose Estimation from a Single RGB Imagecited by 174
  4. 2017GANerated Hands for Real-time 3D Hand Tracking from Monocular RGBcited by 147
  5. 2019End-to-end Hand Mesh Recovery from a Monocular RGB Imagecited by 124
  6. 2019Pushing the Envelope for RGB-based Dense 3D Hand Pose Estimation via Neural Renderingcited by 115
  7. 2018Hand Pose Estimation via Latent 2.5D Heatmap Regressioncited by 111
  8. 2019PU-GCN: Point Cloud Upsampling using Graph Convolutional Networkscited by 100
  9. 2016Learning shape correspondence with anisotropic convolutional neural networkscited by 95
  10. 2018Cross-modal Deep Variational Hand Pose Estimationcited by 89
  11. 2018Disentangling Latent Hands for Image Synthesis and Pose Estimationcited by 44
  12. 2017Using a single RGB frame for real time 3D hand pose estimation in the wildcited by 39
  13. 2019Single Image 3D Hand Reconstruction with Mesh Convolutionscited by 32
  14. 2019Learning Embedding of 3D models with Quadric Losscited by 4

Built on by

Cited by year

Citing papers per year: 2022: 2; 2023: 2; 2024: 0; 2025: 1.

5 papers.

  1. 2022What's in your hands? 3D Reconstruction of Generic Objects in Handscited by 90
  2. 2023DDF-HO: Hand-Held Object Reconstruction via Conditional Directed Distance Fieldcited by 16
  3. 2025BIGS: Bimanual Category-agnostic Interaction Reconstruction from Monocular Videos via 3D Gaussian Splattingcited by 10
  4. 2022Privacy-Preserving In-Bed Pose Monitoring: A Fusion and Reconstruction Studycited by 6
  5. 20233D GANs and Latent Space: A comprehensive surveycited by 1