mlsanityData to 7 Oct 2026

MLPHand: Real Time Multi-View 3D Hand Mesh Reconstruction via MLP Modeling

arXiv 2406.16137 ↗First posted 23 Jun 2024cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Multi-view hand mesh reconstruction is a critical task for applications in virtual reality and human-computer interaction, but it remains a formidable challenge. Although existing multi-view hand reconstruction methods achieve remarkable accuracy, they typically come with an intensive computational burden that hinders real-time inference. To this end, we propose MLPHand, a novel method designed for real-time multi-view single hand reconstruction. MLP Hand consists of two primary modules: (1) a lightweight MLP-based Skeleton2Mesh model that efficiently recovers hand meshes from hand skeletons, and (2) a multi-view geometry feature fusion prediction module that enhances the Skeleton2Mesh model with detailed geometric information from multiple views. Experiments on three widely used datasets demonstrate that MLPHand can reduce computational complexity by 90% while achieving comparable reconstruction accuracy to existing state-of-the-art baselines.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 44 of its 56 references that are in the map. First posted on arXiv 23 Jun 2024.

Builds on

44 of 56 references.

References · 44

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  3. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  4. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
  5. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  6. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  7. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
  8. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  9. 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 467
  10. 2020End-to-End Human Pose and Mesh Reconstruction with Transformerscited by 417
  11. 2019Learning joint reconstruction of hands and manipulated objectscited by 377
  12. 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 369
32 more
  1. 2016Convolutional Pose Machinescited by 325
  2. 2021DexYCB: A Benchmark for Capturing Hand Grasping of Objectscited by 320
  3. 2019FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Imagescited by 271
  4. 2019Convolutional Mesh Regression for Single-Image Human Shape Reconstructioncited by 270
  5. 2021Mesh Graphormercited by 264
  6. 2017Integral Human Pose Regressioncited by 255
  7. 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
  8. 2022Geo-Neus: Geometry-Consistent Neural Implicit Surfaces Learning for Multi-view Reconstructioncited by 211
  9. 20193D Hand Shape and Pose from Images in the Wildcited by 190
  10. 20193D Hand Shape and Pose Estimation from a Single RGB Imagecited by 174
  11. 2019NASA: Neural Articulated Shape Approximationcited by 149
  12. 2020Weakly-Supervised Mesh-Convolutional Hand Reconstruction in the Wildcited by 146
  13. 2022Diffusion-SDF: Conditional Generative Modeling of Signed Distance Functionscited by 133
  14. 2022OakInk: A Large-scale Knowledge Repository for Understanding Hand-Object Interactioncited by 129
  15. 2020Monocular Real-time Hand Shape and Motion Capture using Multi-modal Datacited by 106
  16. 2021MobRecon: Mobile-Friendly Hand Mesh Reconstruction from Monocular Imagecited by 74
  17. 2021Direct Multi-view Multi-person 3D Pose Estimationcited by 64
  18. 2022LISA: Learning Implicit Shape and Appearance of Handscited by 63
  19. 2021Camera-Space Hand Mesh Recovery via Semantic Aggregation and Adaptive 2D-1D Registrationcited by 59
  20. 2022COAP: Compositional Articulated Occupancy of Peoplecited by 59
  21. 2022AlignSDF: Pose-Aligned Signed Distance Fields for Hand-Object Reconstructioncited by 58
  22. 2022Collaborative Learning for Hand and Object Reconstruction with Attention-guided Graph Convolutioncited by 54
  23. 2021I2UV-HandNet: Image-to-UV Prediction Network for Accurate and High-fidelity 3D Hand Mesh Modelingcited by 52
  24. 2021A Skeleton-Driven Neural Occupancy Representation for Articulated Handscited by 50
  25. 2022Hand Avatar: Free-Pose Hand Animation and Rendering from Monocular Videocited by 37
  26. 2021HO-3D_v3: Improving the Accuracy of Hand-Object Annotations of the HO-3D Datasetcited by 25
  27. 2021Shape-aware Multi-Person Pose Estimation from Multi-View Imagescited by 24
  28. 2021FLEX: Extrinsic Parameters-free Multi-view 3D Human Motion Reconstructioncited by 11
  29. 2022Identity-Aware Hand Mesh Estimation and Personalization from RGB Imagescited by 11
  30. 2023POEM: Reconstructing Hand in a Point Embedded Multi-view Stereocited by 9
  31. 2023Spectral Graphormer: Spectral Graph-based Transformer for Egocentric Two-Hand Reconstruction using Multi-View Color Imagescited by 9
  32. 2021Hand tracking for immersive virtual reality: opportunities and challengescited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.

  1. 2026SHOW3D: Capturing Scenes of 3D Hands and Objects in the Wildcited by 4
  2. 2025Towards Dynamic 3D Reconstruction of Hand-Instrument Interaction in Ophthalmic Surgerycited by 2
  3. 2025Ego-Exo 3D Hand Tracking in the Wild with a Mobile Multi-Camera Rigcited by 0