MobRecon: Mobile-Friendly Hand Mesh Reconstruction from Monocular Image
Not on the map. Why?
Abstract (arXiv)
In this work, we propose a framework for single-view hand mesh reconstruction, which can simultaneously achieve high reconstruction accuracy, fast inference speed, and temporal coherence. Specifically, for 2D encoding, we propose lightweight yet effective stacked structures. Regarding 3D decoding, we provide an efficient graph operator, namely depth-separable spiral convolution. Moreover, we present a novel feature lifting module for bridging the gap between 2D and 3D representations. This module begins with a map-based position regression (MapReg) block to integrate the merits of both heatmap encoding and position regression paradigms for improved 2D accuracy and temporal coherence. Furthermore, MapReg is followed by pose pooling and pose-to-vertex lifting approaches, which transform 2D pose encodings to semantic features of 3D vertices. Overall, our hand reconstruction framework, called MobRecon, comprises affordable computational costs and miniature model size, which reaches a high inference speed of 83FPS on Apple A14 CPU. Extensive experiments on popular datasets such as FreiHAND, RHD, and HO3Dv2 demonstrate that our MobRecon achieves superior performance on reconstruction accuracy and temporal coherence. Our code is publicly available at https://github.com/SeanChenxy/HandMesh.
Key facts. Cited by 74 papers in the map (data through 14 Oct 2026). Builds on 73 of its 98 references that are in the map. First posted on arXiv 6 Dec 2021.
Builds on
73 of 98 references.
References · 73
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2016Densely Connected Convolutional Networkscited by 6,720
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
- 2017Squeeze-and-Excitation Networkscited by 4,789
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
- 2019Searching for MobileNetV3cited by 1,994
- 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,420
- 2016Stacked Hourglass Networks for Human Pose Estimationcited by 915
- 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
38 more
- 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
- 2019VIBE: Video Inference for Human Body Pose and Shape Estimationcited by 620
- 2020End-to-End Human Pose and Mesh Reconstruction with Transformerscited by 418
- 2019GhostNet: More Features from Cheap Operationscited by 410
- 2019Learning joint reconstruction of hands and manipulated objectscited by 378
- 2016Convolutional Pose Machinescited by 325
- 2021DexYCB: A Benchmark for Capturing Hand Grasping of Objectscited by 325
- 2018Learning 3D Human Dynamics from Videocited by 316
- 2013DeepPose: Human Pose Estimation via Deep Neural Networkscited by 305
- 2020I2L-MeshNet: Image-to-Lixel Prediction Network for Accurate 3D Human Pose and Mesh Estimation from a Single RGB Imagecited by 274
- 2019FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Imagescited by 271
- 2021Mesh Graphormercited by 265
- 2020ARCH: Animatable Reconstruction of Clothed Humanscited by 257
- 2017Integral Human Pose Regressioncited by 256
- 2021H2O: Two Hands Manipulating Objects for First Person Interaction Recognitioncited by 254
- 2020InterHand2.6M: A Dataset and Baseline for 3D Interacting Hand Pose Estimation from a Single RGB Imagecited by 245
- 2017Learning to Estimate 3D Hand Pose from Single RGB Imagescited by 234
- 2020PaMIR: Parametric Model-Conditioned Implicit Representation for Image-based Human Reconstructioncited by 231
- 2017First-Person Hand Action Benchmark with RGB-D Videos and 3D Hand Pose Annotationscited by 230
- 20193D Hand Shape and Pose from Images in the Wildcited by 190
- 2020Grasping Field: Learning Implicit Representations for Human Graspscited by 179
- 20193D Hand Shape and Pose Estimation from a Single RGB Imagecited by 174
- 2020Beyond Static Features for Temporally Consistent 3D Human Pose and Shape from a Videocited by 163
- 2021Hand-Object Contact Consistency Reasoning for Human Grasps Generationcited by 160
- 2019NASA: Neural Articulated Shape Approximationcited by 149
- 2017GANerated Hands for Real-time 3D Hand Tracking from Monocular RGBcited by 147
- 2020Weakly-Supervised Mesh-Convolutional Hand Reconstruction in the Wildcited by 146
- 2020Reconstructing Hand-Object Interactions in the Wildcited by 144
- 2021Semi-Supervised 3D Hand-Object Poses Estimation with Interactions in Timecited by 141
- 2021Human Pose Regression with Residual Log-likelihood Estimationcited by 131
- 2020CPF: Learning a Contact Potential Field to Model the Hand-Object Interactioncited by 128
- 2017Compositional Human Pose Regressioncited by 124
- 2019End-to-end Hand Mesh Recovery from a Monocular RGB Imagecited by 124
- 2015Human Pose Estimation with Iterative Error Feedbackcited by 121
- 2019Pushing the Envelope for RGB-based Dense 3D Hand Pose Estimation via Neural Renderingcited by 115
- 2018Hand Pose Estimation via Latent 2.5D Heatmap Regressioncited by 111
- 2020LoopReg: Self-supervised Learning of Implicit Surface Correspondences, Pose and Shape for 3D Human Mesh Registrationcited by 108
- 2021LEAP: Learning Articulated Occupancy of Peoplecited by 107
50 most cited of 73 All 73 (JSON)
Built on by
Citing papers per year: 2022: 3; 2023: 16; 2024: 24; 2025: 19; 2026: 12.
74 papers.
Sort:
By area:
- 2023Reconstructing Hands in 3D with Transformerscited by 306
- 2023FastViT: A Fast Hybrid Vision Transformer using Structural Reparameterizationcited by 162
- 2024WiLoR: End-to-end 3D Hand Localization and Reconstruction in-the-wildcited by 124
- 2024TACO: Benchmarking Generalizable Bimanual Tool-ACtion-Object Understandingcited by 88
- 2024Hamba: Single-view 3D Hand Reconstruction with Graph-guided Bi-Scanning Mambacited by 45
- 2024Benchmarks and Challenges in Pose Estimation for Egocentric Hand Interactions with Objectscited by 35
- 2023A Probabilistic Attention Model with Occlusion-aware Texture Regression for 3D Hand Reconstruction from a Single RGB Imagecited by 32
- 2024A Simple Baseline for Efficient Hand Mesh Reconstructioncited by 27
- 2022DART: Articulated Hand Model with Diverse Accessories and Rich Texturescited by 25
- 2023Mobile Foundation Model as Firmwarecited by 25
- 2025GUAVA: Generalizable Upper Body 3D Gaussian Avatarcited by 22
- 2025Predicting 4D Hand Trajectory from Monocular Videoscited by 21
38 more
- 2023High Fidelity 3D Hand Shape Reconstruction via Scalable Graph Frequency Decompositioncited by 18
- 2023EvHandPose: Event-based 3D Hand Pose Estimation with Sparse Supervisioncited by 17
- 2024HOISDF: Constraining 3D Hand-Object Pose Estimation with Global Signed Distance Fieldscited by 14
- 2024Complementing Event Streams and RGB Frames for Hand Mesh Reconstructioncited by 14
- 2024HHMR: Holistic Hand Mesh Recovery by Enhancing the Multimodal Controllability of Graph Diffusion Modelscited by 14
- 2024HandBooster: Boosting 3D Hand-Mesh Reconstruction by Conditional Synthesis and Sampling of Hand-Object Interactionscited by 13
- 2022MPT: Mesh Pre-Training with Transformers for Human Pose and Mesh Reconstructioncited by 11
- 2024PEAR: Phrase-Based Hand-Object Interaction Anticipationcited by 10
- 2024RHanDS: Refining Malformed Hands for Generated Images with Decoupled Structure and Style Guidancecited by 9
- 2024HandOS: 3D Hand Reconstruction in One Stagecited by 9
- 2023Decoupled Iterative Refinement Framework for Interacting Hands Reconstruction from a Single RGB Imagecited by 8
- 2023HaMuCo: Hand Pose Estimation via Multiview Collaborative Self-Supervised Learningcited by 7
- 2023DiffHand: End-to-End Hand Mesh Reconstruction via Diffusion Modelscited by 7
- 2024HandDGP: Camera-Space Hand Mesh Prediction with Differentiable Global Positioningcited by 7
- 2025EDM: Efficient Deep Feature Matchingcited by 7
- 2023Neural Voting Field for Camera-Space 3D Hand Pose Estimationcited by 6
- 2024Multi-view Hand Reconstruction with a Point-Embedded Transformercited by 6
- 2025UniHOPE: A Unified Approach for Hand-Only and Hand-Object Pose Estimationcited by 6
- 2023CLIP-Hand3D: Exploiting 3D Hand Pose Estimation via Context-Aware Promptingcited by 5
- 2024Weakly-Supervised 3D Hand Reconstruction with Knowledge Prior and Uncertainty Guidancecited by 5
- 2024MaskHand: Generative Masked Modeling for Robust Hand Mesh Reconstruction in the Wildcited by 5
- 2025Diffusion-based 3D Hand Motion Recovery with Intuitive Physicscited by 5
- 2023Overcoming the Trade-off Between Accuracy and Plausibility in 3D Hand Shape Reconstructioncited by 4
- 2024HandGCAT: Occlusion-Robust 3D Hand Mesh Reconstruction from Monocular Imagescited by 4
- 2025Hand-Shadow Posercited by 4
- 2026PAD-Hand: Physics-Aware Diffusion for Hand Motion Recoverycited by 4
- 20231st Place Solution of Egocentric 3D Hand Pose Estimation Challenge 2023 Technical Report:A Concise Pipeline for Egocentric Hand Pose Reconstructioncited by 3
- 2024Low-Energy On-Device Personalization for MCUscited by 3
- 2024MLPHand: Real Time Multi-View 3D Hand Mesh Reconstruction via MLP Modelingcited by 3
- 2025QORT-Former: Query-optimized Real-time Transformer for Understanding Two Hands Manipulating Objectscited by 3
- 2025Occlusion-Aware 3D Hand-Object Pose Estimation with Masked AutoEncoderscited by 3
- 2026EgoHandICL: Egocentric 3D Hand Reconstruction with In-Context Learningcited by 3
- 2026PEAR: Pixel-aligned Expressive humAn mesh Recoverycited by 3
- 2026EgoForce: Forearm-Guided Camera-Space 3D Hand Pose from a Monocular Egocentric Cameracited by 3
- 2024SiMA-Hand: Boosting 3D Hand-Mesh Reconstruction by Single-to-Multi-View Adaptationcited by 2
- 20243D Hand Reconstruction via Aggregating Intra and Inter Graphs Guided by Prior Knowledge for Hand-Object Interaction Scenariocited by 2
- 2024XHand: Real-time Expressive Hand Avatarcited by 2
- 2025Rodrigues Network for Learning Robot Actionscited by 2
50 most cited of 74 All 74 (JSON)
- 2026EgoFound3R: End-to-End Egocentric Hand Reconstruction in World Space with Point-Wise Interaction Attributes1 Oct 2026
- 2026ESTHER: Egocentric Stereo Hand Estimation and Reconstruction in the Wild28 Sep 2026
- 2026EventEgoHands++: Event-based Egocentric 3D Hand Mesh Reconstruction with Real Dataset15 Sep 2026
- 2026Hand-Object Interaction in the Age of Large Foundation Models:Reconstruction, Generation, and Embodied Transfer30 Jul 2026
- 2026ScaleHP: Scale-Mediated Optimization of Coupled Errors for Metric-Space Hand Pose Estimation24 Jun 2026
- 2026UST-Hand: An Uncertainty-aware Spatiotemporal Point Cloud Interaction Network for 3D Self-supervised Hand Pose Estimation18 May 2026
- 2026EgoForce: Forearm-Guided Camera-Space 3D Hand Pose from a Monocular Egocentric Camera12 May 2026
- 2026PAD-Hand: Physics-Aware Diffusion for Hand Motion Recovery27 Mar 2026
- 2026AnyHand: A Large-Scale Synthetic Dataset for RGB(-D) Hand Pose Estimation26 Mar 2026
- 2026GenHOI: Generalized Hand-Object Pose Estimation with Occlusion Awareness19 Mar 2026
- 2026PEAR: Pixel-aligned Expressive humAn mesh Recovery30 Jan 2026
- 2026EgoHandICL: Egocentric 3D Hand Reconstruction with In-Context Learning27 Jan 2026
38 more
- 2025DF-Mamba: Deformable State Space Modeling for 3D Hand Pose Estimation in Interactions2 Dec 2025
- 2025SPLite Hand: Sparsity-Aware Lightweight 3D Hand Pose Estimation18 Oct 2025
- 2025Cascaded Diffusion Framework for Probabilistic Coarse-to-Fine Hand Pose Estimation1 Oct 2025
- 2025EvHand-FPV: Efficient Event-Based 3D Hand Tracking from First-Person View17 Sep 2025
- 2025Learning Correlation-aware Aleatoric Uncertainty for 3D Hand Pose Estimation1 Sep 2025
- 2025Enhancing Monocular 3D Hand Reconstruction with Learned Texture Priors13 Aug 2025
- 2025Diffusion-based 3D Hand Motion Recovery with Intuitive Physics3 Aug 2025
- 2025EHPE: A Segmented Architecture for Enhanced Hand Pose Estimation13 Jul 2025
- 2025Occlusion-Aware 3D Hand-Object Pose Estimation with Masked AutoEncoders12 Jun 2025
- 2025Rodrigues Network for Learning Robot Actions3 Jun 2025
- 2025M3DHMR: Monocular 3D Hand Mesh Recovery26 May 2025
- 2025Hand-Shadow Poser11 May 2025
- 2025GUAVA: Generalizable Upper Body 3D Gaussian Avatar6 May 2025
- 2025Direction-Aware Hybrid Representation Learning for 3D Hand Pose and Shape Estimation2 Apr 2025
- 2025UniHOPE: A Unified Approach for Hand-Only and Hand-Object Pose Estimation17 Mar 2025
- 2025EDM: Efficient Deep Feature Matching7 Mar 2025
- 2025QORT-Former: Query-optimized Real-time Transformer for Understanding Two Hands Manipulating Objects27 Feb 2025
- 2025Learning Transformation-Isomorphic Latent Space for Accurate Hand Pose Estimation18 Feb 2025
- 2025Predicting 4D Hand Trajectory from Monocular Videos14 Jan 2025
- 2024MaskHand: Generative Masked Modeling for Robust Hand Mesh Reconstruction in the Wild18 Dec 2024
- 2024HandOS: 3D Hand Reconstruction in One Stage2 Dec 2024
- 2024WiLoR: End-to-end 3D Hand Localization and Reconstruction in-the-wild18 Sep 2024
- 2024Multi-view Hand Reconstruction with a Point-Embedded Transformer20 Aug 2024
- 2024PEAR: Phrase-Based Hand-Object Interaction Anticipation31 Jul 2024
- 2024XHand: Real-time Expressive Hand Avatar30 Jul 2024
- 2024HandDGP: Camera-Space Hand Mesh Prediction with Differentiable Global Positioning22 Jul 2024
- 2024Weakly-Supervised 3D Hand Reconstruction with Knowledge Prior and Uncertainty Guidance17 Jul 2024
- 2024Hamba: Single-view 3D Hand Reconstruction with Graph-guided Bi-Scanning Mamba12 Jul 2024
- 2024STMR: Spiral Transformer for Hand Mesh Reconstruction8 Jul 2024
- 2024MLPHand: Real Time Multi-View 3D Hand Mesh Reconstruction via MLP Modeling23 Jun 2024
- 2024HHMR: Holistic Hand Mesh Recovery by Enhancing the Multimodal Controllability of Graph Diffusion Models3 Jun 2024
- 20243D Hand Mesh Recovery from Monocular RGB in Camera Space12 May 2024
- 2024RHanDS: Refining Malformed Hands for Generated Images with Decoupled Structure and Style Guidance22 Apr 2024
- 2024HandBooster: Boosting 3D Hand-Mesh Reconstruction by Conditional Synthesis and Sampling of Hand-Object Interactions27 Mar 2024
- 2024Benchmarks and Challenges in Pose Estimation for Egocentric Hand Interactions with Objects25 Mar 2024
- 2024Low-Energy On-Device Personalization for MCUs12 Mar 2024
- 2024Complementing Event Streams and RGB Frames for Hand Mesh Reconstruction12 Mar 2024
- 2024A Simple Baseline for Efficient Hand Mesh Reconstruction4 Mar 2024
50 newest of 74 All 74 (JSON)
- 2024HHMR: Holistic Hand Mesh Recovery by Enhancing the Multimodal Controllability of Graph Diffusion Modelscited by 14
- 2024RHanDS: Refining Malformed Hands for Generated Images with Decoupled Structure and Style Guidancecited by 9
- 2023DiffHand: End-to-End Hand Mesh Reconstruction via Diffusion Modelscited by 7
- 2025Cascaded Diffusion Framework for Probabilistic Coarse-to-Fine Hand Pose Estimationcited by 0
- 2025Cascaded Diffusion Framework for Probabilistic Coarse-to-Fine Hand Pose Estimation1 Oct 2025
- 2024HHMR: Holistic Hand Mesh Recovery by Enhancing the Multimodal Controllability of Graph Diffusion Models3 Jun 2024
- 2024RHanDS: Refining Malformed Hands for Generated Images with Decoupled Structure and Style Guidance22 Apr 2024
- 2023DiffHand: End-to-End Hand Mesh Reconstruction via Diffusion Models23 May 2023
- 2023Reconstructing Hands in 3D with Transformerscited by 306
- 2023FastViT: A Fast Hybrid Vision Transformer using Structural Reparameterizationcited by 162
- 2024WiLoR: End-to-end 3D Hand Localization and Reconstruction in-the-wildcited by 124
- 2024TACO: Benchmarking Generalizable Bimanual Tool-ACtion-Object Understandingcited by 88
- 2024Benchmarks and Challenges in Pose Estimation for Egocentric Hand Interactions with Objectscited by 35
- 2023A Probabilistic Attention Model with Occlusion-aware Texture Regression for 3D Hand Reconstruction from a Single RGB Imagecited by 32
- 2024A Simple Baseline for Efficient Hand Mesh Reconstructioncited by 27
- 2022DART: Articulated Hand Model with Diverse Accessories and Rich Texturescited by 25
- 2023Mobile Foundation Model as Firmwarecited by 25
- 2025GUAVA: Generalizable Upper Body 3D Gaussian Avatarcited by 22
- 2025Predicting 4D Hand Trajectory from Monocular Videoscited by 21
- 2023High Fidelity 3D Hand Shape Reconstruction via Scalable Graph Frequency Decompositioncited by 18
12 most cited of 68 All 68 (JSON)
- 2026EgoFound3R: End-to-End Egocentric Hand Reconstruction in World Space with Point-Wise Interaction Attributes1 Oct 2026
- 2026ESTHER: Egocentric Stereo Hand Estimation and Reconstruction in the Wild28 Sep 2026
- 2026EventEgoHands++: Event-based Egocentric 3D Hand Mesh Reconstruction with Real Dataset15 Sep 2026
- 2026Hand-Object Interaction in the Age of Large Foundation Models:Reconstruction, Generation, and Embodied Transfer30 Jul 2026
- 2026ScaleHP: Scale-Mediated Optimization of Coupled Errors for Metric-Space Hand Pose Estimation24 Jun 2026
- 2026UST-Hand: An Uncertainty-aware Spatiotemporal Point Cloud Interaction Network for 3D Self-supervised Hand Pose Estimation18 May 2026
- 2026EgoForce: Forearm-Guided Camera-Space 3D Hand Pose from a Monocular Egocentric Camera12 May 2026
- 2026PAD-Hand: Physics-Aware Diffusion for Hand Motion Recovery27 Mar 2026
- 2026AnyHand: A Large-Scale Synthetic Dataset for RGB(-D) Hand Pose Estimation26 Mar 2026
- 2026GenHOI: Generalized Hand-Object Pose Estimation with Occlusion Awareness19 Mar 2026
- 2026PEAR: Pixel-aligned Expressive humAn mesh Recovery30 Jan 2026
- 2026EgoHandICL: Egocentric 3D Hand Reconstruction with In-Context Learning27 Jan 2026
12 newest of 68 All 68 (JSON)