I2L-MeshNet: Image-to-Lixel Prediction Network for Accurate 3D Human Pose and Mesh Estimation from a Single RGB Image
Not on the map. Why?
Abstract (arXiv)
Most of the previous image-based 3D human pose and mesh estimation methods estimate parameters of the human mesh model from an input image. However, directly regressing the parameters from the input image is a highly non-linear mapping because it breaks the spatial relationship between pixels in the input image. In addition, it cannot model the prediction uncertainty, which can make training harder. To resolve the above issues, we propose I2L-MeshNet, an image-to-lixel (line+pixel) prediction network. The proposed I2L-MeshNet predicts the per-lixel likelihood on 1D heatmaps for each mesh vertex coordinate instead of directly regressing the parameters. Our lixel-based 1D heatmap preserves the spatial relationship in the input image and models the prediction uncertainty. We demonstrate the benefit of the image-to-lixel prediction and show that the proposed I2L-MeshNet outperforms previous methods. The code is publicly available https://github.com/mks0601/I2L-MeshNet_RELEASE.
Key facts. Cited by 274 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Aug 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 51; 2022: 53; 2023: 76; 2024: 51; 2025: 24; 2026: 19.
274 papers.
Sort:
By area:
- 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 344
- 2021PARE: Part Attention Regressor for 3D Human Body Estimationcited by 334
- 2023Reconstructing Hands in 3D with Transformerscited by 298
- 20213D Human Pose Estimation with Spatial and Temporal Transformerscited by 271
- 2021Mesh Graphormercited by 264
- 2021PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loopcited by 250
- 2022CLIFF: Carrying Location Information in Full Frames into Human Pose and Shape Estimationcited by 237
- 2023WHAM: Reconstructing World-grounded Humans with Accurate 3D Motioncited by 200
- 2022MotionBERT: A Unified Perspective on Learning Human Motion Representationscited by 188
- 2022Capturing and Inferring Dense Full-Body Human-Scene Contactcited by 176
- 2021FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and Integrationcited by 168
- 2023FastViT: A Fast Hybrid Vision Transformer using Structural Reparameterizationcited by 161
38 more
- 2022PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Imagescited by 152
- 2021GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Camerascited by 151
- 2024Scaling Up Dynamic Human-Scene Interaction Modelingcited by 137
- 2021EgoBody: Human Body Shape and Motion of Interacting People from Head-Mounted Devicescited by 136
- 2021SPEC: Seeing People in the Wild with an Estimated Cameracited by 134
- 2022OakInk: A Large-scale Knowledge Repository for Understanding Hand-Object Interactioncited by 129
- 2021Keypoint Transformer: Solving Joint Identification in Challenging Hands and Object Interactions for Accurate 3D Pose Estimationcited by 122
- 2024WiLoR: End-to-end 3D Hand Localization and Reconstruction in-the-wildcited by 117
- 2022HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modelingcited by 115
- 2021SimPoE: Simulated Character Control for 3D Human Pose Estimationcited by 111
- 2024TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videoscited by 105
- 2022Recovering 3D Human Mesh from Monocular Images: A Surveycited by 103
- 2021Dynamics-Regulated Kinematic Policy for Egocentric Pose Estimationcited by 101
- 20233D Human Pose Estimation via Intuitive Physicscited by 100
- 2022Not All Tokens Are Equal: Human-centric Visual Analysis via Token Clustering Transformercited by 99
- 2022HandOccNet: Occlusion-Robust 3D Hand Mesh Estimation Networkcited by 95
- 2023PoseFormerV2: Exploring Frequency Domain for Efficient and Robust 3D Human Pose Estimationcited by 91
- 2022Cross-Attention of Disentangled Modalities for 3D Human Mesh Recovery with Transformerscited by 81
- 2021MobRecon: Mobile-Friendly Hand Mesh Reconstruction from Monocular Imagecited by 74
- 2025PromptHMR: Promptable Human Mesh Recoverycited by 70
- 2021Model-based 3D Hand Reconstruction via Self-Supervised Learningcited by 65
- 2021Learning to Estimate Robust 3D Human Mesh from In-the-Wild Crowded Scenescited by 64
- 2021Playing for 3D Human Recoverycited by 63
- 2022LISA: Learning Implicit Shape and Appearance of Handscited by 63
- 2021Encoder-decoder with Multi-level Attention for 3D Human Shape and Pose Estimationcited by 62
- 2021Camera-Space Hand Mesh Recovery via Semantic Aggregation and Adaptive 2D-1D Registrationcited by 59
- 2022Capturing Humans in Motion: Temporal-Attentive 3D Human Pose and Shape Estimation from Monocular Videocited by 59
- 2024Neural Localizer Fields for Continuous 3D Human Pose and Shape Estimationcited by 57
- 2021I2UV-HandNet: Image-to-UV Prediction Network for Accurate and High-fidelity 3D Hand Mesh Modelingcited by 52
- 2022Occluded Human Mesh Recoverycited by 52
- 2021THUNDR: Transformer-based 3D HUmaN Reconstruction with Markerscited by 50
- 2021A Skeleton-Driven Neural Occupancy Representation for Articulated Handscited by 50
- 2021Recent Advances in Monocular 2D and 3D Human Pose Estimation: A Deep Learning Perspectivecited by 49
- 2021Hierarchical Kinematic Probability Distributions for 3D Human Shape and Pose Estimation from Images in the Wildcited by 48
- 2023HybrIK-X: Hybrid Analytical-Neural Inverse Kinematics for Whole-body Mesh Recoverycited by 48
- 2021Reconstructing 3D Human Pose by Watching Humans in the Mirrorcited by 47
- 2023AffordPose: A Large-scale Dataset of Hand-Object Interactions with Affordance-driven Hand Posecited by 47
- 2023Global-to-Local Modeling for Video-based 3D Human Pose and Shape Estimationcited by 46
50 most cited of 274 All 274 (JSON)
- 2026ESTHER: Egocentric Stereo Hand Estimation and Reconstruction in the Wild28 Sep 2026
- 2026HandMvNet: Real-Time 3D Hand Pose Estimation Using Multi-View Cross-Attention Fusion20 Aug 2026
- 2026Reliability-Aware 3D Geometric Injection for Universal Person Re-identification21 Jul 2026
- 2026EgoExoMoCap: Distributed Ego-Exo Human Motion Capture17 Jul 2026
- 2026ScaleHP: Scale-Mediated Optimization of Coupled Errors for Metric-Space Hand Pose Estimation24 Jun 2026
- 2026GIVE: Grounding Human Gestures in Vision-Language-Action Models11 Jun 2026
- 2026GeoHand: Unlocking Prior Geometry Knowledge for Monocular 3D Hand Reconstruction17 May 2026
- 2026EgoForce: Forearm-Guided Camera-Space 3D Hand Pose from a Monocular Egocentric Camera12 May 2026
- 2026EgoEV-HandPose: Egocentric 3D Hand Pose Estimation and Gesture Recognition with Stereo Event Cameras12 May 2026
- 2026Dual-stream Spatio-Temporal GCN-Transformer Network for 3D Human Pose Estimation20 Apr 2026
- 2026AnyHand: A Large-Scale Synthetic Dataset for RGB(-D) Hand Pose Estimation26 Mar 2026
- 2026HGGT: Robust and Flexible 3D Hand Mesh Reconstruction from Uncalibrated Images25 Mar 2026
38 more
- 2026Fast-HaMeR: Boosting Hand Mesh Reconstruction using Knowledge Distillation17 Mar 2026
- 2026Enhancing Hands in 3D Whole-Body Pose Estimation with Conditional Hands Modulator16 Mar 2026
- 2026SesaHand: Enhancing 3D Hand Reconstruction via Controllable Generation with Semantic and Structural Alignment28 Feb 2026
- 2026SARS: A Novel Face and Body Shape and Appearance Aware 3D Reconstruction System extends Morphable Models10 Feb 2026
- 2026Hand3R: Online 4D Hand-Scene Reconstruction in the Wild3 Feb 2026
- 2026EgoHandICL: Egocentric 3D Hand Reconstruction with In-Context Learning27 Jan 2026
- 2026Masked Modeling for Human Motion Recovery Under Occlusions22 Jan 2026
- 2025PoseMoE: Mixture-of-Experts Network for Monocular 3D Human Pose Estimation18 Dec 2025
- 2025From Camera to World: A Plug-and-Play Module for Human Mesh Transformation17 Dec 2025
- 2025Robust Long-term Test-Time Adaptation for 3D Human Pose Estimation through Motion Discretization24 Nov 2025
- 2025MobileOcc: A Human-Aware Semantic Occupancy Dataset for Mobile Robots21 Nov 2025
- 2025Cascaded Diffusion Framework for Probabilistic Coarse-to-Fine Hand Pose Estimation1 Oct 2025
- 2025LieHMR: Autoregressive Human Mesh Recovery with SO(3) Diffusion30 Sep 2025
- 2025Learning Correlation-aware Aleatoric Uncertainty for 3D Hand Pose Estimation1 Sep 2025
- 2025PersPose: 3D Human Pose Estimation with Perspective Encoding and Perspective Rotation24 Aug 2025
- 2025PERSONA: Personalized Whole-Body 3D Avatar with Pose-Driven Deformations from a Single Image13 Aug 2025
- 2025Enhancing Monocular 3D Hand Reconstruction with Learned Texture Priors13 Aug 2025
- 2025Diffusion-based 3D Hand Motion Recovery with Intuitive Physics3 Aug 2025
- 2025Reconstructing 4D Spatial Intelligence: A Survey28 Jul 2025
- 2025A Structure-aware and Motion-adaptive Framework for 3D Human Pose Estimation with Mamba26 Jul 2025
- 2025Rodrigues Network for Learning Robot Actions3 Jun 2025
- 2025M3DHMR: Monocular 3D Hand Mesh Recovery26 May 2025
- 2025Hand-Shadow Poser11 May 2025
- 2025Single View Garment Reconstruction Using Diffusion Mapping Via Pattern Coordinates11 Apr 2025
- 2025PromptHMR: Promptable Human Mesh Recovery8 Apr 2025
- 2025Direction-Aware Hybrid Representation Learning for 3D Hand Pose and Shape Estimation2 Apr 2025
- 2025OccRobNet : Occlusion Robust Network for Accurate 3D Interacting Hand-Object Pose Estimation27 Mar 2025
- 2025CHROME: Clothed Human Reconstruction with Occlusion-Resilience and Multiview-Consistency from a Single Image19 Mar 2025
- 2025UniHOPE: A Unified Approach for Hand-Only and Hand-Object Pose Estimation17 Mar 2025
- 2025End-to-End HOI Reconstruction Transformer with Graph-based Encoding8 Mar 2025
- 2025Predicting 4D Hand Trajectory from Monocular Videos14 Jan 2025
- 2024HeatFormer: A Neural Optimizer for Multiview Human Mesh Recovery5 Dec 2024
- 2024HandOS: 3D Hand Reconstruction in One Stage2 Dec 2024
- 2024ProGraph: Temporally-alignable Probability Guided Graph Topological Modeling for 3D Human Reconstruction7 Nov 2024
- 2024Multi-modal Pose Diffuser: A Multimodal Generative Conditional Pose Prior18 Oct 2024
- 2024Look Ma, no markers: holistic performance capture without the hassle15 Oct 2024
- 2024Multi-hypotheses Conditioned Point Cloud Diffusion for 3D Human Reconstruction from Occluded Images27 Sep 2024
- 2024WiLoR: End-to-end 3D Hand Localization and Reconstruction in-the-wild18 Sep 2024
50 newest of 274 All 274 (JSON)
- 2024COIN: Control-Inpainting Diffusion Prior for Human and Camera Motion Estimationcited by 15
- 2024HHMR: Holistic Hand Mesh Recovery by Enhancing the Multimodal Controllability of Graph Diffusion Modelscited by 14
- 2023DiffHand: End-to-End Hand Mesh Reconstruction via Diffusion Modelscited by 7
- 2024Multi-hypotheses Conditioned Point Cloud Diffusion for 3D Human Reconstruction from Occluded Imagescited by 5
- 2024Multi-modal Pose Diffuser: A Multimodal Generative Conditional Pose Priorcited by 2
- 2025Cascaded Diffusion Framework for Probabilistic Coarse-to-Fine Hand Pose Estimationcited by 0
- 2025Cascaded Diffusion Framework for Probabilistic Coarse-to-Fine Hand Pose Estimation1 Oct 2025
- 2024Multi-modal Pose Diffuser: A Multimodal Generative Conditional Pose Prior18 Oct 2024
- 2024Multi-hypotheses Conditioned Point Cloud Diffusion for 3D Human Reconstruction from Occluded Images27 Sep 2024
- 2024COIN: Control-Inpainting Diffusion Prior for Human and Camera Motion Estimation29 Aug 2024
- 2024HHMR: Holistic Hand Mesh Recovery by Enhancing the Multimodal Controllability of Graph Diffusion Models3 Jun 2024
- 2023DiffHand: End-to-End Hand Mesh Reconstruction via Diffusion Models23 May 2023
- 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 344
- 2021PARE: Part Attention Regressor for 3D Human Body Estimationcited by 334
- 2023Reconstructing Hands in 3D with Transformerscited by 298
- 20213D Human Pose Estimation with Spatial and Temporal Transformerscited by 271
- 2021Mesh Graphormercited by 264
- 2021PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loopcited by 250
- 2022CLIFF: Carrying Location Information in Full Frames into Human Pose and Shape Estimationcited by 237
- 2023WHAM: Reconstructing World-grounded Humans with Accurate 3D Motioncited by 200
- 2022MotionBERT: A Unified Perspective on Learning Human Motion Representationscited by 188
- 2022Capturing and Inferring Dense Full-Body Human-Scene Contactcited by 176
- 2021FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and Integrationcited by 168
- 2023FastViT: A Fast Hybrid Vision Transformer using Structural Reparameterizationcited by 161
12 most cited of 264 All 264 (JSON)
- 2026ESTHER: Egocentric Stereo Hand Estimation and Reconstruction in the Wild28 Sep 2026
- 2026HandMvNet: Real-Time 3D Hand Pose Estimation Using Multi-View Cross-Attention Fusion20 Aug 2026
- 2026Reliability-Aware 3D Geometric Injection for Universal Person Re-identification21 Jul 2026
- 2026EgoExoMoCap: Distributed Ego-Exo Human Motion Capture17 Jul 2026
- 2026ScaleHP: Scale-Mediated Optimization of Coupled Errors for Metric-Space Hand Pose Estimation24 Jun 2026
- 2026GeoHand: Unlocking Prior Geometry Knowledge for Monocular 3D Hand Reconstruction17 May 2026
- 2026EgoForce: Forearm-Guided Camera-Space 3D Hand Pose from a Monocular Egocentric Camera12 May 2026
- 2026EgoEV-HandPose: Egocentric 3D Hand Pose Estimation and Gesture Recognition with Stereo Event Cameras12 May 2026
- 2026Dual-stream Spatio-Temporal GCN-Transformer Network for 3D Human Pose Estimation20 Apr 2026
- 2026AnyHand: A Large-Scale Synthetic Dataset for RGB(-D) Hand Pose Estimation26 Mar 2026
- 2026HGGT: Robust and Flexible 3D Hand Mesh Reconstruction from Uncalibrated Images25 Mar 2026
- 2026Fast-HaMeR: Boosting Hand Mesh Reconstruction using Knowledge Distillation17 Mar 2026
12 newest of 264 All 264 (JSON)