Mesh Graphormer
Not on the map. Why?
Abstract (arXiv)
We present a graph-convolution-reinforced transformer, named Mesh Graphormer, for 3D human pose and mesh reconstruction from a single image. Recently both transformers and graph convolutional neural networks (GCNNs) have shown promising progress in human mesh reconstruction. Transformer-based approaches are effective in modeling non-local interactions among 3D mesh vertices and body joints, whereas GCNNs are good at exploiting neighborhood vertex interactions based on a pre-specified mesh topology. In this paper, we study how to combine graph convolutions and self-attentions in a transformer to model both local and global interactions. Experimental results show that our proposed method, Mesh Graphormer, significantly outperforms the previous state-of-the-art methods on multiple benchmarks, including Human3.6M, 3DPW, and FreiHAND datasets. Code and pre-trained models are available at https://github.com/microsoft/MeshGraphormer
Key facts. Cited by 264 papers in the map (data through 7 Oct 2026). Builds on 36 of its 44 references that are in the map. First posted on arXiv 1 Apr 2021.
Builds on
36 of 44 references.
References · 36
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2016Layer Normalizationcited by 5,579
- 2016Gaussian Error Linear Units (GELUs)cited by 3,431
- 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
- 2018Group Normalizationcited by 1,514
- 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,417
- 2021Transformers in Vision: A Surveycited by 1,009
- 2017End-to-end Recovery of Human Shape and Posecited by 883
24 more
- 2020Efficient Transformers: A Surveycited by 784
- 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 649
- 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 625
- 2019VIBE: Video Inference for Human Body Pose and Shape Estimationcited by 615
- 2018DensePose: Dense Human Pose Estimation In The Wildcited by 573
- 2020End-to-End Human Pose and Mesh Reconstruction with Transformerscited by 417
- 2020I2L-MeshNet: Image-to-Lixel Prediction Network for Accurate 3D Human Pose and Mesh Estimation from a Single RGB Imagecited by 274
- 2019FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Imagescited by 271
- 2019Convolutional Mesh Regression for Single-Image Human Shape Reconstructioncited by 270
- 2018Generating 3D faces using Convolutional Mesh Autoencoderscited by 267
- 2020Pose2Mesh: Graph Convolutional Network for 3D Human Pose and Mesh Recovery from a 2D Human Posecited by 248
- 2018Learning to Estimate 3D Human Pose and Shape from a Single Color Imagecited by 226
- 2017Unite the People: Closing the Loop Between 3D and 2D Human Representationscited by 205
- 2017Single-Shot Multi-Person 3D Pose Estimation From Monocular RGBcited by 195
- 2018Neural Body Fitting: Unifying Deep Learning and Model-Based Human Pose and Shape Estimationcited by 185
- 2018QANet: Combining Local Convolution with Global Self-Attention for Reading Comprehensioncited by 164
- 2020Beyond Static Features for Temporally Consistent 3D Human Pose and Shape from a Videocited by 162
- 2020In Defense of Grid Features for Visual Question Answeringcited by 155
- 2018A2-Nets: Double Attention Networkscited by 136
- 2020Lite Transformer with Long-Short Range Attentioncited by 127
- 2017Self-supervised Learning of Motion Capturecited by 97
- 2020Human Mesh Recovery from Multiple Shotscited by 52
- 2019Learning 3D Human Shape and Pose from Dense Body Partscited by 48
- 2017MonoCap: Monocular Human Motion Capture using a CNN Coupled with a Geometric Priorcited by 36
Built on by
Citing papers per year: 2021: 10; 2022: 45; 2023: 80; 2024: 69; 2025: 37; 2026: 23.
264 papers.
Sort:
By area:
- 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 344
- 2022HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interactioncited by 321
- 2023Reconstructing Hands in 3D with Transformerscited by 298
- 2022CLIFF: Carrying Location Information in Full Frames into Human Pose and Shape Estimationcited by 237
- 2023BEDLAM: A Synthetic Dataset of Bodies Exhibiting Detailed Lifelike Animated Motioncited by 229
- 2022Pure Transformers are Powerful Graph Learnerscited by 188
- 2022MotionBERT: A Unified Perspective on Learning Human Motion Representationscited by 188
- 2022Capturing and Inferring Dense Full-Body Human-Scene Contactcited by 176
- 2023FastViT: A Fast Hybrid Vision Transformer using Structural Reparameterizationcited by 161
- 2022PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Imagescited by 152
- 2021Keypoint Transformer: Solving Joint Identification in Challenging Hands and Object Interactions for Accurate 3D Pose Estimationcited by 122
- 2024WiLoR: End-to-end 3D Hand Localization and Reconstruction in-the-wildcited by 117
38 more
- 2022Transformer for Graphs: An Overview from Architecture Perspectivecited by 107
- 2024TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videoscited by 105
- 2022Recovering 3D Human Mesh from Monocular Images: A Surveycited by 103
- 2022Not All Tokens Are Equal: Human-centric Visual Analysis via Token Clustering Transformercited by 99
- 2023EMDB: The Electromagnetic Database of Global 3D Human Pose and Shape in the Wildcited by 95
- 2024TokenHMR: Advancing Human Mesh Recovery with a Tokenized Pose Representationcited by 93
- 2022Interacting Attention Graph for Single Image Two-Hand Reconstructioncited by 87
- 2024DINO-X: A Unified Vision Model for Open-World Object Detection and Understandingcited by 85
- 2022Cross-Attention of Disentangled Modalities for 3D Human Mesh Recovery with Transformerscited by 81
- 2023Attending to Graph Transformerscited by 81
- 2021MobRecon: Mobile-Friendly Hand Mesh Reconstruction from Monocular Imagecited by 74
- 2025PromptHMR: Promptable Human Mesh Recoverycited by 70
- 2025HaWoR: World-Space Hand Motion Reconstruction from Egocentric Videoscited by 62
- 2023EgoHumans: An Egocentric 3D Multi-Human Benchmarkcited by 58
- 2024Neural Localizer Fields for Continuous 3D Human Pose and Shape Estimationcited by 57
- 2022A Survey on Graph Neural Networks and Graph Transformers in Computer Vision: A Task-Oriented Perspectivecited by 56
- 2022Occluded Human Mesh Recoverycited by 52
- 2022Learning 3D Human Pose Estimation from Dozens of Datasets using a Geometry-Aware Autoencoder to Bridge Between Skeleton Formatscited by 50
- 2023ReFit: Recurrent Fitting Network for 3D Human Recoverycited by 47
- 2023NIKI: Neural Inverse Kinematics with Invertible Neural Networks for 3D Human Pose and Shape Estimationcited by 45
- 2024Hamba: Single-view 3D Hand Reconstruction with Graph-guided Bi-Scanning Mambacited by 45
- 20233D Human Mesh Estimation from Virtual Markerscited by 44
- 2023HandRefiner: Refining Malformed Hands in Generated Images by Diffusion-based Conditional Inpaintingcited by 42
- 2022TORE: Token Reduction for Efficient Human Mesh Recovery with Transformercited by 41
- 2023Zolly: Zoom Focal Length Correctly for Perspective-Distorted Human Mesh Reconstructioncited by 41
- 2023Realistic Full-Body Tracking from Sparse Observations via Joint-Level Modelingcited by 41
- 2024AiOS: All-in-One-Stage Expressive Human Pose and Shape Estimationcited by 41
- 2024Score-Guided Diffusion for 3D Human Recoverycited by 39
- 2023ACR: Attention Collaboration-based Regressor for Arbitrary Two-Hand Reconstructioncited by 37
- 2021ElePose: Unsupervised 3D Human Pose Estimation by Predicting Camera Elevation and Learning Normalizing Flows on 2D Posescited by 35
- 2022Hierarchical Temporal Transformer for 3D Hand Pose Estimation and Action Recognition from Egocentric RGB Videoscited by 35
- 2021AdaptPose: Cross-Dataset Adaptation for 3D Human Pose Estimation by Learnable Motion Generationcited by 32
- 2022MeshMAE: Masked Autoencoders for 3D Mesh Data Analysiscited by 31
- 2023PSVT: End-to-End Multi-person 3D Pose and Shape Estimation with Progressive Video Transformerscited by 31
- 2023POTTER: Pooling Attention Transformer for Efficient Human Mesh Recoverycited by 31
- 2024Harmony4D: A Video Dataset for In-The-Wild Close Human Interactionscited by 31
- 2022Benchmarking and Analyzing 3D Human Pose and Shape Estimation Beyond Algorithmscited by 28
- 20233D-Aware Neural Body Fitting for Occlusion Robust 3D Human Pose Estimationcited by 28
50 most cited of 264 All 264 (JSON)
- 2026EgoFound3R: End-to-End Egocentric Hand Reconstruction in World Space with Point-Wise Interaction Attributes1 Oct 2026
- 2026ESTHER: Egocentric Stereo Hand Estimation and Reconstruction in the Wild28 Sep 2026
- 2026EventEgoHands++: Event-based Egocentric 3D Hand Mesh Reconstruction with Real Dataset15 Sep 2026
- 2026Reconstructing Humans and Objects in Interaction using Large Reconstruction Models27 Aug 2026
- 2026Hand Visibility Detector: Per-Keypoint Visibility Estimation for Hands12 Aug 2026
- 2026Reliability-Aware 3D Geometric Injection for Universal Person Re-identification21 Jul 2026
- 2026EgoExoMoCap: Distributed Ego-Exo Human Motion Capture17 Jul 2026
- 2026Again-Pose: Anchor-Guided Adaptive Inter-Frame Motion Cues Propagating for High-quality Human Pose Reconstruction28 Jun 2026
- 2026AVI-HT: Adaptive Vision-IMU Fusion for 3D Hand Tracking20 May 2026
- 2026StableHand: Quality-Aware Flow Matching for World-Space Dual-Hand Motion Estimation from Egocentric Video18 May 2026
- 2026GeoHand: Unlocking Prior Geometry Knowledge for Monocular 3D Hand Reconstruction17 May 2026
- 2026Tamaththul3D: High-Fidelity 3D Saudi Sign Language Avatars from Monocular Video6 May 2026
38 more
- 2026ResiHMR: Residual-Limb Aware Single-Image 3D Human Mesh Recovery for Individuals with Limb Loss30 Apr 2026
- 2026LEXIS: LatEnt ProXimal Interaction Signatures for 3D HOI from an Image22 Apr 2026
- 2026AnyHand: A Large-Scale Synthetic Dataset for RGB(-D) Hand Pose Estimation26 Mar 2026
- 2026GraphiContact: Pose-aware Human-Scene Robust Contact Perception for Interactive Systems19 Mar 2026
- 2026Fast-HaMeR: Boosting Hand Mesh Reconstruction using Knowledge Distillation17 Mar 2026
- 2026WHOLE: World-Grounded Hand-Object Lifted from Egocentric Videos25 Feb 2026
- 2026UniHand: A Unified Model for Diverse Controlled 4D Hand Motion Modeling25 Feb 2026
- 2026SARS: A Novel Face and Body Shape and Appearance Aware 3D Reconstruction System extends Morphable Models10 Feb 2026
- 2026Hand3R: Online 4D Hand-Scene Reconstruction in the Wild3 Feb 2026
- 2026BBoxMaskPose v2: Expanding Mutual Conditioning to 3D21 Jan 2026
- 2026ARMARecon: An ARMA Convolutional Filter based Graph Neural Network for Neurodegenerative Dementias Classification17 Jan 2026
- 2025Towards Practical Large-scale Dynamical Heterogeneous Graph Embedding: Cold-start Resilient Recommendation15 Dec 2025
- 2025MobileOcc: A Human-Aware Semantic Occupancy Dataset for Mobile Robots21 Nov 2025
- 2025Sketch-Augmented Features Improve Learning Long-Range Dependencies in Graph Neural Networks5 Nov 2025
- 2025SPLite Hand: Sparsity-Aware Lightweight 3D Hand Pose Estimation18 Oct 2025
- 2025DARTS-GT: Differentiable Architecture Search for Graph Transformers with Quantifiable Instance-Specific Interpretability Analysis16 Oct 2025
- 2025On the Use of Hierarchical Vision Foundation Models for Low-Cost Human Mesh Recovery and Pose Estimation14 Oct 2025
- 2025Graph Integrated Multimodal Concept Bottleneck Model1 Oct 2025
- 2025Cascaded Diffusion Framework for Probabilistic Coarse-to-Fine Hand Pose Estimation1 Oct 2025
- 2025Affordance-Guided Diffusion Prior for 3D Hand Reconstruction1 Oct 2025
- 2025LieHMR: Autoregressive Human Mesh Recovery with SO(3) Diffusion30 Sep 2025
- 20253D Human Pose and Shape Estimation from LiDAR Point Clouds: A Review15 Sep 2025
- 2025HodgeFormer: Transformers for Learnable Operators on Triangular Meshes through Data-Driven Hodge Matrices1 Sep 2025
- 2025Learning Correlation-aware Aleatoric Uncertainty for 3D Hand Pose Estimation1 Sep 2025
- 2025PHD: Personalized 3D Human Body Fitting with Point Diffusion28 Aug 2025
- 2025PersPose: 3D Human Pose Estimation with Perspective Encoding and Perspective Rotation24 Aug 2025
- 2025Enhancing Monocular 3D Hand Reconstruction with Learned Texture Priors13 Aug 2025
- 2025MeshMamba: State Space Models for Articulated 3D Mesh Generation and Reconstruction21 Jul 2025
- 2025Mask6D: Masked Pose Priors For 6D Object Pose Estimation9 Jul 2025
- 20253D Hand Mesh-Guided AI-Generated Malformed Hand Refinement with Hand Pose Transformation via Diffusion Model15 Jun 2025
- 2025Rodrigues Network for Learning Robot Actions3 Jun 2025
- 2025M3DHMR: Monocular 3D Hand Mesh Recovery26 May 2025
- 2025Learning Dense Hand Contact Estimation from Imbalanced Data16 May 2025
- 2025PICO: Reconstructing 3D People In Contact with Objects24 Apr 2025
- 2025ODHSR: Online Dense 3D Reconstruction of Humans and Scenes from Monocular Videos17 Apr 2025
- 2025Unsupervised Cross-Domain 3D Human Pose Estimation via Pseudo-Label-Guided Global Transforms17 Apr 2025
- 2025PromptHMR: Promptable Human Mesh Recovery8 Apr 2025
- 2025InteractVLM: 3D Interaction Reasoning from 2D Foundational Models7 Apr 2025
50 newest of 264 All 264 (JSON)
- 2023HandRefiner: Refining Malformed Hands in Generated Images by Diffusion-based Conditional Inpaintingcited by 42
- 2024Score-Guided Diffusion for 3D Human Recoverycited by 39
- 2024HHMR: Holistic Hand Mesh Recovery by Enhancing the Multimodal Controllability of Graph Diffusion Modelscited by 14
- 2024RHanDS: Refining Malformed Hands for Generated Images with Decoupled Structure and Style Guidancecited by 9
- 2024Diffusion Models are Efficient Data Generators for Human Mesh Recoverycited by 8
- 2023DiffHand: End-to-End Hand Mesh Reconstruction via Diffusion Modelscited by 7
- 2024DiffSurf: A Transformer-based Diffusion Model for Generating and Reconstructing 3D Surfaces in Posecited by 2
- 2025Affordance-Guided Diffusion Prior for 3D Hand Reconstructioncited by 2
- 2026StableHand: Quality-Aware Flow Matching for World-Space Dual-Hand Motion Estimation from Egocentric Videocited by 2
- 20253D Hand Mesh-Guided AI-Generated Malformed Hand Refinement with Hand Pose Transformation via Diffusion Modelcited by 0
- 2025Cascaded Diffusion Framework for Probabilistic Coarse-to-Fine Hand Pose Estimationcited by 0
- 2026StableHand: Quality-Aware Flow Matching for World-Space Dual-Hand Motion Estimation from Egocentric Video18 May 2026
- 2025Cascaded Diffusion Framework for Probabilistic Coarse-to-Fine Hand Pose Estimation1 Oct 2025
- 2025Affordance-Guided Diffusion Prior for 3D Hand Reconstruction1 Oct 2025
- 20253D Hand Mesh-Guided AI-Generated Malformed Hand Refinement with Hand Pose Transformation via Diffusion Model15 Jun 2025
- 2024DiffSurf: A Transformer-based Diffusion Model for Generating and Reconstructing 3D Surfaces in Pose27 Aug 2024
- 2024HHMR: Holistic Hand Mesh Recovery by Enhancing the Multimodal Controllability of Graph Diffusion Models3 Jun 2024
- 2024RHanDS: Refining Malformed Hands for Generated Images with Decoupled Structure and Style Guidance22 Apr 2024
- 2024Diffusion Models are Efficient Data Generators for Human Mesh Recovery17 Mar 2024
- 2024Score-Guided Diffusion for 3D Human Recovery14 Mar 2024
- 2023HandRefiner: Refining Malformed Hands in Generated Images by Diffusion-based Conditional Inpainting29 Nov 2023
- 2023DiffHand: End-to-End Hand Mesh Reconstruction via Diffusion Models23 May 2023
- 2025Graph Integrated Multimodal Concept Bottleneck Modelcited by 1
- 2025Graph Integrated Multimodal Concept Bottleneck Model1 Oct 2025
- 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 344
- 2022HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interactioncited by 321
- 2023Reconstructing Hands in 3D with Transformerscited by 298
- 2022CLIFF: Carrying Location Information in Full Frames into Human Pose and Shape Estimationcited by 237
- 2023BEDLAM: A Synthetic Dataset of Bodies Exhibiting Detailed Lifelike Animated Motioncited by 229
- 2022Pure Transformers are Powerful Graph Learnerscited by 188
- 2022MotionBERT: A Unified Perspective on Learning Human Motion Representationscited by 188
- 2022Capturing and Inferring Dense Full-Body Human-Scene Contactcited by 176
- 2023FastViT: A Fast Hybrid Vision Transformer using Structural Reparameterizationcited by 161
- 2022PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Imagescited by 152
- 2021Keypoint Transformer: Solving Joint Identification in Challenging Hands and Object Interactions for Accurate 3D Pose Estimationcited by 122
- 2024WiLoR: End-to-end 3D Hand Localization and Reconstruction in-the-wildcited by 117
12 most cited of 248 All 248 (JSON)
- 2026EgoFound3R: End-to-End Egocentric Hand Reconstruction in World Space with Point-Wise Interaction Attributes1 Oct 2026
- 2026ESTHER: Egocentric Stereo Hand Estimation and Reconstruction in the Wild28 Sep 2026
- 2026EventEgoHands++: Event-based Egocentric 3D Hand Mesh Reconstruction with Real Dataset15 Sep 2026
- 2026Reconstructing Humans and Objects in Interaction using Large Reconstruction Models27 Aug 2026
- 2026Hand Visibility Detector: Per-Keypoint Visibility Estimation for Hands12 Aug 2026
- 2026Reliability-Aware 3D Geometric Injection for Universal Person Re-identification21 Jul 2026
- 2026EgoExoMoCap: Distributed Ego-Exo Human Motion Capture17 Jul 2026
- 2026Again-Pose: Anchor-Guided Adaptive Inter-Frame Motion Cues Propagating for High-quality Human Pose Reconstruction28 Jun 2026
- 2026AVI-HT: Adaptive Vision-IMU Fusion for 3D Hand Tracking20 May 2026
- 2026GeoHand: Unlocking Prior Geometry Knowledge for Monocular 3D Hand Reconstruction17 May 2026
- 2026Tamaththul3D: High-Fidelity 3D Saudi Sign Language Avatars from Monocular Video6 May 2026
- 2026ResiHMR: Residual-Limb Aware Single-Image 3D Human Mesh Recovery for Individuals with Limb Loss30 Apr 2026
12 newest of 248 All 248 (JSON)