mlsanityData to 7 Oct 2026

3D Human Mesh Estimation from Virtual Markers

arXiv 2303.11726 ↗First posted 21 Mar 2023cs.CVcited by 44

Not on the map. Why?

Abstract (arXiv)

Inspired by the success of volumetric 3D pose estimation, some recent human mesh estimators propose to estimate 3D skeletons as intermediate representations, from which, the dense 3D meshes are regressed by exploiting the mesh topology. However, body shape information is lost in extracting skeletons, leading to mediocre performance. The advanced motion capture systems solve the problem by placing dense physical markers on the body surface, which allows to extract realistic meshes from their non-rigid motions. However, they cannot be applied to wild images without markers. In this work, we present an intermediate representation, named virtual markers, which learns 64 landmark keypoints on the body surface based on the large-scale mocap data in a generative style, mimicking the effects of physical markers. The virtual markers can be accurately detected from wild images and can reconstruct the intact meshes with realistic shapes by simple interpolation. Our approach outperforms the state-of-the-art methods on three datasets. In particular, it surpasses the existing methods by a notable margin on the SURREAL dataset, which has diverse body shapes. Code is available at https://github.com/ShirleyMaxx/VirtualMarker

Key facts. Cited by 44 papers in the map (data through 7 Oct 2026). Builds on 54 of its 68 references that are in the map. First posted on arXiv 21 Mar 2023.

Builds on

54 of 68 references.

References · 54

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  3. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
  4. 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
  5. 2017End-to-end Recovery of Human Shape and Posecited by 883
  6. 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 692
  7. 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 649
  8. 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 625
  9. 2019VIBE: Video Inference for Human Body Pose and Shape Estimationcited by 615
  10. 2016Monocular 3D Human Pose Estimation In The Wild Using Improved CNN Supervisioncited by 493
  11. 2020End-to-End Human Pose and Mesh Reconstruction with Transformerscited by 417
  12. 2017Learning from Synthetic Humanscited by 358
38 more
  1. 2021PARE: Part Attention Regressor for 3D Human Body Estimationcited by 334
  2. 2018Learning 3D Human Dynamics from Videocited by 315
  3. 2020HybrIK: A Hybrid Analytical-Neural Inverse Kinematics Solution for 3D Human Pose and Shape Estimationcited by 304
  4. 2020I2L-MeshNet: Image-to-Lixel Prediction Network for Accurate 3D Human Pose and Mesh Estimation from a Single RGB Imagecited by 274
  5. 2019Convolutional Mesh Regression for Single-Image Human Shape Reconstructioncited by 270
  6. 2021Mesh Graphormercited by 264
  7. 2017Integral Human Pose Regressioncited by 255
  8. 2021PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loopcited by 250
  9. 2020Pose2Mesh: Graph Convolutional Network for 3D Human Pose and Mesh Recovery from a 2D Human Posecited by 248
  10. 2022CLIFF: Carrying Location Information in Full Frames into Human Pose and Shape Estimationcited by 237
  11. 2018Learning to Estimate 3D Human Pose and Shape from a Single Color Imagecited by 226
  12. 2020Monocular, One-stage, Regression of Multiple 3D Peoplecited by 216
  13. 2017Unite the People: Closing the Loop Between 3D and 2D Human Representationscited by 205
  14. 2018Neural Body Fitting: Unifying Deep Learning and Model-Based Human Pose and Shape Estimationcited by 185
  15. 2020Beyond Static Features for Temporally Consistent 3D Human Pose and Shape from a Videocited by 162
  16. 2019Learnable Triangulation of Human Posecited by 160
  17. 2020Monocular Expressive Body Regression through Body-Driven Attentioncited by 155
  18. 2021Probabilistic Modeling for Human Mesh Recoverycited by 152
  19. 2018BodyNet: Volumetric Inference of 3D Human Body Shapescited by 141
  20. 2019Exploiting temporal context for 3D human pose estimation in the wildcited by 110
  21. 2019DenseRaC: Joint 3D Pose and Shape Estimation by Dense Render-and-Comparecited by 100
  22. 2017Self-supervised Learning of Motion Capturecited by 97
  23. 2017Towards Accurate Markerless Human Shape and Pose Estimation over Timecited by 92
  24. 2019Cross View Fusion for 3D Human Pose Estimationcited by 90
  25. 2019Human Mesh Recovery from Monocular Images via a Skeleton-disentangled Representationcited by 87
  26. 2022Cross-Attention of Disentangled Modalities for 3D Human Mesh Recovery with Transformerscited by 81
  27. 2020PaStaNet: Toward Human Activity Knowledge Enginecited by 79
  28. 20203D Human Mesh Regression with Dense Correspondencecited by 66
  29. 2021Learning to Estimate Robust 3D Human Mesh from In-the-Wild Crowded Scenescited by 64
  30. 2021Encoder-decoder with Multi-level Attention for 3D Human Shape and Pose Estimationcited by 62
  31. 2022GFPose: Learning 3D Human Pose Prior with Gradient Fieldscited by 57
  32. 2022Occluded Human Mesh Recoverycited by 52
  33. 2021THUNDR: Transformer-based 3D HUmaN Reconstruction with Markerscited by 50
  34. 2019Learning 3D Human Shape and Pose from Dense Body Partscited by 48
  35. 2021VoxelTrack: Multi-Person 3D Human Pose Estimation and Tracking in the Wildcited by 39
  36. 2022Faster VoxelPose: Real-time 3D Human Pose Estimation by Orthographic Projectioncited by 39
  37. 2022Learned Vertex Descent: A New Direction for 3D Human Model Fittingcited by 37
  38. 2021PC-HMR: Pose Calibration for 3D Human Mesh Recovery from 2D Images/Videoscited by 25

50 most cited of 54 All 54 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 9; 2024: 17; 2025: 13; 2026: 5.

44 papers.

Sort:

By area:

  1. 2023WHAM: Reconstructing World-grounded Humans with Accurate 3D Motioncited by 200
  2. 2024Scaling Up Dynamic Human-Scene Interaction Modelingcited by 137
  3. 2024Multi-HMR: Multi-Person Whole-Body Human Mesh Recovery in a Single Shotcited by 98
  4. 2023Human Motion Generation: A Surveycited by 95
  5. 2024Neural Localizer Fields for Continuous 3D Human Pose and Shape Estimationcited by 57
  6. 2023Motion Flow Matching for Human Motion Synthesis and Editingcited by 36
  7. 2023Dynamic Inertial Poser (DynaIP): Part-Based Motion Dynamics Learning for Enhanced Human Pose Estimation with Sparse Inertial Sensorscited by 29
  8. 2024PhysPT: Physics-aware Pretrained Transformer for Estimating Human Dynamics from Monocular Videoscited by 27
  9. 2023Back to Optimization: Diffusion-based Zero-Shot 3D Human Pose Estimationcited by 24
  10. 2024DPMesh: Exploiting Diffusion Prior for Occluded Human Mesh Recoverycited by 16
  11. 2025BioPose: Biomechanically-accurate 3D Pose Estimation from Monocular Videoscited by 16
  12. 2024SAT-HMR: Real-Time Multi-Person 3D Mesh Estimation via Scale-Adaptive Tokenscited by 15
32 more
  1. 2023VQ-HPS: Human Pose and Shape Estimation in a Vector-Quantized Latent Spacecited by 13
  2. 2024MEGA: Masked Generative Autoencoder for Human Mesh Recoverycited by 13
  3. 2023ProxyCap: Real-time Monocular Full-body Capture in World Space via Human-Centric Proxy-to-Motion Learningcited by 9
  4. 2024Diffusion Models are Efficient Data Generators for Human Mesh Recoverycited by 8
  5. 2024MeshPose: Unifying DensePose and 3D Body Mesh reconstructioncited by 8
  6. 2024OpenCapBench: A Benchmark to Bridge Pose Estimation and Biomechanicscited by 7
  7. 2024Human Mesh Recovery from Arbitrary Multi-view Imagescited by 5
  8. 2023SpeechAct: Towards Generating Whole-body Motion from Speechcited by 4
  9. 2024ShapeBoost: Boosting Human Shape Estimation with Part-Based Parameterization and Clothing-Preserving Augmentationcited by 4
  10. 2024Harmonious Group Choreography with Trajectory-Controllable Diffusioncited by 3
  11. 2024MoCap-to-Visual Domain Adaptation for Efficient Human Mesh Estimation from 2D Keypointscited by 3
  12. 2024PostoMETRO: Pose Token Enhanced Mesh Transformer for Robust 3D Human Mesh Recoverycited by 2
  13. 2025DiffCap: Diffusion-based Real-time Human Motion Capture using Sparse IMUs and a Monocular Cameracited by 2
  14. 2025PersPose: 3D Human Pose Estimation with Perspective Encoding and Perspective Rotationcited by 2
  15. 2024Divide and Fuse: Body Part Mesh Recovery from Partially Visible Human Imagescited by 1
  16. 2024Motion Generation Review: Exploring Deep Learning for Lifelike Animation with Manifoldcited by 1
  17. 2025Multimodal Generative AI with Autoregressive LLMs for Human Motion Understanding and Generation: A Way Forwardcited by 1
  18. 2025MeshMamba: State Space Models for Articulated 3D Mesh Generation and Reconstructioncited by 1
  19. 2025Mesh-Gait: A Unified Framework for Gait Recognition Through Multi-Modal Representation Learning from 2D Silhouettescited by 1
  20. 2025ClothHMR: 3D Mesh Recovery of Humans in Diverse Clothing from Single Imagecited by 1
  21. 2023Temporal-Aware Refinement for Video-based Human Pose and Shape Recoverycited by 0
  22. 2025Diffusion Model-based Activity Completion for AI Motion Capture from Videoscited by 0
  23. 20253D Human Mesh Estimation from Single View RGBDcited by 0
  24. 2025LieHMR: Autoregressive Human Mesh Recovery with SO(3) Diffusioncited by 0
  25. 2025GLVD: Guided Learned Vertex Descentcited by 0
  26. 2025On the Use of Hierarchical Vision Foundation Models for Low-Cost Human Mesh Recovery and Pose Estimationcited by 0
  27. 2025End-to-End Motion Capture from Rigid Body Markers with Geodesic Losscited by 0
  28. 2026Listen to Rhythm, Choose Movements: Autoregressive Multimodal Dance Generation via Diffusion and Mamba with Decoupled Dance Datasetcited by 0
  29. 2026Flexible Geometric Guidance for Probabilistic Human Pose Estimation with Diffusion Modelscited by 0
  30. 2026PoseDreamer: Scalable and Photorealistic Human Data Generation Pipeline with Diffusion Modelscited by 0
  31. 2026Sparkle: A Robust and Versatile Representation for Point Cloud based Human Motion Capturecited by 0
  32. 2026MuNet: A Mutualistic Network for Joint 3D Human Mesh Recovery and 3D Clothed Human Reconstruction from Single Imagescited by 0