mlsanityData to 7 Oct 2026

Towards Accurate Markerless Human Shape and Pose Estimation over Time

arXiv 1707.07548 ↗First posted 24 Jul 2017cs.CVcited by 92

Not on the map. Why?

Abstract (arXiv)

Existing marker-less motion capture methods often assume known backgrounds, static cameras, and sequence specific motion priors, which narrows its application scenarios. Here we propose a fully automatic method that given multi-view video, estimates 3D human motion and body shape. We take recent SMPLify citebogo2016keep as the base method, and extend it in several ways. First we fit the body to 2D features detected in multi-view images. Second, we use a CNN method to segment the person in each image and fit the 3D body model to the contours to further improves accuracy. Third we utilize a generic and robust DCT temporal prior to handle the left and right side swapping issue sometimes introduced by the 2D pose estimator. Validation on standard benchmarks shows our results are comparable to the state of the art and also provide a realistic 3D shape avatar. We also demonstrate accurate results on HumanEva and on challenging dance sequences from YouTube in monocular case.

Key facts. Cited by 92 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Jul 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 30; 2022: 19; 2023: 20; 2024: 13; 2025: 6; 2026: 4.

92 papers.

Sort:

By area:

  1. 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 319
  2. 2021PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loopcited by 250
  3. 2022BEHAVE: Dataset and Method for Tracking Human Object Interactionscited by 246
  4. 2023InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactionscited by 205
  5. 2022PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Imagescited by 152
  6. 2021Collaborative Regression of Expressive Bodies using Moderationcited by 137
  7. 2021EgoBody: Human Body Shape and Motion of Interacting People from Head-Mounted Devicescited by 136
  8. 2021SimPoE: Simulated Character Control for 3D Human Pose Estimationcited by 111
  9. 2024TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videoscited by 105
  10. 2022Recovering 3D Human Mesh from Monocular Images: A Surveycited by 103
  11. 2021Learning Motion Priors for 4D Human Body Capture in 3D Scenescited by 98
  12. 2022InterCap: Joint Markerless 3D Tracking of Humans and Objects in Interactioncited by 90
38 more
  1. 2021Modeling Clothing as a Separate Layer for an Animatable Human Avatarcited by 66
  2. 2021Playing for 3D Human Recoverycited by 63
  3. 2023EgoHumans: An Egocentric 3D Multi-Human Benchmarkcited by 58
  4. 2021DoubleField: Bridging the Neural Surface and Radiance Fields for High-fidelity Human Reconstruction and Renderingcited by 52
  5. 2022Accurate 3D Body Shape Regression using Metric and Semantic Attributescited by 49
  6. 2023ReFit: Recurrent Fitting Network for 3D Human Recoverycited by 47
  7. 2024RoHM: Robust Human Motion Reconstruction via Diffusioncited by 46
  8. 20233D Human Mesh Estimation from Virtual Markerscited by 44
  9. 2022LiDAR-aid Inertial Poser: Large-scale Human Motion Capture by Sparse Inertial and LiDAR Sensorscited by 43
  10. 2023Animal3D: A Comprehensive Dataset of 3D Animal Pose and Shapecited by 43
  11. 2021Probabilistic 3D Human Shape and Pose Estimation from Multiple Unconstrained Images in the Wildcited by 40
  12. 2023EmotionGesture: Audio-Driven Diverse Emotional Co-Speech 3D Gesture Generationcited by 40
  13. 2021Bilevel Online Adaptation for Out-of-Domain Human Mesh Reconstructioncited by 39
  14. 2023Dynamic Point Fieldscited by 37
  15. 2021Task-Generic Hierarchical Human Motion Prior using VAEscited by 33
  16. 2022mmBody Benchmark: 3D Body Reconstruction Dataset and Analysis for Millimeter Wave Radarcited by 32
  17. 2021Learning Parallel Dense Correspondence from Spatio-Temporal Descriptors for Efficient and Robust 4D Reconstructioncited by 31
  18. 2024Harmony4D: A Video Dataset for In-The-Wild Close Human Interactionscited by 31
  19. 2021Birds of a Feather: Capturing Avian Shape Models from Imagescited by 30
  20. 2022The One Where They Reconstructed 3D Humans and Environments in TV Showscited by 30
  21. 2021AcinoSet: A 3D Pose Estimation Dataset and Baseline Models for Cheetahs in the Wildcited by 29
  22. 20233D-Aware Neural Body Fitting for Occlusion Robust 3D Human Pose Estimationcited by 28
  23. 2023Distribution-Aligned Diffusion for Human Mesh Recoverycited by 27
  24. 2021ChallenCap: Monocular 3D Capture of Challenging Human Performances using Multi-Modal Referencescited by 26
  25. 2021Dynamic Multi-Person Mesh Recovery From Uncalibrated Multi-View Camerascited by 26
  26. 2021Human Performance Capture from Monocular Video in the Wildcited by 26
  27. 2022Weakly-supervised Action Transition Learning for Stochastic Human Motion Predictioncited by 26
  28. 2021Shape-aware Multi-Person Pose Estimation from Multi-View Imagescited by 24
  29. 2021Out-of-Domain Human Mesh Reconstruction via Dynamic Bilevel Online Adaptationcited by 24
  30. 2024PACER+: On-Demand Pedestrian Animation Controller in Driving Scenarioscited by 24
  31. 2022BodySLAM: Joint Camera Localisation, Mapping, and Human Motion Trackingcited by 23
  32. 2022SUPR: A Sparse Unified Part-Based Human Representationcited by 21
  33. 2023POCO: 3D Pose and Shape Estimation with Confidencecited by 20
  34. 2024LiveHPS: LiDAR-based Scene-level Human Pose and Shape Estimation in Free Environmentcited by 20
  35. 2021Revitalizing Optimization for 3D Human Pose and Shape Estimation: A Sparse Constrained Formulationcited by 19
  36. 2022HybridCap: Inertia-aid Monocular Capture of Challenging Human Motionscited by 19
  37. 2021Lifting Monocular Events to 3D Human Posescited by 16
  38. 2021Coarse-to-fine Animal Pose and Shape Estimationcited by 16

50 most cited of 92 All 92 (JSON)