mlsanityData to 7 Oct 2026

VIBE: Video Inference for Human Body Pose and Shape Estimation

arXiv 1912.05656 ↗First posted 11 Dec 2019cs.CVcited by 615

Not on the map. Why?

Cited by 23 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Human motion is fundamental to understanding behavior. Despite progress on single-image 3D pose and shape estimation, existing video-based state-of-the-art methods fail to produce accurate and natural motion sequences due to a lack of ground-truth 3D motion data for training. To address this problem, we propose Video Inference for Body Pose and Shape Estimation (VIBE), which makes use of an existing large-scale motion capture dataset (AMASS) together with unpaired, in-the-wild, 2D keypoint annotations. Our key novelty is an adversarial learning framework that leverages AMASS to discriminate between real human motions and those produced by our temporal pose and shape regression networks. We define a temporal network architecture and show that adversarial training, at the sequence level, produces kinematically plausible motion sequences without in-the-wild ground-truth 3D labels. We perform extensive experimentation to analyze the importance of motion and demonstrate the effectiveness of VIBE on challenging 3D pose estimation datasets, achieving state-of-the-art performance. Code and pretrained models are available at https://github.com/mkocabas/VIBE.

Key facts. Cited by 615 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Dec 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 113; 2022: 122; 2023: 128; 2024: 110; 2025: 74; 2026: 68.

615 papers.

Sort:

By area:

  1. 2022Human Motion Diffusion Modelcited by 1,062
  2. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
  3. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 567
  4. 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 497
  5. 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 479
  6. 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 344
  7. 2021PARE: Part Attention Regressor for 3D Human Body Estimationcited by 334
  8. 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 327
  9. 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 319
  10. 2022ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulationcited by 306
  11. 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
  12. 2021Mesh Graphormercited by 264
38 more
  1. 2021Revisiting Skeleton-based Action Recognitioncited by 256
  2. 2021PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loopcited by 250
  3. 2022BEHAVE: Dataset and Method for Tracking Human Object Interactionscited by 246
  4. 2022NeuMan: Neural Human Radiance Field from a Single Videocited by 244
  5. 2022CLIFF: Carrying Location Information in Full Frames into Human Pose and Shape Estimationcited by 237
  6. 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
  7. 2023InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactionscited by 205
  8. 2021AGORA: Avatars in Geography Optimized for Regression Analysiscited by 203
  9. 2023WHAM: Reconstructing World-grounded Humans with Accurate 3D Motioncited by 200
  10. 2021BANMo: Building Animatable 3D Neural Models from Many Casual Videoscited by 195
  11. 2022MotionBERT: A Unified Perspective on Learning Human Motion Representationscited by 188
  12. 2021SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar Networkscited by 181
  13. 2022Capturing and Inferring Dense Full-Body Human-Scene Contactcited by 176
  14. 2021FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and Integrationcited by 168
  15. 2023SMPLer-X: Scaling Up Expressive Human Pose and Shape Estimationcited by 154
  16. 2022PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Imagescited by 152
  17. 2021GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Camerascited by 151
  18. 2021Kimera: from SLAM to Spatial Perception with 3D Dynamic Scene Graphscited by 144
  19. 2021Putting People in their Place: Monocular Regression of 3D People in Depthcited by 141
  20. 2023Decoupling Human and Camera Motion from Videos in the Wildcited by 140
  21. 2021EgoBody: Human Body Shape and Motion of Interacting People from Head-Mounted Devicescited by 136
  22. 2021SPEC: Seeing People in the Wild with an Estimated Cameracited by 134
  23. 2024World-Grounded Human Motion Recovery via Gravity-View Coordinatescited by 127
  24. 2023Consistent4D: Consistent 360deg Dynamic Object Generation from Monocular Videocited by 124
  25. 2023GART: Gaussian Articulated Template Modelscited by 121
  26. 2021LASR: Learning Articulated Shape Reconstruction from a Monocular Videocited by 115
  27. 2022HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modelingcited by 115
  28. 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 113
  29. 2022Gait Recognition in the Wild with Dense 3D Representations and A Benchmarkcited by 113
  30. 2021SimPoE: Simulated Character Control for 3D Human Pose Estimationcited by 111
  31. 2022EVA3D: Compositional 3D Human Generation from 2D Image Collectionscited by 111
  32. 2021Animatable Neural Radiance Fields from Monocular RGB Videoscited by 109
  33. 2024TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videoscited by 105
  34. 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humanscited by 104
  35. 2022Recovering 3D Human Mesh from Monocular Images: A Surveycited by 103
  36. 2021Dynamics-Regulated Kinematic Policy for Egocentric Pose Estimationcited by 101
  37. 2022Generative Neural Articulated Radiance Fieldscited by 101
  38. 20233D Human Pose Estimation via Intuitive Physicscited by 100

50 most cited of 615 All 615 (JSON)