KBody: Towards general, robust, and aligned monocular whole-body estimation
Not on the map. Why?
Abstract (arXiv)
KBody is a method for fitting a low-dimensional body model to an image. It follows a predict-and-optimize approach, relying on data-driven model estimates for the constraints that will be used to solve for the body's parameters. Acknowledging the importance of high quality correspondences, it leverages ``virtual joints" to improve fitting performance, disentangles the optimization between the pose and shape parameters, and integrates asymmetric distance fields to strike a balance in terms of pose and shape capturing capacity, as well as pixel alignment. We also show that generative model inversion offers a strong appearance prior that can be used to complete partial human images and used as a building block for generalized and robust monocular body fitting. Project page: https://zokin.github.io/KBody.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 62 of its 77 references that are in the map. First posted on arXiv 23 Apr 2023.
Builds on
62 of 77 references.
References · 62
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
- 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,539
- 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
- 2021Alias-Free Generative Adversarial Networkscited by 1,181
- 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,161
38 more
- 2017End-to-end Recovery of Human Shape and Posecited by 883
- 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 781
- 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 692
- 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
- 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 625
- 2018DensePose: Dense Human Pose Estimation In The Wildcited by 573
- 2021Designing an Encoder for StyleGAN Image Manipulationcited by 542
- 2020Modular Primitives for High-Performance Differentiable Renderingcited by 439
- 2017Neural 3D Mesh Renderercited by 437
- 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
- 2019Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoningcited by 420
- 2020HybrIK: A Hybrid Analytical-Neural Inverse Kinematics Solution for 3D Human Pose and Shape Estimationcited by 304
- 2017Unite the People: Closing the Loop Between 3D and 2D Human Representationscited by 205
- 2020STAR: Sparse Trained Articulated Human Body Regressorcited by 194
- 2021FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and Integrationcited by 168
- 2020Monocular Expressive Body Regression through Body-Driven Attentioncited by 155
- 2022PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Imagescited by 152
- 2022StyleGAN-Human: A Data-Centric Odyssey of Human Generationcited by 143
- 2021Collaborative Regression of Expressive Bodies using Moderationcited by 137
- 2021SPEC: Seeing People in the Wild with an Estimated Cameracited by 134
- 2020Combining Implicit Function Learning and Parametric Models for 3D Human Reconstructioncited by 133
- 2022High-Resolution Virtual Try-On with Misalignment and Occlusion-Handled Conditionscited by 129
- 2020MODNet: Real-Time Trimap-Free Portrait Matting via Objective Decompositioncited by 127
- 2020LoopReg: Self-supervised Learning of Implicit Surface Correspondences, Pose and Shape for 3D Human Mesh Registrationcited by 108
- 2022Recovering 3D Human Mesh from Monocular Images: A Surveycited by 103
- 2021imGHUM: Implicit Generative Models of 3D Human Shape and Articulated Posecited by 102
- 2017Towards Accurate Markerless Human Shape and Pose Estimation over Timecited by 92
- 2022Balanced MSE for Imbalanced Visual Regressioncited by 89
- 2022Pose-NDF: Modeling Human Pose Manifolds with Neural Distance Fieldscited by 85
- 2018Creatures great and SMAL: Recovering the shape and motion of animals from videocited by 84
- 2020Synthetic Training for Accurate 3D Human Pose and Shape Estimation in the Wildcited by 82
- 2020Neural Descent for Visual 3D Human Pose and Shapecited by 60
- 2022Accurate 3D Body Shape Regression using Metric and Semantic Attributescited by 49
- 2021Hierarchical Kinematic Probability Distributions for 3D Human Shape and Pose Estimation from Images in the Wildcited by 48
- 2021When Human Pose Estimation Meets Robustness: Adversarial Algorithms and Benchmarkscited by 41
- 2021Probabilistic 3D Human Shape and Pose Estimation from Multiple Unconstrained Images in the Wildcited by 40
- 2022Generalizable Neural Performer: Learning Robust Radiance Fields for Human Novel View Synthesiscited by 40
- 2021Adversarial Parametric Pose Priorcited by 38
50 most cited of 62 All 62 (JSON)
Built on by
Citing papers per year: 2024: 4; 2025: 0; 2026: 2.
6 papers.
- 2024Neural Localizer Fields for Continuous 3D Human Pose and Shape Estimationcited by 57
- 2024Distribution and Depth-Aware Transformers for 3D Human Mesh Recoverycited by 5
- 2024Uncertainty-Aware Testing-Time Optimization for 3D Human Pose Estimationcited by 2
- 2024Leveraging Anthropometric Measurements to Improve Human Mesh Estimation and Ensure Consistent Body Shapescited by 2
- 2026PRIMA: Boosting Animal Mesh Recovery with Biological Priors and Test-Time Adaptationcited by 1
- 2026Anny-Fit: All-Age Human Mesh Recoverycited by 0
- 2026PRIMA: Boosting Animal Mesh Recovery with Biological Priors and Test-Time Adaptation1 Jun 2026
- 2026Anny-Fit: All-Age Human Mesh Recovery6 May 2026
- 2024Leveraging Anthropometric Measurements to Improve Human Mesh Estimation and Ensure Consistent Body Shapes26 Sep 2024
- 2024Neural Localizer Fields for Continuous 3D Human Pose and Shape Estimation10 Jul 2024
- 2024Distribution and Depth-Aware Transformers for 3D Human Mesh Recovery14 Mar 2024
- 2024Uncertainty-Aware Testing-Time Optimization for 3D Human Pose Estimation4 Feb 2024