Shape of You: Precise 3D shape estimations for diverse body types
Not on the map. Why?
Abstract (arXiv)
This paper presents Shape of You (SoY), an approach to improve the accuracy of 3D body shape estimation for vision-based clothing recommendation systems. While existing methods have successfully estimated 3D poses, there remains a lack of work in precise shape estimation, particularly for diverse human bodies. To address this gap, we propose two loss functions that can be readily integrated into parametric 3D human reconstruction pipelines. Additionally, we propose a test-time optimization routine that further improves quality. Our method improves over the recent SHAPY method by 17.7% on the challenging SSP-3D dataset. We consider our work to be a step towards a more accurate 3D shape estimation system that works reliably on diverse body types and holds promise for practical applications in the fashion industry.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 19 of its 20 references that are in the map. First posted on arXiv 14 Apr 2023.
Builds on
19 of 20 references.
References · 19
- 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,162
- 2017End-to-end Recovery of Human Shape and Posecited by 885
- 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
- 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 695
- 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 627
- 2018DensePose: Dense Human Pose Estimation In The Wildcited by 575
- 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
- 20163D Menagerie: Modeling the 3D shape and pose of animalscited by 312
- 2019Convolutional Mesh Regression for Single-Image Human Shape Reconstructioncited by 270
- 2021SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapescited by 221
- 2017Unite the People: Closing the Loop Between 3D and 2D Human Representationscited by 205
- 2021BANMo: Building Animatable 3D Neural Models from Many Casual Videoscited by 197
7 more
- 2022Photorealistic Monocular 3D Reconstruction of Humans Wearing Clothingcited by 126
- 2018Creatures great and SMAL: Recovering the shape and motion of animals from videocited by 84
- 2020Synthetic Training for Accurate 3D Human Pose and Shape Estimation in the Wildcited by 82
- 2020Who Left the Dogs Out? 3D Animal Reconstruction with Expectation Maximization in the Loopcited by 81
- 2022BARC: Learning to Regress 3D Dog Shape from Images by Exploiting Breed Informationcited by 51
- 2022Accurate 3D Body Shape Regression using Metric and Semantic Attributescited by 50
- 2021Probabilistic 3D Human Shape and Pose Estimation from Multiple Unconstrained Images in the Wildcited by 40
Built on by
Citing papers per year: 2024: 3.
3 papers.
- 2024Neural Localizer Fields for Continuous 3D Human Pose and Shape Estimationcited by 59
- 2024ShapeBoost: Boosting Human Shape Estimation with Part-Based Parameterization and Clothing-Preserving Augmentationcited by 4
- 2024Leveraging Anthropometric Measurements to Improve Human Mesh Estimation and Ensure Consistent Body Shapescited by 2
- 2024Leveraging Anthropometric Measurements to Improve Human Mesh Estimation and Ensure Consistent Body Shapes26 Sep 2024
- 2024Neural Localizer Fields for Continuous 3D Human Pose and Shape Estimation10 Jul 2024
- 2024ShapeBoost: Boosting Human Shape Estimation with Part-Based Parameterization and Clothing-Preserving Augmentation2 Mar 2024