FuRPE: Learning Full-body Reconstruction from Part Experts
Not on the map. Why?
Abstract (arXiv)
In the field of full-body reconstruction, the scarcity of annotated data often impedes the efficacy of prevailing methods. To address this issue, we introduce FuRPE, a novel framework that employs part-experts and an ingenious pseudo ground-truth selection scheme to derive high-quality pseudo labels. These labels, central to our approach, equip our network with the capability to efficiently learn from the available data. Integral to FuRPE is a unique exponential moving average training strategy and expert-derived feature distillation strategy. These novel elements of FuRPE not only serve to further refine the model but also to reduce potential biases that may arise from inaccuracies in pseudo labels, thereby optimizing the network's training process and enhancing the robustness of the model. We apply FuRPE to train both two-stage and fully convolutional single-stage full-body reconstruction networks. Our exhaustive experiments on numerous benchmark datasets illustrate a substantial performance boost over existing methods, underscoring FuRPE's potential to reshape the state-of-the-art in full-body reconstruction.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 38 of its 50 references that are in the map. First posted on arXiv 30 Nov 2022.
Builds on
38 of 50 references.
References · 38
- 2016Identity Mappings in Deep Residual Networkscited by 1,960
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
- 2017End-to-end Recovery of Human Shape and Posecited by 883
- 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 625
- 2019VIBE: Video Inference for Human Body Pose and Shape Estimationcited by 615
- 2016Monocular 3D Human Pose Estimation In The Wild Using Improved CNN Supervisioncited by 493
- 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 475
- 2020End-to-End Human Pose and Mesh Reconstruction with Transformerscited by 417
- 2017A simple yet effective baseline for 3d human pose estimationcited by 401
- 20183D human pose estimation in video with temporal convolutions and semi-supervised trainingcited by 401
- 2021PARE: Part Attention Regressor for 3D Human Body Estimationcited by 334
- 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 319
26 more
- 2019FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Imagescited by 271
- 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 254
- 2021PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loopcited by 250
- 2016Coarse-to-Fine Volumetric Prediction for Single-Image 3D Human Posecited by 220
- 2017Single-Shot Multi-Person 3D Pose Estimation From Monocular RGBcited by 195
- 2021Spatio-temporal Self-Supervised Representation Learning for 3D Point Cloudscited by 180
- 20193D Hand Shape and Pose Estimation from a Single RGB Imagecited by 174
- 2021FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and Integrationcited by 168
- 2020Beyond Static Features for Temporally Consistent 3D Human Pose and Shape from a Videocited by 162
- 2020Monocular Expressive Body Regression through Body-Driven Attentioncited by 155
- 2021MHFormer: Multi-Hypothesis Transformer for 3D Human Pose Estimationcited by 151
- 2021Collaborative Regression of Expressive Bodies using Moderationcited by 137
- 2019Camera Distance-aware Top-down Approach for 3D Multi-person Pose Estimation from a Single RGB Imagecited by 131
- 2020Exemplar Fine-Tuning for 3D Human Model Fitting Towards In-the-Wild 3D Human Pose Estimationcited by 113
- 2018Pose2Seg: Detection Free Human Instance Segmentationcited by 107
- 2020Monocular Real-time Hand Shape and Motion Capture using Multi-modal Datacited by 106
- 2021imGHUM: Implicit Generative Models of 3D Human Shape and Articulated Posecited by 102
- 2021Exploiting Temporal Contexts with Strided Transformer for 3D Human Pose Estimationcited by 94
- 2018LCR-Net++: Multi-person 2D and 3D Pose Detection in Natural Imagescited by 88
- 2020Monocular Real-time Full Body Capture with Inter-part Correlationscited by 53
- 2021Deep Learning on Monocular Object Pose Detection and Tracking: A Comprehensive Overviewcited by 31
- 2020Object Handovers: a Review for Roboticscited by 28
- 2020DOPE: Distillation Of Part Experts for whole-body 3D pose estimation in the wildcited by 25
- 2022Ray3D: ray-based 3D human pose estimation for monocular absolute 3D localizationcited by 25
- 2018Evaluation of Dense 3D Reconstruction from 2D Face Images in the Wildcited by 22
- 2020Chasing the Tail in Monocular 3D Human Reconstruction with Prototype Memorycited by 11
Built on by
Citing papers per year: 2023: 1.
1 paper.