3D Multi-bodies: Fitting Sets of Plausible 3D Human Models to Ambiguous Image Data
Not on the map. Why?
Abstract (arXiv)
We consider the problem of obtaining dense 3D reconstructions of humans from single and partially occluded views. In such cases, the visual evidence is usually insufficient to identify a 3D reconstruction uniquely, so we aim at recovering several plausible reconstructions compatible with the input data. We suggest that ambiguities can be modelled more effectively by parametrizing the possible body shapes and poses via a suitable 3D model, such as SMPL for humans. We propose to learn a multi-hypothesis neural network regressor using a best-of-M loss, where each of the M hypotheses is constrained to lie on a manifold of plausible human poses by means of a generative model. We show that our method outperforms alternative approaches in ambiguous pose recovery on standard benchmarks for 3D humans, and in heavily occluded versions of these benchmarks.
Key facts. Cited by 50 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Nov 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 10; 2023: 15; 2024: 11; 2025: 1; 2026: 4.
50 papers.
Sort:
By area:
- 2021PARE: Part Attention Regressor for 3D Human Body Estimationcited by 334
- 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 319
- 2021Human Pose Regression with Residual Log-likelihood Estimationcited by 131
- 2022Recovering 3D Human Mesh from Monocular Images: A Surveycited by 103
- 2021Probabilistic Monocular 3D Human Pose Estimation with Normalizing Flowscited by 84
- 2022DiffPose: Multi-hypothesis Human Pose Estimation using Diffusion modelscited by 65
- 2022FLAG: Flow-based 3D Avatar Generation from Sparse Observationscited by 54
- 2021THUNDR: Transformer-based 3D HUmaN Reconstruction with Markerscited by 50
- 2023NIKI: Neural Inverse Kinematics with Invertible Neural Networks for 3D Human Pose and Shape Estimationcited by 45
- 2023Animal3D: A Comprehensive Dataset of 3D Animal Pose and Shapecited by 43
- 2023Probabilistic Human Mesh Recovery in 3D Scenes from Egocentric Viewscited by 33
- 20233D-Aware Neural Body Fitting for Occlusion Robust 3D Human Pose Estimationcited by 28
38 more
- 2023Distribution-Aligned Diffusion for Human Mesh Recoverycited by 27
- 2023Sampling is Matter: Point-guided 3D Human Mesh Reconstructioncited by 24
- 2022HUM3DIL: Semi-supervised Multi-modal 3D Human Pose Estimation for Autonomous Drivingcited by 22
- 2023POCO: 3D Pose and Shape Estimation with Confidencecited by 20
- 2023HMD-NeMo: Online 3D Avatar Motion Generation From Sparse Observationscited by 17
- 2021Coarse-to-fine Animal Pose and Shape Estimationcited by 16
- 2021Learning to Fit Morphable Modelscited by 16
- 2022Occluded Human Body Capture with Self-Supervised Spatial-Temporal Motion Priorcited by 15
- 2023Rendering Humans from Object-Occluded Monocular Videoscited by 14
- 2023VQ-HPS: Human Pose and Shape Estimation in a Vector-Quantized Latent Spacecited by 13
- 2024DiffHuman: Probabilistic Photorealistic 3D Reconstruction of Humanscited by 13
- 2024MEGA: Masked Generative Autoencoder for Human Mesh Recoverycited by 13
- 2022Domain Adaptive 3D Pose Augmentation for In-the-wild Human Mesh Recoverycited by 12
- 2022Towards Hard-pose Virtual Try-on via 3D-aware Global Correspondence Learningcited by 12
- 2022Explicit Occlusion Reasoning for Multi-person 3D Human Pose Estimationcited by 10
- 2022Distribution-Aware Single-Stage Models for Multi-Person 3D Pose Estimationcited by 9
- 2023Body Knowledge and Uncertainty Modeling for Monocular 3D Human Body Reconstructioncited by 8
- 2025ADHMR: Aligning Diffusion-based Human Mesh Recovery via Direct Preference Optimizationcited by 6
- 2021DensePose 3D: Lifting Canonical Surface Maps of Articulated Objects to the Third Dimensioncited by 5
- 2024Distribution and Depth-Aware Transformers for 3D Human Mesh Recoverycited by 5
- 2024CondiMen: Conditional Multi-Person Mesh Recoverycited by 5
- 2021Multi-initialization Optimization Network for Accurate 3D Human Pose and Shape Estimationcited by 4
- 2023Improving the Robustness of 3D Human Pose Estimation: A Benchmark and Learning from Noisy Inputcited by 4
- 2024CryoSPIN: Improving Ab-Initio Cryo-EM Reconstruction with Semi-Amortized Pose Inferencecited by 4
- 2024CHAMP: Conformalized 3D Human Multi-Hypothesis Pose Estimatorscited by 4
- 2024Utilizing Uncertainty in 2D Pose Detectors for Probabilistic 3D Human Mesh Recoverycited by 4
- 2022Human Body Measurement Estimation with Adversarial Augmentationcited by 3
- 2023Multimodal Active Measurement for Human Mesh Recovery in Close Proximitycited by 2
- 2024Di2Pose: Discrete Diffusion Model for Occluded 3D Human Pose Estimationcited by 2
- 2024CUPS: Improving Human Pose-Shape Estimators with Conformalized Deep Uncertaintycited by 2
- 2026VLM-Guided Group Preference Alignment for Diffusion-based Human Mesh Recoverycited by 2
- 2023TAPE: Temporal Attention-based Probabilistic human pose and shape Estimationcited by 1
- 2023SHARE: Single-view Human Adversarial REconstructioncited by 0
- 2024A Simple Strategy for Body Estimation from Partial-View Imagescited by 0
- 2024Social EgoMesh Estimationcited by 0
- 2026Unsupervised SE(3) Disentanglement for in situ Macromolecular Morphology Identification from Cryo-Electron Tomographycited by 0
- 2026UST-Hand: An Uncertainty-aware Spatiotemporal Point Cloud Interaction Network for 3D Self-supervised Hand Pose Estimationcited by 0
- 2026MHE-Former: Multi-Hypothesis Transformers via Entropy Maximization for 3D Mesh Recoverycited by 0
- 2026MHE-Former: Multi-Hypothesis Transformers via Entropy Maximization for 3D Mesh Recovery9 Sep 2026
- 2026UST-Hand: An Uncertainty-aware Spatiotemporal Point Cloud Interaction Network for 3D Self-supervised Hand Pose Estimation18 May 2026
- 2026VLM-Guided Group Preference Alignment for Diffusion-based Human Mesh Recovery22 Feb 2026
- 2026Unsupervised SE(3) Disentanglement for in situ Macromolecular Morphology Identification from Cryo-Electron Tomography4 Jan 2026
- 2025ADHMR: Aligning Diffusion-based Human Mesh Recovery via Direct Preference Optimization15 May 2025
- 2024CondiMen: Conditional Multi-Person Mesh Recovery17 Dec 2024
- 2024CUPS: Improving Human Pose-Shape Estimators with Conformalized Deep Uncertainty11 Dec 2024
- 2024Utilizing Uncertainty in 2D Pose Detectors for Probabilistic 3D Human Mesh Recovery25 Nov 2024
- 2024Social EgoMesh Estimation7 Nov 2024
- 2024CryoSPIN: Improving Ab-Initio Cryo-EM Reconstruction with Semi-Amortized Pose Inference15 Jun 2024
- 2024MEGA: Masked Generative Autoencoder for Human Mesh Recovery29 May 2024
- 2024CHAMP: Conformalized 3D Human Multi-Hypothesis Pose Estimators27 May 2024
38 more
- 2024Di2Pose: Discrete Diffusion Model for Occluded 3D Human Pose Estimation27 May 2024
- 2024A Simple Strategy for Body Estimation from Partial-View Images14 Apr 2024
- 2024DiffHuman: Probabilistic Photorealistic 3D Reconstruction of Humans30 Mar 2024
- 2024Distribution and Depth-Aware Transformers for 3D Human Mesh Recovery14 Mar 2024
- 2023SHARE: Single-view Human Adversarial REconstruction30 Dec 2023
- 2023VQ-HPS: Human Pose and Shape Estimation in a Vector-Quantized Latent Space13 Dec 2023
- 2023Improving the Robustness of 3D Human Pose Estimation: A Benchmark and Learning from Noisy Input11 Dec 2023
- 2023Multimodal Active Measurement for Human Mesh Recovery in Close Proximity12 Oct 2023
- 2023Distribution-Aligned Diffusion for Human Mesh Recovery25 Aug 2023
- 2023POCO: 3D Pose and Shape Estimation with Confidence24 Aug 2023
- 2023Animal3D: A Comprehensive Dataset of 3D Animal Pose and Shape22 Aug 2023
- 2023HMD-NeMo: Online 3D Avatar Motion Generation From Sparse Observations22 Aug 2023
- 20233D-Aware Neural Body Fitting for Occlusion Robust 3D Human Pose Estimation19 Aug 2023
- 2023Rendering Humans from Object-Occluded Monocular Videos8 Aug 2023
- 2023Body Knowledge and Uncertainty Modeling for Monocular 3D Human Body Reconstruction1 Aug 2023
- 2023NIKI: Neural Inverse Kinematics with Invertible Neural Networks for 3D Human Pose and Shape Estimation15 May 2023
- 2023TAPE: Temporal Attention-based Probabilistic human pose and shape Estimation29 Apr 2023
- 2023Sampling is Matter: Point-guided 3D Human Mesh Reconstruction19 Apr 2023
- 2023Probabilistic Human Mesh Recovery in 3D Scenes from Egocentric Views12 Apr 2023
- 2022HUM3DIL: Semi-supervised Multi-modal 3D Human Pose Estimation for Autonomous Driving15 Dec 2022
- 2022DiffPose: Multi-hypothesis Human Pose Estimation using Diffusion models29 Nov 2022
- 2022Towards Hard-pose Virtual Try-on via 3D-aware Global Correspondence Learning25 Nov 2022
- 2022Human Body Measurement Estimation with Adversarial Augmentation11 Oct 2022
- 2022Explicit Occlusion Reasoning for Multi-person 3D Human Pose Estimation29 Jul 2022
- 2022Occluded Human Body Capture with Self-Supervised Spatial-Temporal Motion Prior12 Jul 2022
- 2022Domain Adaptive 3D Pose Augmentation for In-the-wild Human Mesh Recovery21 Jun 2022
- 2022Distribution-Aware Single-Stage Models for Multi-Person 3D Pose Estimation15 Mar 2022
- 2022FLAG: Flow-based 3D Avatar Generation from Sparse Observations11 Mar 2022
- 2022Recovering 3D Human Mesh from Monocular Images: A Survey3 Mar 2022
- 2021Multi-initialization Optimization Network for Accurate 3D Human Pose and Shape Estimation24 Dec 2021
- 2021Learning to Fit Morphable Models29 Nov 2021
- 2021Coarse-to-fine Animal Pose and Shape Estimation16 Nov 2021
- 2021DensePose 3D: Lifting Canonical Surface Maps of Articulated Objects to the Third Dimension31 Aug 2021
- 2021Probabilistic Monocular 3D Human Pose Estimation with Normalizing Flows29 Jul 2021
- 2021Human Pose Regression with Residual Log-likelihood Estimation23 Jul 2021
- 2021THUNDR: Transformer-based 3D HUmaN Reconstruction with Markers17 Jun 2021
- 2021HuMoR: 3D Human Motion Model for Robust Pose Estimation10 May 2021
- 2021PARE: Part Attention Regressor for 3D Human Body Estimation17 Apr 2021
- 2021PARE: Part Attention Regressor for 3D Human Body Estimationcited by 334
- 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 319
- 2021Human Pose Regression with Residual Log-likelihood Estimationcited by 131
- 2022Recovering 3D Human Mesh from Monocular Images: A Surveycited by 103
- 2021Probabilistic Monocular 3D Human Pose Estimation with Normalizing Flowscited by 84
- 2022FLAG: Flow-based 3D Avatar Generation from Sparse Observationscited by 54
- 2021THUNDR: Transformer-based 3D HUmaN Reconstruction with Markerscited by 50
- 2023NIKI: Neural Inverse Kinematics with Invertible Neural Networks for 3D Human Pose and Shape Estimationcited by 45
- 2023Animal3D: A Comprehensive Dataset of 3D Animal Pose and Shapecited by 43
- 2023Probabilistic Human Mesh Recovery in 3D Scenes from Egocentric Viewscited by 33
- 20233D-Aware Neural Body Fitting for Occlusion Robust 3D Human Pose Estimationcited by 28
- 2023Distribution-Aligned Diffusion for Human Mesh Recoverycited by 27
12 most cited of 46 All 46 (JSON)
- 2026MHE-Former: Multi-Hypothesis Transformers via Entropy Maximization for 3D Mesh Recovery9 Sep 2026
- 2026UST-Hand: An Uncertainty-aware Spatiotemporal Point Cloud Interaction Network for 3D Self-supervised Hand Pose Estimation18 May 2026
- 2026Unsupervised SE(3) Disentanglement for in situ Macromolecular Morphology Identification from Cryo-Electron Tomography4 Jan 2026
- 2025ADHMR: Aligning Diffusion-based Human Mesh Recovery via Direct Preference Optimization15 May 2025
- 2024CondiMen: Conditional Multi-Person Mesh Recovery17 Dec 2024
- 2024CUPS: Improving Human Pose-Shape Estimators with Conformalized Deep Uncertainty11 Dec 2024
- 2024Utilizing Uncertainty in 2D Pose Detectors for Probabilistic 3D Human Mesh Recovery25 Nov 2024
- 2024Social EgoMesh Estimation7 Nov 2024
- 2024CryoSPIN: Improving Ab-Initio Cryo-EM Reconstruction with Semi-Amortized Pose Inference15 Jun 2024
- 2024MEGA: Masked Generative Autoencoder for Human Mesh Recovery29 May 2024
- 2024A Simple Strategy for Body Estimation from Partial-View Images14 Apr 2024
- 2024DiffHuman: Probabilistic Photorealistic 3D Reconstruction of Humans30 Mar 2024
12 newest of 46 All 46 (JSON)