DiffHPE: Robust, Coherent 3D Human Pose Lifting with Diffusion
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
We present an innovative approach to 3D Human Pose Estimation (3D-HPE) by integrating cutting-edge diffusion models, which have revolutionized diverse fields, but are relatively unexplored in 3D-HPE. We show that diffusion models enhance the accuracy, robustness, and coherence of human pose estimations. We introduce DiffHPE, a novel strategy for harnessing diffusion models in 3D-HPE, and demonstrate its ability to refine standard supervised 3D-HPE. We also show how diffusion models lead to more robust estimations in the face of occlusions, and improve the time-coherence and the sagittal symmetry of predictions. Using the Human,3.6M dataset, we illustrate the effectiveness of our approach and its superiority over existing models, even under adverse situations where the occlusion patterns in training do not match those in inference. Our findings indicate that while standalone diffusion models provide commendable performance, their accuracy is even better in combination with supervised models, opening exciting new avenues for 3D-HPE research.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 38 of its 46 references that are in the map. First posted on arXiv 4 Sep 2023.
Builds on
38 of 46 references.
Closest ancestors · 2
Same direction, newest first
- 2022A generic diffusion-based approach for 3D human pose prediction in the wild11 Oct
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Models24 Jan
Other references · 36
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
- 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,354
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
24 more
- 2022Diffusion-LM Improves Controllable Text Generationcited by 1,027
- 2022Equivariant Diffusion for Molecule Generation in 3Dcited by 677
- 2021CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputationcited by 582
- 2022A Continuous Time Framework for Discrete Denoising Modelscited by 451
- 20183D human pose estimation in video with temporal convolutions and semi-supervised trainingcited by 403
- 2017A simple yet effective baseline for 3d human pose estimationcited by 401
- 2017Cascaded Pyramid Network for Multi-Person Pose Estimationcited by 341
- 20213D Human Pose Estimation with Spatial and Temporal Transformerscited by 272
- 2016Coarse-to-Fine Volumetric Prediction for Single-Image 3D Human Posecited by 221
- 2019Semantic Graph Convolutional Networks for 3D Human Pose Regressioncited by 204
- 2022MixSTE: Seq2seq Mixed Spatio-Temporal Encoder for 3D Human Pose Estimation in Videocited by 159
- 2021Probabilistic Modeling for Human Mesh Recoverycited by 153
- 2017VNect: Real-time 3D Human Pose Estimation with a Single RGB Cameracited by 129
- 2017Compositional Human Pose Regressioncited by 124
- 20163D Human Pose Estimation = 2D Pose Estimation + Matchingcited by 113
- 2022DiffPose: Toward More Reliable 3D Pose Estimationcited by 100
- 2021Graph Stacked Hourglass Networks for 3D Human Pose Estimationcited by 95
- 2017Exploiting temporal information for 3D pose estimationcited by 89
- 2021Probabilistic Monocular 3D Human Pose Estimation with Normalizing Flowscited by 85
- 2023Diffusion-Based 3D Human Pose Estimation with Multi-Hypothesis Aggregationcited by 82
- 2022P-STMO: Pre-Trained Spatial Temporal Many-to-One Model for 3D Human Pose Estimationcited by 80
- 2019Monocular 3D Human Pose Estimation by Generation and Ordinal Rankingcited by 76
- 20163D Human Pose Estimation from a Single Image via Distance Matrix Regressioncited by 73
- 2021Conditional Directed Graph Convolution for 3D Human Pose Estimationcited by 52
Built on by
Citing papers per year: 2023: 1; 2024: 5; 2025: 2; 2026: 1.
9 papers.
- 2024Closely Interactive Human Reconstruction with Proxemics and Physics-Guided Adaptioncited by 19
- 2023ManiPose: Manifold-Constrained Multi-Hypothesis 3D Human Pose Estimationcited by 6
- 2024CHAMP: Conformalized 3D Human Multi-Hypothesis Pose Estimatorscited by 5
- 2024PADS: Plug-and-Play 3D Human Pose Analysis via Diffusion Generative Modelingcited by 3
- 2024Di2Pose: Discrete Diffusion Model for Occluded 3D Human Pose Estimationcited by 2
- 2024PAFUSE: Part-based Diffusion for 3D Whole-Body Pose Estimationcited by 1
- 20253D Human Pose and Shape Estimation from LiDAR Point Clouds: A Reviewcited by 0
- 2025Valeo Near-Field: a novel dataset for pedestrian intent detectioncited by 0
- 2026SocialMirror: Reconstructing 3D Human Interaction Behaviors from Monocular Videos with Semantic and Geometric Guidancecited by 0
- 2026SocialMirror: Reconstructing 3D Human Interaction Behaviors from Monocular Videos with Semantic and Geometric Guidance15 Apr 2026
- 2025Valeo Near-Field: a novel dataset for pedestrian intent detection17 Oct 2025
- 20253D Human Pose and Shape Estimation from LiDAR Point Clouds: A Review15 Sep 2025
- 2024PAFUSE: Part-based Diffusion for 3D Whole-Body Pose Estimation14 Jul 2024
- 2024CHAMP: Conformalized 3D Human Multi-Hypothesis Pose Estimators27 May 2024
- 2024Di2Pose: Discrete Diffusion Model for Occluded 3D Human Pose Estimation27 May 2024
- 2024Closely Interactive Human Reconstruction with Proxemics and Physics-Guided Adaption17 Apr 2024
- 2024PADS: Plug-and-Play 3D Human Pose Analysis via Diffusion Generative Modeling17 Jan 2024
- 2023ManiPose: Manifold-Constrained Multi-Hypothesis 3D Human Pose Estimation11 Dec 2023
Similar, not cited
Close in wording, no citation either way
- 2022DiffPose: Multi-hypothesis Human Pose Estimation using Diffusion models
- 2025FastDDHPose: Towards Unified, Efficient, and Disentangled 3D Human Pose Estimation
- 2022DiffuPose: Monocular 3D Human Pose Estimation via Denoising Diffusion Probabilistic Model
- 2026Flexible Geometric Guidance for Probabilistic Human Pose Estimation with Diffusion Models
- 2023DiffPose: SpatioTemporal Diffusion Model for Video-Based Human Pose Estimation
- 2023Learning Structure-Guided Diffusion Model for 2D Human Pose Estimation
- 2024D3PRefiner: A Diffusion-based Denoise Method for 3D Human Pose Refinement
- 2025DPoser-X: Diffusion Model as Robust 3D Whole-body Human Pose Prior