mlsanityData to 7 Oct 2026

PAFUSE: Part-based Diffusion for 3D Whole-Body Pose Estimation

arXiv 2407.10220 ↗First posted 14 Jul 2024cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

We introduce a novel approach for 3D whole-body pose estimation, addressing the challenge of scale -- and deformability -- variance across body parts brought by the challenge of extending the 17 major joints on the human body to fine-grained keypoints on the face and hands. In addition to addressing the challenge of exploiting motion in unevenly sampled data, we combine stable diffusion to a hierarchical part representation which predicts the relative locations of fine-grained keypoints within each part (e.g., face) with respect to the part's local reference frame. On the H3WB dataset, our method greatly outperforms the current state of the art, which fails to exploit the temporal information. We also show considerable improvements compared to other spatiotemporal 3D human-pose estimation approaches that fail to account for the body part specificities. Code is available at https://github.com/valeoai/PAFUSE.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 44 of its 63 references that are in the map. First posted on arXiv 14 Jul 2024.

Builds on

44 of 63 references.

References · 44

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2020Denoising Diffusion Implicit Modelscited by 9,655
  3. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  4. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
  5. 2021CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputationcited by 577
  6. 2017A simple yet effective baseline for 3d human pose estimationcited by 401
  7. 20183D human pose estimation in video with temporal convolutions and semi-supervised trainingcited by 401
  8. 20213D Human Pose Estimation with Spatial and Temporal Transformerscited by 271
  9. 2018Total Capture: A 3D Deformation Model for Tracking Faces, Hands, and Bodiescited by 239
  10. 2019Actional-Structural Graph Convolutional Networks for Skeleton-based Action Recognitioncited by 228
  11. 2016Coarse-to-Fine Volumetric Prediction for Single-Image 3D Human Posecited by 220
  12. 2019Semantic Graph Convolutional Networks for 3D Human Pose Regressioncited by 204
32 more
  1. 2020Whole-Body Human Pose Estimation in the Wildcited by 178
  2. 2021FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and Integrationcited by 168
  3. 2018Monocular Total Capture: Posing Face, Body, and Hands in the Wildcited by 162
  4. 2022MixSTE: Seq2seq Mixed Spatio-Temporal Encoder for 3D Human Pose Estimation in Videocited by 158
  5. 2020Monocular Expressive Body Regression through Body-Driven Attentioncited by 155
  6. 2021Probabilistic Modeling for Human Mesh Recoverycited by 152
  7. 2021MHFormer: Multi-Hypothesis Transformer for 3D Human Pose Estimationcited by 151
  8. 2017Compositional Human Pose Regressioncited by 124
  9. 2019PifPaf: Composite Fields for Human Pose Estimationcited by 120
  10. 20182D/3D Pose Estimation and Action Recognition using Multitask Deep Learningcited by 103
  11. 2022Not All Tokens Are Equal: Human-centric Visual Analysis via Token Clustering Transformercited by 99
  12. 2021Graph Stacked Hourglass Networks for 3D Human Pose Estimationcited by 94
  13. 2021Driving-Signal Aware Full-Body Avatarscited by 81
  14. 2023Diffusion-Based 3D Human Pose Estimation with Multi-Hypothesis Aggregationcited by 81
  15. 2019Monocular 3D Human Pose Estimation by Generation and Ordinal Rankingcited by 76
  16. 20163D Human Pose Estimation from a Single Image via Distance Matrix Regressioncited by 73
  17. 2021Scene-aware Generative Network for Human Motion Synthesiscited by 70
  18. 2020CanonPose: Self-Supervised Monocular 3D Human Pose Estimation in the Wildcited by 65
  19. 2022DiffPose: Multi-hypothesis Human Pose Estimation using Diffusion modelscited by 65
  20. 2020Learning Complex 3D Human Self-Contactcited by 40
  21. 2022A generic diffusion-based approach for 3D human pose prediction in the wildcited by 33
  22. 2022Unsupervised Pre-training for Temporal Action Localization Taskscited by 31
  23. 2020Appearance Consensus Driven Self-Supervised Human Mesh Recoverycited by 27
  24. 2021KAMA: 3D Keypoint Aware Body Mesh Articulationcited by 27
  25. 2020DOPE: Distillation Of Part Experts for whole-body 3D pose estimation in the wildcited by 25
  26. 2022ZoomNAS: Searching for Whole-body Human Pose Estimation in the Wildcited by 23
  27. 2022H3WB: Human3.6M 3D WholeBody Dataset and Benchmarkcited by 23
  28. 2023Improving 3D Pose Estimation for Sign Languagecited by 16
  29. 2023DiffHPE: Robust, Coherent 3D Human Pose Lifting with Diffusioncited by 9
  30. 2020A Multi-modal Machine Learning Approach and Toolkit to Automate Recognition of Early Stages of Dementia among British Sign Language Userscited by 8
  31. 2021Keypoint Communitiescited by 8
  32. 2021HPRNet: Hierarchical Point Regression for Whole-Body Human Pose Estimationcited by 1

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

  1. 20253D Human Pose and Shape Estimation from LiDAR Point Clouds: A Reviewcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025DPoser-X: Diffusion Model as Robust 3D Whole-body Human Pose Prior
  2. 2025FastDDHPose: Towards Unified, Efficient, and Disentangled 3D Human Pose Estimation
  3. 2023DiffPose: SpatioTemporal Diffusion Model for Video-Based Human Pose Estimation
  4. 2024Di2Pose: Discrete Diffusion Model for Occluded 3D Human Pose Estimation
  5. 2025PHD: Personalized 3D Human Body Fitting with Point Diffusion
  6. 2024FinePOSE: Fine-Grained Prompt-Driven 3D Human Pose Estimation via Diffusion Models
  7. 2024Disentangled Diffusion-Based 3D Human Pose Estimation with Hierarchical Spatial and Temporal Denoiser
  8. 2022DiffuPose: Monocular 3D Human Pose Estimation via Denoising Diffusion Probabilistic Model