Distribution-Aligned Diffusion for Human Mesh Recovery
Not on the map. Why?
Abstract (arXiv)
Recovering a 3D human mesh from a single RGB image is a challenging task due to depth ambiguity and self-occlusion, resulting in a high degree of uncertainty. Meanwhile, diffusion models have recently seen much success in generating high-quality outputs by progressively denoising noisy inputs. Inspired by their capability, we explore a diffusion-based approach for human mesh recovery, and propose a Human Mesh Diffusion (HMDiff) framework which frames mesh recovery as a reverse diffusion process. We also propose a Distribution Alignment Technique (DAT) that infuses prior distribution information into the mesh distribution diffusion process, and provides useful prior knowledge to facilitate the mesh recovery task. Our method achieves state-of-the-art performance on three widely used datasets. Project page: https://gongjia0208.github.io/HMDiff/.
Key facts. Cited by 27 papers in the map (data through 14 Oct 2026). Builds on 43 of its 66 references that are in the map. First posted on arXiv 25 Aug 2023.
Builds on
43 of 66 references.
References · 43
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
- 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,420
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,416
- 2022Diffusion-LM Improves Controllable Text Generationcited by 1,027
- 2022Denoising Diffusion Restoration Modelscited by 963
- 2017End-to-end Recovery of Human Shape and Posecited by 885
31 more
- 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 627
- 2019VIBE: Video Inference for Human Body Pose and Shape Estimationcited by 620
- 2020End-to-End Human Pose and Mesh Reconstruction with Transformerscited by 418
- 2019Learning joint reconstruction of hands and manipulated objectscited by 378
- 2021PARE: Part Attention Regressor for 3D Human Body Estimationcited by 337
- 2020I2L-MeshNet: Image-to-Lixel Prediction Network for Accurate 3D Human Pose and Mesh Estimation from a Single RGB Imagecited by 274
- 2019FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Imagescited by 271
- 2019Convolutional Mesh Regression for Single-Image Human Shape Reconstructioncited by 270
- 2018Generating 3D faces using Convolutional Mesh Autoencoderscited by 268
- 2021Mesh Graphormercited by 265
- 2020Pose2Mesh: Graph Convolutional Network for 3D Human Pose and Mesh Recovery from a 2D Human Posecited by 248
- 2018Learning to Estimate 3D Human Pose and Shape from a Single Color Imagecited by 226
- 2020Monocular, One-stage, Regression of Multiple 3D Peoplecited by 218
- 2017Unite the People: Closing the Loop Between 3D and 2D Human Representationscited by 205
- 2017Single-Shot Multi-Person 3D Pose Estimation From Monocular RGBcited by 195
- 20193D Hand Shape and Pose from Images in the Wildcited by 190
- 2018Neural Body Fitting: Unifying Deep Learning and Model-Based Human Pose and Shape Estimationcited by 185
- 2022Stochastic Trajectory Prediction via Motion Indeterminacy Diffusioncited by 185
- 2022Recovering 3D Human Mesh from Monocular Images: A Surveycited by 103
- 2022DiffPose: Toward More Reliable 3D Pose Estimationcited by 100
- 2017Towards Accurate Markerless Human Shape and Pose Estimation over Timecited by 92
- 2022Cross-Attention of Disentangled Modalities for 3D Human Mesh Recovery with Transformerscited by 81
- 2020Rethinking the Heatmap Regression for Bottom-up Human Pose Estimationcited by 69
- 2021Learning to Estimate Robust 3D Human Mesh from In-the-Wild Crowded Scenescited by 65
- 2020Neural Descent for Visual 3D Human Pose and Shapecited by 60
- 2022Occluded Human Mesh Recoverycited by 54
- 20203D Multi-bodies: Fitting Sets of Plausible 3D Human Models to Ambiguous Image Datacited by 50
- 2017MonoCap: Monocular Human Motion Capture using a CNN Coupled with a Geometric Priorcited by 36
- 2023Diffusion-based Image Translation with Label Guidance for Domain Adaptive Semantic Segmentationcited by 27
- 2022Uncertainty-Aware Adaptation for Self-Supervised 3D Human Pose Estimationcited by 25
- 2021A Lightweight Graph Transformer Network for Human Mesh Reconstruction from 2D Human Posecited by 21
Built on by
Citing papers per year: 2023: 2; 2024: 9; 2025: 9; 2026: 7.
27 papers.
Sort:
By area:
- 2024SPAD : Spatially Aware Multiview Diffuserscited by 62
- 2024RoHM: Robust Human Motion Reconstruction via Diffusioncited by 48
- 2023Egocentric Whole-Body Motion Capture with FisheyeViT and Diffusion-Based Motion Refinementcited by 31
- 2024HMD^2: Environment-aware Motion Generation from Single Egocentric Head-Mounted Devicecited by 27
- 2023AI-Generated Content (AIGC) for Various Data Modalities: A Surveycited by 25
- 2024Diff-Tracker: Text-to-Image Diffusion Models are Unsupervised Trackerscited by 24
- 2024DPMesh: Exploiting Diffusion Prior for Occluded Human Mesh Recoverycited by 17
- 2026Physical Simulator In-the-Loop Video Generationcited by 14
- 2024Action Detection via an Image Diffusion Processcited by 11
- 2025ScoreHOI: Physically Plausible Reconstruction of Human-Object Interaction via Score-Guided Diffusioncited by 9
- 2025Visual Prompting for One-shot Controllable Video Editing without Inversioncited by 8
- 2025ADHMR: Aligning Diffusion-based Human Mesh Recovery via Direct Preference Optimizationcited by 7
15 more
- 2025DiSRT-In-Bed: Diffusion-Based Sim-to-Real Transfer Framework for In-Bed Human Mesh Recoverycited by 6
- 2025An Image-like Diffusion Method for Human-Object Interaction Detectioncited by 5
- 2024Utilizing Uncertainty in 2D Pose Detectors for Probabilistic 3D Human Mesh Recoverycited by 4
- 2025FastHMR: Accelerating Human Mesh Recovery via Token and Layer Merging with Diffusion Decodingcited by 4
- 2024GPT-Connect: Interaction between Text-Driven Human Motion Generator and 3D Scenes in a Training-free Mannercited by 3
- 2024DiffSurf: A Transformer-based Diffusion Model for Generating and Reconstructing 3D Surfaces in Posecited by 3
- 2025MeshMamba: State Space Models for Articulated 3D Mesh Generation and Reconstructioncited by 2
- 2026VLM-Guided Group Preference Alignment for Diffusion-based Human Mesh Recoverycited by 2
- 2025Gait Recognition via Collaborating Discriminative and Generative Diffusion Modelscited by 1
- 2026DiffProxy: Multi-View Human Mesh Recovery via Diffusion-Generated Dense Proxiescited by 1
- 2025Cascaded Diffusion Framework for Probabilistic Coarse-to-Fine Hand Pose Estimationcited by 0
- 2026Flexible Geometric Guidance for Probabilistic Human Pose Estimation with Diffusion Modelscited by 0
- 2026Discriminative-Generative Synergy for Occlusion Robust 3D Human Mesh Recoverycited by 0
- 2026HumanFlow -- Diffusion-Driven MAV Navigation Among Humans via Tightly-Coupled Motion Tracking, Forecasting, and Controlcited by 0
- 2026Training-free Controllable Human Motion Generation under Heterogeneous Constraintscited by 0
- 2026Training-free Controllable Human Motion Generation under Heterogeneous Constraints2 Jul 2026
- 2026HumanFlow -- Diffusion-Driven MAV Navigation Among Humans via Tightly-Coupled Motion Tracking, Forecasting, and Control25 May 2026
- 2026Discriminative-Generative Synergy for Occlusion Robust 3D Human Mesh Recovery20 Apr 2026
- 2026Physical Simulator In-the-Loop Video Generation6 Mar 2026
- 2026VLM-Guided Group Preference Alignment for Diffusion-based Human Mesh Recovery22 Feb 2026
- 2026Flexible Geometric Guidance for Probabilistic Human Pose Estimation with Diffusion Models3 Feb 2026
- 2026DiffProxy: Multi-View Human Mesh Recovery via Diffusion-Generated Dense Proxies5 Jan 2026
- 2025Gait Recognition via Collaborating Discriminative and Generative Diffusion Models9 Nov 2025
- 2025FastHMR: Accelerating Human Mesh Recovery via Token and Layer Merging with Diffusion Decoding13 Oct 2025
- 2025Cascaded Diffusion Framework for Probabilistic Coarse-to-Fine Hand Pose Estimation1 Oct 2025
- 2025ScoreHOI: Physically Plausible Reconstruction of Human-Object Interaction via Score-Guided Diffusion9 Sep 2025
- 2025MeshMamba: State Space Models for Articulated 3D Mesh Generation and Reconstruction21 Jul 2025
15 more
- 2025ADHMR: Aligning Diffusion-based Human Mesh Recovery via Direct Preference Optimization15 May 2025
- 2025Visual Prompting for One-shot Controllable Video Editing without Inversion19 Apr 2025
- 2025DiSRT-In-Bed: Diffusion-Based Sim-to-Real Transfer Framework for In-Bed Human Mesh Recovery3 Apr 2025
- 2025An Image-like Diffusion Method for Human-Object Interaction Detection23 Mar 2025
- 2024Utilizing Uncertainty in 2D Pose Detectors for Probabilistic 3D Human Mesh Recovery25 Nov 2024
- 2024HMD^2: Environment-aware Motion Generation from Single Egocentric Head-Mounted Device20 Sep 2024
- 2024DiffSurf: A Transformer-based Diffusion Model for Generating and Reconstructing 3D Surfaces in Pose27 Aug 2024
- 2024Diff-Tracker: Text-to-Image Diffusion Models are Unsupervised Trackers11 Jul 2024
- 2024DPMesh: Exploiting Diffusion Prior for Occluded Human Mesh Recovery1 Apr 2024
- 2024Action Detection via an Image Diffusion Process1 Apr 2024
- 2024GPT-Connect: Interaction between Text-Driven Human Motion Generator and 3D Scenes in a Training-free Manner22 Mar 2024
- 2024SPAD : Spatially Aware Multiview Diffusers7 Feb 2024
- 2024RoHM: Robust Human Motion Reconstruction via Diffusion16 Jan 2024
- 2023Egocentric Whole-Body Motion Capture with FisheyeViT and Diffusion-Based Motion Refinement28 Nov 2023
- 2023AI-Generated Content (AIGC) for Various Data Modalities: A Survey27 Aug 2023
- 2024Diff-Tracker: Text-to-Image Diffusion Models are Unsupervised Trackerscited by 24
- 2024DPMesh: Exploiting Diffusion Prior for Occluded Human Mesh Recoverycited by 17
- 2026Physical Simulator In-the-Loop Video Generationcited by 14
- 2025ScoreHOI: Physically Plausible Reconstruction of Human-Object Interaction via Score-Guided Diffusioncited by 9
- 2025Visual Prompting for One-shot Controllable Video Editing without Inversioncited by 8
- 2024DiffSurf: A Transformer-based Diffusion Model for Generating and Reconstructing 3D Surfaces in Posecited by 3
- 2025Gait Recognition via Collaborating Discriminative and Generative Diffusion Modelscited by 1
- 2025Cascaded Diffusion Framework for Probabilistic Coarse-to-Fine Hand Pose Estimationcited by 0
- 2026Flexible Geometric Guidance for Probabilistic Human Pose Estimation with Diffusion Modelscited by 0
- 2026HumanFlow -- Diffusion-Driven MAV Navigation Among Humans via Tightly-Coupled Motion Tracking, Forecasting, and Controlcited by 0
- 2026HumanFlow -- Diffusion-Driven MAV Navigation Among Humans via Tightly-Coupled Motion Tracking, Forecasting, and Control25 May 2026
- 2026Physical Simulator In-the-Loop Video Generation6 Mar 2026
- 2026Flexible Geometric Guidance for Probabilistic Human Pose Estimation with Diffusion Models3 Feb 2026
- 2025Gait Recognition via Collaborating Discriminative and Generative Diffusion Models9 Nov 2025
- 2025Cascaded Diffusion Framework for Probabilistic Coarse-to-Fine Hand Pose Estimation1 Oct 2025
- 2025ScoreHOI: Physically Plausible Reconstruction of Human-Object Interaction via Score-Guided Diffusion9 Sep 2025
- 2025Visual Prompting for One-shot Controllable Video Editing without Inversion19 Apr 2025
- 2024DiffSurf: A Transformer-based Diffusion Model for Generating and Reconstructing 3D Surfaces in Pose27 Aug 2024
- 2024Diff-Tracker: Text-to-Image Diffusion Models are Unsupervised Trackers11 Jul 2024
- 2024DPMesh: Exploiting Diffusion Prior for Occluded Human Mesh Recovery1 Apr 2024
- 2024SPAD : Spatially Aware Multiview Diffuserscited by 62
- 2024RoHM: Robust Human Motion Reconstruction via Diffusioncited by 48
- 2023Egocentric Whole-Body Motion Capture with FisheyeViT and Diffusion-Based Motion Refinementcited by 31
- 2024HMD^2: Environment-aware Motion Generation from Single Egocentric Head-Mounted Devicecited by 27
- 2023AI-Generated Content (AIGC) for Various Data Modalities: A Surveycited by 25
- 2024Action Detection via an Image Diffusion Processcited by 11
- 2025ADHMR: Aligning Diffusion-based Human Mesh Recovery via Direct Preference Optimizationcited by 7
- 2025DiSRT-In-Bed: Diffusion-Based Sim-to-Real Transfer Framework for In-Bed Human Mesh Recoverycited by 6
- 2025An Image-like Diffusion Method for Human-Object Interaction Detectioncited by 5
- 2024Utilizing Uncertainty in 2D Pose Detectors for Probabilistic 3D Human Mesh Recoverycited by 4
- 2025FastHMR: Accelerating Human Mesh Recovery via Token and Layer Merging with Diffusion Decodingcited by 4
- 2024GPT-Connect: Interaction between Text-Driven Human Motion Generator and 3D Scenes in a Training-free Mannercited by 3
12 most cited of 15 All 15 (JSON)
- 2026Training-free Controllable Human Motion Generation under Heterogeneous Constraints2 Jul 2026
- 2026Discriminative-Generative Synergy for Occlusion Robust 3D Human Mesh Recovery20 Apr 2026
- 2026DiffProxy: Multi-View Human Mesh Recovery via Diffusion-Generated Dense Proxies5 Jan 2026
- 2025FastHMR: Accelerating Human Mesh Recovery via Token and Layer Merging with Diffusion Decoding13 Oct 2025
- 2025ADHMR: Aligning Diffusion-based Human Mesh Recovery via Direct Preference Optimization15 May 2025
- 2025DiSRT-In-Bed: Diffusion-Based Sim-to-Real Transfer Framework for In-Bed Human Mesh Recovery3 Apr 2025
- 2025An Image-like Diffusion Method for Human-Object Interaction Detection23 Mar 2025
- 2024Utilizing Uncertainty in 2D Pose Detectors for Probabilistic 3D Human Mesh Recovery25 Nov 2024
- 2024HMD^2: Environment-aware Motion Generation from Single Egocentric Head-Mounted Device20 Sep 2024
- 2024Action Detection via an Image Diffusion Process1 Apr 2024
- 2024GPT-Connect: Interaction between Text-Driven Human Motion Generator and 3D Scenes in a Training-free Manner22 Mar 2024
- 2024SPAD : Spatially Aware Multiview Diffusers7 Feb 2024
12 newest of 15 All 15 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2023Generative Approach for Probabilistic Human Mesh Recovery using Diffusion Models
- 2023DiffMesh: A Motion-aware Diffusion Framework for Human Mesh Recovery from Videos
- 2025LieHMR: Autoregressive Human Mesh Recovery with SO(3) Diffusion
- 2024DiffHuman: Probabilistic Photorealistic 3D Reconstruction of Humans
- 2023Diffusion-HPC: Synthetic Data Generation for Human Mesh Recovery in Challenging Domains
- 2024Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Models
- 2024Score-Guided Diffusion for 3D Human Recovery
- 2024Multi-hypotheses Conditioned Point Cloud Diffusion for 3D Human Reconstruction from Occluded Images