Discriminative-Generative Synergy for Occlusion Robust 3D Human Mesh Recovery
Not on the map. Why?
Abstract (arXiv)
3D human mesh recovery from monocular RGB images aims to estimate anatomically plausible 3D human models for downstream applications, but remains challenging under partial or severe occlusions. Regression-based methods are efficient yet often produce implausible or inaccurate results in unconstrained scenarios, while diffusion-based methods provide strong generative priors for occluded regions but may weaken fidelity to rare poses due to over-reliance on generation. To address these limitations, we propose a brain-inspired synergistic framework that integrates the discriminative power of vision transformers with the generative capability of conditional diffusion models. Specifically, the ViT-based pathway extracts deterministic visual cues from visible regions, while the diffusion-based pathway synthesizes structurally coherent human body representations. To effectively bridge the two pathways, we design a diverse-consistent feature learning module to align discriminative features with generative priors, and a cross-attention multi-level fusion mechanism to enable bidirectional interaction across semantic levels. Experiments on standard benchmarks demonstrate that our method achieves superior performance on key metrics and shows strong robustness in complex real-world scenarios.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 39 of its 56 references that are in the map. First posted on arXiv 20 Apr 2026.
Builds on
39 of 56 references.
References · 39
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2017Mask R-CNNcited by 7,259
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
27 more
- 2017End-to-end Recovery of Human Shape and Posecited by 883
- 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 625
- 2021PARE: Part Attention Regressor for 3D Human Body Estimationcited by 334
- 2021PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loopcited by 250
- 2020Monocular, One-stage, Regression of Multiple 3D Peoplecited by 216
- 2018CrowdPose: Efficient Crowded Scenes Pose Estimation and A New Benchmarkcited by 214
- 2021AGORA: Avatars in Geography Optimized for Regression Analysiscited by 203
- 2021FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and Integrationcited by 168
- 2020Monocular Expressive Body Regression through Body-Driven Attentioncited by 155
- 2023SMPLer-X: Scaling Up Expressive Human Pose and Shape Estimationcited by 154
- 2022PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Imagescited by 152
- 2021Putting People in their Place: Monocular Regression of 3D People in Depthcited by 141
- 2021Collaborative Regression of Expressive Bodies using Moderationcited by 137
- 2020Coherent Reconstruction of Multiple Humans from a Single Imagecited by 136
- 2023One-Stage 3D Whole-Body Mesh Recovery with Component Aware Transformercited by 128
- 2024Multi-HMR: Multi-Person Whole-Body Human Mesh Recovery in a Single Shotcited by 98
- 2020Accurate 3D Hand Pose Estimation for Whole-Body 3D Human Mesh Estimationcited by 81
- 2025PromptHMR: Promptable Human Mesh Recoverycited by 70
- 2021Learning to Estimate Robust 3D Human Mesh from In-the-Wild Crowded Scenescited by 64
- 2022Occluded Human Mesh Recoverycited by 52
- 2022Differentiable Dynamics for Articulated 3d Human Motion Reconstructioncited by 38
- 2023PSVT: End-to-End Multi-person 3D Pose and Shape Estimation with Progressive Video Transformerscited by 31
- 20233D-Aware Neural Body Fitting for Occlusion Robust 3D Human Pose Estimationcited by 28
- 2023Distribution-Aligned Diffusion for Human Mesh Recoverycited by 27
- 2024DPMesh: Exploiting Diffusion Prior for Occluded Human Mesh Recoverycited by 16
- 2023Generative Approach for Probabilistic Human Mesh Recovery using Diffusion Modelscited by 14
- 2021LASOR: Learning Accurate 3D Human Pose and Shape Via Synthetic Occlusion-Aware Data and Neural Mesh Renderingcited by 7
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025LieHMR: Autoregressive Human Mesh Recovery with SO(3) Diffusion
- 2025Stable Diffusion-Based Approach for Human De-Occlusion
- 2025Adapting Human Mesh Recovery with Vision-Language Feedback
- 2026DiffProxy: Multi-View Human Mesh Recovery via Diffusion-Generated Dense Proxies
- 2023Diffusion-HPC: Synthetic Data Generation for Human Mesh Recovery in Challenging Domains
- 2026VLM-Guided Group Preference Alignment for Diffusion-based Human Mesh Recovery
- 2024StructLDM: Structured Latent Diffusion for 3D Human Generation
- 2024DiffHuman: Probabilistic Photorealistic 3D Reconstruction of Humans