HAODiff: Human-Aware One-Step Diffusion via Dual-Prompt Guidance
Not on the map. Why?
Abstract (arXiv)
Human-centered images often suffer from severe generic degradation during transmission and are prone to human motion blur (HMB), making restoration challenging. Existing research lacks sufficient focus on these issues, as both problems often coexist in practice. To address this, we design a degradation pipeline that simulates the coexistence of HMB and generic noise, generating synthetic degraded data to train our proposed HAODiff, a human-aware one-step diffusion. Specifically, we propose a triple-branch dual-prompt guidance (DPG), which leverages high-quality images, residual noise (LQ minus HQ), and HMB segmentation masks as training targets. It produces a positive-negative prompt pair for classifier-free guidance (CFG) in a single diffusion step. The resulting adaptive dual prompts let HAODiff exploit CFG more effectively, boosting robustness against diverse degradations. For fair evaluation, we introduce MPII-Test, a benchmark rich in combined noise and HMB cases. Extensive experiments show that our HAODiff surpasses existing state-of-the-art (SOTA) methods in terms of both quantitative metrics and visual quality on synthetic and real-world datasets, including our introduced MPII-Test. Code is available at: https://github.com/gobunu/HAODiff.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 50 of its 71 references that are in the map. First posted on arXiv 26 May 2025.
Builds on
50 of 71 references.
References · 50
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
- 2020Rethinking Attention with Performerscited by 1,601
38 more
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
- 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 727
- 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 529
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 522
- 2023Exploiting Diffusion Prior for Real-World Image Super-Resolutioncited by 489
- 2017DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networkscited by 367
- 2023ResShift: Efficient Diffusion Model for Image Super-resolution by Residual Shiftingcited by 365
- 2018Scale-recurrent Network for Deep Image Deblurringcited by 333
- 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolutioncited by 315
- 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 286
- 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 280
- 2023DiffBIR: Towards Blind Image Restoration with Generative Diffusion Priorcited by 257
- 2023DiffIR: Efficient Diffusion Model for Image Restorationcited by 255
- 2023Pixel-Aware Stable Diffusion for Realistic Image Super-resolution and Personalized Stylizationcited by 254
- 2024One-Step Effective Diffusion Network for Real-World Image Super-Resolutioncited by 246
- 2023SinSR: Diffusion-Based Image Super-Resolution in a Single Stepcited by 238
- 2024Sapiens: Foundation for Human Vision Modelscited by 229
- 2023TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessmentcited by 226
- 2015Learning a Convolutional Neural Network for Non-uniform Motion Blur Removalcited by 149
- 2023Hierarchical Integration Diffusion Model for Realistic Image Deblurringcited by 88
- 2024Arbitrary-steps Image Super-resolution via Diffusion Inversioncited by 86
- 2016A Neural Approach to Blind Motion Deblurringcited by 69
- 2024Degradation-Guided One-Step Image Super-Resolution with Diffusion Priorscited by 69
- 2024OSDFace: One-Step Diffusion Model for Face Restorationcited by 33
- 2022Real-World Deep Local Motion Deblurringcited by 21
- 2024Unleashing the Power of One-Step Diffusion based Image Super-Resolution via a Large-Scale Diffusion Discriminatorcited by 19
- 2017Motion Deblurring in the Wildcited by 17
- 2024Multiscale Sliced Wasserstein Distances as Perceptual Color Difference Measurescited by 14
- 2024MultiGO: Towards Multi-level Geometry Learning for Monocular 3D Textured Human Reconstructioncited by 10
- 2025One-Step Diffusion Model for Image Motion-Deblurringcited by 9
- 2025HiPART: Hierarchical Pose AutoRegressive Transformer for Occluded 3D Human Pose Estimationcited by 8
- 2023Adaptive Window Pruning for Efficient Local Motion Deblurringcited by 6
- 2024DiffBody: Human Body Restoration by Imagining with Generative Diffusion Priorcited by 6
- 2024Interacted Object Grounding in Spatio-Temporal Human-Object Interactionscited by 6
- 2024A Review of Human-Object Interaction Detectioncited by 5
- 2025Human Body Restoration with One-Step Diffusion Model and A New Benchmarkcited by 5
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Improved Adversarial Diffusion Compression for Real-World Video Super-Resolutioncited by 5
- 2026Spectral and Trajectory Regularization for Diffusion Transformer Super-Resolutioncited by 2
- 2026Light Up Your Face: A Physically Consistent Dataset and Diffusion Model for Face Fill-Light Enhancementcited by 0
- 2026LCUDiff: Latent Capacity Upgrade Diffusion for Faithful Human Body Restorationcited by 0
- 2026Face2Scene: Using Facial Degradation as an Oracle for Diffusion-Based Scene Restorationcited by 0
- 2026Face2Scene: Using Facial Degradation as an Oracle for Diffusion-Based Scene Restoration17 Mar 2026
- 2026Spectral and Trajectory Regularization for Diffusion Transformer Super-Resolution6 Mar 2026
- 2026Improved Adversarial Diffusion Compression for Real-World Video Super-Resolution28 Feb 2026
- 2026LCUDiff: Latent Capacity Upgrade Diffusion for Faithful Human Body Restoration4 Feb 2026
- 2026Light Up Your Face: A Physically Consistent Dataset and Diffusion Model for Face Fill-Light Enhancement4 Feb 2026