mlsanityData to 14 Oct 2026

HAODiff: Human-Aware One-Step Diffusion via Dual-Prompt Guidance

arXiv 2505.19742 ↗First posted 26 May 2025cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

Human-centered images often suffer from severe generic degradation during transmission and are prone to human motion blur (HMB), making restoration challenging. Existing research lacks sufficient focus on these issues, as both problems often coexist in practice. To address this, we design a degradation pipeline that simulates the coexistence of HMB and generic noise, generating synthetic degraded data to train our proposed HAODiff, a human-aware one-step diffusion. Specifically, we propose a triple-branch dual-prompt guidance (DPG), which leverages high-quality images, residual noise (LQ minus HQ), and HMB segmentation masks as training targets. It produces a positive-negative prompt pair for classifier-free guidance (CFG) in a single diffusion step. The resulting adaptive dual prompts let HAODiff exploit CFG more effectively, boosting robustness against diverse degradations. For fair evaluation, we introduce MPII-Test, a benchmark rich in combined noise and HMB cases. Extensive experiments show that our HAODiff surpasses existing state-of-the-art (SOTA) methods in terms of both quantitative metrics and visual quality on synthetic and real-world datasets, including our introduced MPII-Test. Code is available at: https://github.com/gobunu/HAODiff.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 50 of its 71 references that are in the map. First posted on arXiv 26 May 2025.

Builds on

50 of 71 references.

References · 50

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  5. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  6. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  7. 2020Denoising Diffusion Implicit Modelscited by 9,781
  8. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  9. 2022Classifier-Free Diffusion Guidancecited by 5,847
  10. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  11. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
  12. 2020Rethinking Attention with Performerscited by 1,601
38 more
  1. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
  2. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
  3. 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
  4. 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 727
  5. 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 529
  6. 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 522
  7. 2023Exploiting Diffusion Prior for Real-World Image Super-Resolutioncited by 489
  8. 2017DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networkscited by 367
  9. 2023ResShift: Efficient Diffusion Model for Image Super-resolution by Residual Shiftingcited by 365
  10. 2018Scale-recurrent Network for Deep Image Deblurringcited by 333
  11. 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolutioncited by 315
  12. 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 286
  13. 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 280
  14. 2023DiffBIR: Towards Blind Image Restoration with Generative Diffusion Priorcited by 257
  15. 2023DiffIR: Efficient Diffusion Model for Image Restorationcited by 255
  16. 2023Pixel-Aware Stable Diffusion for Realistic Image Super-resolution and Personalized Stylizationcited by 254
  17. 2024One-Step Effective Diffusion Network for Real-World Image Super-Resolutioncited by 246
  18. 2023SinSR: Diffusion-Based Image Super-Resolution in a Single Stepcited by 238
  19. 2024Sapiens: Foundation for Human Vision Modelscited by 229
  20. 2023TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessmentcited by 226
  21. 2015Learning a Convolutional Neural Network for Non-uniform Motion Blur Removalcited by 149
  22. 2023Hierarchical Integration Diffusion Model for Realistic Image Deblurringcited by 88
  23. 2024Arbitrary-steps Image Super-resolution via Diffusion Inversioncited by 86
  24. 2016A Neural Approach to Blind Motion Deblurringcited by 69
  25. 2024Degradation-Guided One-Step Image Super-Resolution with Diffusion Priorscited by 69
  26. 2024OSDFace: One-Step Diffusion Model for Face Restorationcited by 33
  27. 2022Real-World Deep Local Motion Deblurringcited by 21
  28. 2024Unleashing the Power of One-Step Diffusion based Image Super-Resolution via a Large-Scale Diffusion Discriminatorcited by 19
  29. 2017Motion Deblurring in the Wildcited by 17
  30. 2024Multiscale Sliced Wasserstein Distances as Perceptual Color Difference Measurescited by 14
  31. 2024MultiGO: Towards Multi-level Geometry Learning for Monocular 3D Textured Human Reconstructioncited by 10
  32. 2025One-Step Diffusion Model for Image Motion-Deblurringcited by 9
  33. 2025HiPART: Hierarchical Pose AutoRegressive Transformer for Occluded 3D Human Pose Estimationcited by 8
  34. 2023Adaptive Window Pruning for Efficient Local Motion Deblurringcited by 6
  35. 2024DiffBody: Human Body Restoration by Imagining with Generative Diffusion Priorcited by 6
  36. 2024Interacted Object Grounding in Spatio-Temporal Human-Object Interactionscited by 6
  37. 2024A Review of Human-Object Interaction Detectioncited by 5
  38. 2025Human Body Restoration with One-Step Diffusion Model and A New Benchmarkcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.