Dynamic Attention-Guided Diffusion for Image Super-Resolution
On the map: Diffusion models → Inverse problems and image restoration
Abstract (arXiv)
Diffusion models in image Super-Resolution (SR) treat all image regions uniformly, which risks compromising the overall image quality by potentially introducing artifacts during denoising of less-complex regions. To address this, we propose ``You Only Diffuse Areas'' (YODA), a dynamic attention-guided diffusion process for image SR. YODA selectively focuses on spatial regions defined by attention maps derived from the low-resolution images and the current denoising time step. This time-dependent targeting enables a more efficient conversion to high-resolution outputs by focusing on areas that benefit the most from the iterative refinement process, i.e., detail-rich objects. We empirically validate YODA by extending leading diffusion-based methods SR3, DiffBIR, and SRDiff. Our experiments demonstrate new state-of-the-art performances in face and general SR tasks across PSNR, SSIM, and LPIPS metrics. As a side effect, we find that YODA reduces color shift issues and stabilizes training with small batches.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 42 of its 63 references that are in the map. First posted on arXiv 15 Aug 2023.
Builds on
42 of 63 references.
Closest ancestors · 7
Same direction, newest first
- 2023Exploiting Diffusion Prior for Real-World Image Super-Resolution11 May
- 2023Inversion by Direct Iteration: An Alternative to Denoising Diffusion for Image Restoration20 Mar
- 2022Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Model1 Dec
- 2022Denoising Diffusion Restoration Models27 Jan
- 2021Come-Closer-Diffuse-Faster: Accelerating Conditional Diffusion Models for Inverse Problems through Stochastic Contraction9 Dec
- 2021Deblurring via Stochastic Refinement5 Dec
- 2021SRDiff: Single Image Super-Resolution with Diffusion Probabilistic Models30 Apr
Other references · 35
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
- 2021Image Super-Resolution via Iterative Refinementcited by 1,506
23 more
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
- 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,250
- 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,218
- 2020Learning Continuous Image Representation with Local Implicit Image Functioncited by 550
- 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 529
- 2018Recovering Realistic Texture in Image Super-resolution by Deep Spatial Feature Transformcited by 369
- 2022Perception Prioritized Training of Diffusion Modelscited by 301
- 2022Cold Diffusion: Inverting Arbitrary Image Transforms Without Noisecited by 275
- 2023I2SB: Image-to-Image Schr"odinger Bridgecited by 214
- 2020SRFlow: Learning the Super-Resolution Space with Normalizing Flowcited by 209
- 2019RankSRGAN: Generative Adversarial Networks with Ranker for Image Super-Resolutioncited by 145
- 2021Hierarchical Conditional Flow: A Unified Framework for Image Super-Resolution and Image Rescalingcited by 73
- 2022MR Image Denoising and Super-Resolution Using Regularized Reverse Diffusioncited by 66
- 2019Densely Residual Laplacian Super-Resolutioncited by 57
- 2019Learned Image Downscaling for Upscaling using Content Adaptive Resamplercited by 55
- 2021Adversarial Text-to-Image Synthesis: A Reviewcited by 52
- 2019Path-Restore: Learning Network Path Selection for Image Restorationcited by 39
- 2016RAISR: Rapid and Accurate Image Super Resolutioncited by 27
- 2020Visualization of Supervised and Self-Supervised Neural Networks via Attribution Guided Factorizationcited by 23
- 2022Hitchhiker's Guide to Super-Resolution: Introduction and Recent Advancescited by 21
- 2022Adaptive Patch Exiting for Scalable Single Image Super-Resolutioncited by 16
- 2023DWA: Differential Wavelet Amplifier for Image Super-Resolutioncited by 4
- 2023PartDiff: Image Super-resolution with Partial Diffusion Modelscited by 4
Built on by
Citing papers per year: 2023: 1; 2024: 2; 2025: 6; 2026: 1.
10 papers.
- 2024Diffusion Models, Image Super-Resolution And Everything: A Surveycited by 63
- 2023ElasticDiffusion: Training-free Arbitrary Size Image Generation through Global-Local Content Separationcited by 37
- 2025A Coreset Selection of Coreset Selection Literature: Introduction and Recent Advancescited by 28
- 2025Latent Wavelet Diffusion For Ultra-High-Resolution Image Synthesiscited by 6
- 2025VQualA 2025 Challenge on Image Super-Resolution Generated Content Quality Assessment: Methods and Resultscited by 5
- 2025Perception-oriented Bidirectional Attention Network for Image Super-resolution Quality Assessmentcited by 2
- 2026R3D: Regional-guided Residual Radar Diffusioncited by 2
- 2024Zoomed In, Diffused Out: Towards Local Degradation-Aware Multi-Diffusion for Extreme Image Super-Resolutioncited by 1
- 2025SkipSR: Faster Super Resolution with Token Skippingcited by 1
- 2025HDW-SR: High-Frequency Guided Diffusion Model based on Wavelet Decomposition for Image Super-Resolutioncited by 0
- 2026R3D: Regional-guided Residual Radar Diffusion10 Jan 2026
- 2025HDW-SR: High-Frequency Guided Diffusion Model based on Wavelet Decomposition for Image Super-Resolution17 Nov 2025
- 2025SkipSR: Faster Super Resolution with Token Skipping9 Oct 2025
- 2025Perception-oriented Bidirectional Attention Network for Image Super-resolution Quality Assessment8 Sep 2025
- 2025VQualA 2025 Challenge on Image Super-Resolution Generated Content Quality Assessment: Methods and Results8 Sep 2025
- 2025Latent Wavelet Diffusion For Ultra-High-Resolution Image Synthesis31 May 2025
- 2025A Coreset Selection of Coreset Selection Literature: Introduction and Recent Advances23 May 2025
- 2024Zoomed In, Diffused Out: Towards Local Degradation-Aware Multi-Diffusion for Extreme Image Super-Resolution18 Nov 2024
- 2024Diffusion Models, Image Super-Resolution And Everything: A Survey1 Jan 2024
- 2023ElasticDiffusion: Training-free Arbitrary Size Image Generation through Global-Local Content Separation30 Nov 2023
Similar, not cited
Close in wording, no citation either way
- 2025Accelerating Diffusion-based Super-Resolution with Dynamic Time-Spatial Sampling
- 2024FAM Diffusion: Frequency and Attention Modulation for High-Resolution Image Generation with Stable Diffusion
- 2025Local-Global Context-Aware and Structure-Preserving Image Super-Resolution
- 2024You Only Need One Step: Fast Super-Resolution with Stable Diffusion via Scale Distillation
- 2024Degradation-Guided One-Step Image Super-Resolution with Diffusion Priors
- 2025Semantic-Guided Diffusion Model for Single-Step Image Super-Resolution
- 2025GuideSR: Rethinking Guidance for One-Step High-Fidelity Diffusion-Based Super-Resolution
- 2026Degradation-Aware and Structure-Preserving Diffusion for Real-World Image Super-Resolution