mlsanityData to 14 Oct 2026

Unlimited-Size Diffusion Restoration

arXiv 2303.00354 ↗First posted 1 Mar 2023cs.CVcited by 15

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

Recently, using diffusion models for zero-shot image restoration (IR) has become a new hot paradigm. This type of method only needs to use the pre-trained off-the-shelf diffusion models, without any finetuning, and can directly handle various IR tasks. The upper limit of the restoration performance depends on the pre-trained diffusion models, which are in rapid evolution. However, current methods only discuss how to deal with fixed-size images, but dealing with images of arbitrary sizes is very important for practical applications. This paper focuses on how to use those diffusion-based zero-shot IR methods to deal with any size while maintaining the excellent characteristics of zero-shot. A simple way to solve arbitrary size is to divide it into fixed-size patches and solve each patch independently. But this may yield significant artifacts since it neither considers the global semantics of all patches nor the local information of adjacent patches. Inspired by the Range-Null space Decomposition, we propose the Mask-Shift Restoration to address local incoherence and propose the Hierarchical Restoration to alleviate out-of-domain issues. Our simple, parameter-free approaches can be used not only for image restoration but also for image generation of unlimited sizes, with the potential to be a general tool for diffusion models. Code: https://github.com/wyhuai/DDNM/tree/main/hq_demo

Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 32 of its 41 references that are in the map. First posted on arXiv 1 Mar 2023.

Builds on

32 of 41 references.

Closest ancestors · 7

Same direction, newest first

  1. 2022Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Model1 Dec
  2. 2022Diffusion Posterior Sampling for General Noisy Inverse Problems29 Sep
  3. 2022JPEG Artifact Correction using Denoising Diffusion Restoration Models23 Sep
  4. 2022Improving Diffusion Models for Inverse Problems using Manifold Constraints2 Jun
  5. 2022Denoising Diffusion Restoration Models27 Jan
  6. 2021Come-Closer-Diffuse-Faster: Accelerating Conditional Diffusion Models for Inverse Problems through Stochastic Contraction9 Dec
  7. 2021Deblurring via Stochastic Refinement5 Dec

Other references · 25

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2020Denoising Diffusion Implicit Modelscited by 9,781
  5. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  7. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  8. 2022Scalable Diffusion Models with Transformerscited by 6,054
  9. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  10. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  11. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
  12. 2021Image Super-Resolution via Iterative Refinementcited by 1,511
13 more
  1. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
  2. 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
  3. 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 635
  4. 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 529
  5. 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Modelscited by 521
  6. 2023Universal Guidance for Diffusion Modelscited by 437
  7. 2021Towards Real-World Blind Face Restoration with Generative Facial Priorcited by 349
  8. 2022Analytic-DPM: an Analytic Estimate of the Optimal Reverse Variance in Diffusion Probabilistic Modelscited by 334
  9. 2023I2SB: Image-to-Image Schr"odinger Bridgecited by 218
  10. 2022VQFR: Blind Face Restoration with Vector-Quantized Dictionary and Parallel Decodercited by 116
  11. 2019Deep Decomposition Learning for Inverse Imaging Problemscited by 25
  12. 2022GAN Prior based Null-Space Learning for Consistent Super-Resolutioncited by 22
  13. 2022Panini-Net: GAN Prior Based Degradation-Aware Feature Interpolation for Face Restorationcited by 12

Built on by

Cited by year

Citing papers per year: 2023: 7; 2024: 6; 2025: 2.

15 papers.

Sort:

By area:

  1. 2023FreeDoM: Training-Free Energy-Guided Conditional Diffusion Modelcited by 294
  2. 2023Prompt-tuning latent diffusion models for inverse problemscited by 70
  3. 2023CRoSS: Diffusion Model Makes Controllable, Robust and Secure Image Steganographycited by 50
  4. 2023Image Restoration Through Generalized Ornstein-Uhlenbeck Bridgecited by 41
  5. 2024Arbitrary-Scale Image Generation and Upsampling using Latent Diffusion Model and Implicit Neural Decodercited by 25
  6. 2023A Unified Conditional Framework for Diffusion-based Image Restorationcited by 22
  7. 2023AnimateZero: Video Diffusion Models are Zero-Shot Image Animatorscited by 19
  8. 2024RecDiffusion: Rectangling for Image Stitching with Diffusion Modelscited by 14
  9. 2024Invertible Diffusion Models for Compressed Sensingcited by 12
  10. 2024Music Consistency Modelscited by 7
  11. 2024Make Your Actor Talk: Generalizable and High-Fidelity Lip Sync with Motion and Appearance Disentanglementcited by 7
  12. 2024Taming Generative Diffusion Prior for Universal Blind Image Restorationcited by 4
3 more
  1. 2025NPN: Non-Linear Projections of the Null-Space for Imaging Inverse Problemscited by 4
  2. 2023DDGM: Solving inverse problems by Diffusive Denoising of Gradient-based Minimizationcited by 2
  3. 2025Equivariant Sampling for Improving Diffusion Model-based Image Restorationcited by 1

Similar, not cited

Close in wording, no citation either way

  1. 2025Reconciling Stochastic and Deterministic Strategies for Zero-shot Image Restoration using Diffusion Model in Dual
  2. 2024DiffIR2VR-Zero: Zero-Shot Video Restoration with Diffusion-based Image Restoration Models
  3. 2024Efficient Diffusion Model for Image Restoration by Residual Shifting
  4. 2024Taming Diffusion Models for Image Restoration: A Review
  5. 2026Efficient and Training-Free Single-Image Diffusion Models
  6. 2025Efficient Zero-Shot Inpainting with Decoupled Diffusion Guidance
  7. 2025Diffusion Image Prior
  8. 2024Zero-Shot Video Restoration and Enhancement Using Pre-Trained Image Diffusion Model