Solving Diffusion ODEs with Optimal Boundary Conditions for Better Image Super-Resolution
On the map: Diffusion models → Inverse problems and image restoration
Abstract (arXiv)
Diffusion models, as a kind of powerful generative model, have given impressive results on image super-resolution (SR) tasks. However, due to the randomness introduced in the reverse process of diffusion models, the performances of diffusion-based SR models are fluctuating at every time of sampling, especially for samplers with few resampled steps. This inherent randomness of diffusion models results in ineffectiveness and instability, making it challenging for users to guarantee the quality of SR results. However, our work takes this randomness as an opportunity: fully analyzing and leveraging it leads to the construction of an effective plug-and-play sampling method that owns the potential to benefit a series of diffusion-based SR methods. More in detail, we propose to steadily sample high-quality SR images from pre-trained diffusion-based SR models by solving diffusion ordinary differential equations (diffusion ODEs) with optimal boundary conditions (BCs) and analyze the characteristics between the choices of BCs and their corresponding SR results. Our analysis shows the route to obtain an approximately optimal BC via an efficient exploration in the whole space. The quality of SR results sampled by the proposed method with fewer steps outperforms the quality of results sampled by current methods with randomness from the same pre-trained diffusion-based SR model, which means that our sampling method "boosts" current diffusion-based SR models without any additional training.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 50 of its 58 references that are in the map. First posted on arXiv 24 May 2023.
Builds on
50 of 58 references.
Closest ancestors · 5
Same direction, newest first
- 2023Exploiting Diffusion Prior for Real-World Image Super-Resolution11 May
- 2023ResDiff: Combining CNN and Diffusion Model for Image Super-Resolution15 Mar
- 2023Denoising Diffusion Probabilistic Models for Robust Image Super-Resolution in the Wild15 Feb
- 2022Denoising Diffusion Restoration Models27 Jan
- 2021SRDiff: Single Image Super-Resolution with Diffusion Probabilistic Models30 Apr
Other references · 45
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
33 more
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022Generative Adversarial Networkscited by 5,627
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,908
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,552
- 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,545
- 2021Image Super-Resolution via Iterative Refinementcited by 1,511
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
- 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,264
- 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,254
- 2021Variational Diffusion Modelscited by 1,153
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
- 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 903
- 2020WaveGrad: Estimating Gradients for Waveform Generationcited by 622
- 2019Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Modelcited by 403
- 2020PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Modelscited by 358
- 2022Analytic-DPM: an Analytic Estimate of the Optimal Reverse Variance in Diffusion Probabilistic Modelscited by 334
- 2022MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generationcited by 227
- 2020SRFlow: Learning the Super-Resolution Space with Normalizing Flowcited by 209
- 2021GAN Prior Embedded Network for Blind Face Restoration in the Wildcited by 197
- 2020GLEAN: Generative Latent Bank for Large-Factor Image Super-Resolutioncited by 158
- 2019RankSRGAN: Generative Adversarial Networks with Ranker for Image Super-Resolutioncited by 145
- 2023DiffCollage: Parallel Generation of Large Content with Diffusion Modelscited by 103
- 2022Efficient and Degradation-Adaptive Network for Real-World Image Super-Resolutioncited by 96
- 2023Unified Multi-Modal Latent Diffusion for Joint Subject and Text Conditional Image Generationcited by 60
- 2017Pixel Recursive Super Resolutioncited by 44
- 2021Blind Image Super-Resolution via Contrastive Representation Learningcited by 32
Built on by
Citing papers per year: 2023: 1; 2024: 2; 2025: 4.
7 papers.
- 2023Any-Size-Diffusion: Toward Efficient Text-Driven Synthesis for Any-Size HD Imagescited by 36
- 2024Diffusion Enhancement for Cloud Removal in Ultra-Resolution Remote Sensing Imagerycited by 16
- 2024Correcting Diffusion-Based Perceptual Image Compression with Privileged End-to-End Decodercited by 13
- 2025Deterministic Image-to-Image Translation via Denoising Brownian Bridge Models with Dual Approximatorscited by 5
- 2025TurboVSR: Fantastic Video Upscalers and Where to Find Themcited by 2
- 2025Language-based Image Colorization: A Benchmark and Beyondcited by 1
- 2025Deterministic Medical Image Translation via High-fidelity Brownian Bridgescited by 0
- 2025Deterministic Image-to-Image Translation via Denoising Brownian Bridge Models with Dual Approximators29 Dec 2025
- 2025TurboVSR: Fantastic Video Upscalers and Where to Find Them30 Jun 2025
- 2025Deterministic Medical Image Translation via High-fidelity Brownian Bridges28 Mar 2025
- 2025Language-based Image Colorization: A Benchmark and Beyond19 Mar 2025
- 2024Correcting Diffusion-Based Perceptual Image Compression with Privileged End-to-End Decoder7 Apr 2024
- 2024Diffusion Enhancement for Cloud Removal in Ultra-Resolution Remote Sensing Imagery25 Jan 2024
- 2023Any-Size-Diffusion: Toward Efficient Text-Driven Synthesis for Any-Size HD Images31 Aug 2023
Similar, not cited
Close in wording, no citation either way
- 2023SinSR: Diffusion-Based Image Super-Resolution in a Single Step
- 2024Taming Diffusion Prior for Image Super-Resolution with Domain Shift SDEs
- 2024Arbitrary-steps Image Super-resolution via Diffusion Inversion
- 2024Diffusion Models, Image Super-Resolution And Everything: A Survey
- 2026Bridging Restoration and Generation in One-step Diffusion for Real-World Image Super-Resolution
- 2025Accelerating Diffusion-based Super-Resolution with Dynamic Time-Spatial Sampling
- 2024Degradation-Guided One-Step Image Super-Resolution with Diffusion Priors
- 2026TOC-SR: Task-Optimal Compact diffusion for Image Super Resolution