Stage-wise Distortion-Perception Traversal in Zero-shot Inverse Problems with Diffusion Models
On the map: Diffusion models → Inverse problems and image restoration
Abstract (arXiv)
The distortion-perception (D-P) tradeoff is a fundamental phenomenon of Bayesian inverse problems, which characterizes the inherent tension between distortion performance and perceptual quality. Enabling flexible traversal of the D-P tradeoff at inference time is crucial for practical applications. Despite the recent success of diffusion models in zero-shot inverse problem solving, efficient and principled strategies for D-P traversal in diffusion-based inverse algorithms remain inadequately characterized. In this paper, we propose a stage-wise framework for realizing D-P traversal using a single diffusion model in zero-shot inverse problems. Our proposed method, termed MAP-RPS, starts with an MAP estimation stage that approximates the MMSE solution and provides a low-distortion initialization, followed by a re-noised posterior sampling stage that progressively improves perceptual quality. We provide theoretical analyses for both stages, establishing the validity and effectiveness of the proposed design. Furthermore, we extend MAP-RPS to the latent space, yielding LMAP-RPS, which enjoys broader applicability by leveraging large-scale pre-trained latent diffusion backbones. Extensive experiments demonstrate that MAP-RPS and LMAP-RPS enable more effective D-P traversal on various tasks, while also exhibiting strong performance as efficient solvers for real-world inverse problems.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 49 of its 67 references that are in the map. First posted on arXiv 27 May 2026.
Builds on
49 of 67 references.
Closest ancestors · 23
Same direction, newest first
- 2025Local MAP Sampling for Diffusion Models7 Oct
- 2025Traversing Distortion-Perception Tradeoff using a Single Score-Based Generative Model26 Mar
- 2025Efficient Image Restoration via Latent Consistency Flow Matching5 Feb
- 2025Rethinking Diffusion Posterior Sampling: From Conditional Score Estimator to Maximizing a Posterior31 Jan
- 2024A Modular Conditional Diffusion Framework for Image Reconstruction8 Nov
- 2024SITCOM: Step-wise Triple-Consistent Diffusion Sampling for Inverse Problems6 Oct
- 2024A Survey on Diffusion Models for Inverse Problems30 Sep
- 2024Improving Diffusion Inverse Problem Solving with Decoupled Noise Annealing1 Jul
- 2024Provably Robust Score-Based Diffusion Posterior Sampling for Plug-and-Play Image Reconstruction25 Mar
- 2024Efficient Diffusion Model for Image Restoration by Residual Shifting12 Mar
- 2023Beyond First-Order Tweedie: Solving Inverse Problems using Latent Diffusion1 Dec
- 2023Solving Inverse Problems with Latent Diffusion Models via Hard Data Consistency16 Jul
11 more
- 2023Solving Linear Inverse Problems Provably via Posterior Sampling with Latent Diffusion Models2 Jul
- 2023Denoising Diffusion Models for Plug-and-Play Image Restoration15 May
- 2023A Variational Perspective on Solving Inverse Problems with Diffusion Models7 May
- 2023Inversion by Direct Iteration: An Alternative to Denoising Diffusion for Image Restoration20 Mar
- 2022Multiscale Structure Guided Diffusion for Image Deblurring4 Dec
- 2022Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Model1 Dec
- 2022Diffusion Model Based Posterior Sampling for Noisy Linear Inverse Problems20 Nov
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problems29 Sep
- 2022Denoising Diffusion Restoration Models27 Jan
- 2021Come-Closer-Diffuse-Faster: Accelerating Conditional Diffusion Models for Inverse Problems through Stochastic Contraction9 Dec
- 2021Deblurring via Stochastic Refinement5 Dec
Other references · 26
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,323
- 2021Variational Diffusion Modelscited by 1,153
- 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Modelscited by 521
14 more
- 2016A Kernelized Stein Discrepancy for Goodness-of-fit Tests and Model Evaluationcited by 236
- 2016A Kernel Test of Goodness of Fitcited by 143
- 2018Regularization by Denoising: Clarifications and New Interpretationscited by 103
- 2023Multi-Source Diffusion Models for Simultaneous Music Generation and Separationcited by 63
- 2021Explore Image Deblurring via Blur Kernel Spacecited by 58
- 2021A Theory of the Distortion-Perception Tradeoff in Wasserstein Spacecited by 52
- 2022Score-based Generative Modeling Secretly Minimizes the Wasserstein Distancecited by 50
- 2021High Perceptual Quality Image Denoising with a Posterior Sampling CGANcited by 33
- 2023Stimulating Diffusion Model for Image Denoising via Adaptive Embedding and Ensemblingcited by 17
- 2024Tackling the Singularities at the Endpoints of Time Intervals in Diffusion Modelscited by 13
- 2024Adaptive Compressed Sensing with Diffusion-Based Posterior Samplingcited by 13
- 2024A Score-Based Density Formula, with Applications in Diffusion Generative Modelscited by 4
- 2024Score-Based Variational Inference for Inverse Problemscited by 2
- 2025A Simple Combination of Diffusion Models for Better Quality Trade-Offs in Image Denoisingcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023DiracDiffusion: Denoising and Incremental Reconstruction with Assured Data-Consistency
- 2023Accelerating Diffusion Models for Inverse Problems through Shortcut Sampling
- 2026Flow Map Denoisers: Traversing the Distortion-Perception Plane for Inverse Problems
- 2024Inverse Problems with Diffusion Models: A MAP Estimation Perspective
- 2026Hallucination-Aware Diffusion Sampling for Inverse Problems via Robust Prior Updates
- 2025DAPS++: Rethinking Diffusion Inverse Problems with Decoupled Posterior Annealing
- 2025MAP-based Problem-Agnostic diffusion model for Inverse Problems
- 2026Principled Design of Diffusion-based Optimizers for Inverse Problems