Reasons for the Superiority of Stochastic Estimators over Deterministic Ones: Robustness, Consistency and Perceptual Quality
Not on the map. Why?
Abstract (arXiv)
Stochastic restoration algorithms allow to explore the space of solutions that correspond to the degraded input. In this paper we reveal additional fundamental advantages of stochastic methods over deterministic ones, which further motivate their use. First, we prove that any restoration algorithm that attains perfect perceptual quality and whose outputs are consistent with the input must be a posterior sampler, and is thus required to be stochastic. Second, we illustrate that while deterministic restoration algorithms may attain high perceptual quality, this can be achieved only by filling up the space of all possible source images using an extremely sensitive mapping, which makes them highly vulnerable to adversarial attacks. Indeed, we show that enforcing deterministic models to be robust to such attacks profoundly hinders their perceptual quality, while robustifying stochastic models hardly influences their perceptual quality, and improves their output variability. These findings provide a motivation to foster progress in stochastic restoration methods, paving the way to better recovery algorithms.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 45 of its 66 references that are in the map. First posted on arXiv 16 Nov 2022.
Builds on
45 of 66 references.
References · 45
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
- 2021Image Super-Resolution via Iterative Refinementcited by 1,506
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
- 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,250
33 more
- 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,218
- 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,199
- 2022Denoising Diffusion Restoration Modelscited by 951
- 2016Adversarial Machine Learning at Scalecited by 934
- 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 925
- 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 902
- 2018Which Training Methods for GANs do actually Converge?cited by 672
- 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
- 2017The Perception-Distortion Tradeoffcited by 582
- 2018Generative Image Inpainting with Contextual Attentioncited by 578
- 2018Assessing Generative Models via Precision and Recallcited by 401
- 2017A Downsampled Variant of ImageNet as an Alternative to the CIFAR datasetscited by 374
- 2015Deep multi-scale video prediction beyond mean square errorcited by 297
- 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networkscited by 219
- 2019On instabilities of deep learning in image reconstruction - Does AI come at a cost?cited by 211
- 2020SRFlow: Learning the Super-Resolution Space with Normalizing Flowcited by 209
- 2021SNIPS: Solving Noisy Inverse Problems Stochasticallycited by 191
- 2020Contextual Residual Aggregation for Ultra High-Resolution Image Inpaintingcited by 124
- 2019Diversity-Sensitive Conditional Generative Adversarial Networkscited by 77
- 2021A Theory of the Distortion-Perception Tradeoff in Wasserstein Spacecited by 52
- 2022Towards Robust Rain Removal Against Adversarial Attacks: A Comprehensive Benchmark Analysis and Beyondcited by 48
- 2021Stochastic Image Denoising by Sampling from the Posterior Distributioncited by 45
- 2019Explorable Super Resolutioncited by 44
- 2017Deep Generative Adversarial Compression Artifact Removalcited by 37
- 2019Evaluating Robustness of Deep Image Super-Resolution against Adversarial Attackscited by 37
- 2021High Perceptual Quality Image Denoising with a Posterior Sampling CGANcited by 33
- 2020Improving Robustness of Deep-Learning-Based Image Reconstructioncited by 23
- 2021Variational AutoEncoder for Reference based Image Super-Resolutioncited by 18
- 2022Towards Adversarially Robust Deep Image Denoisingcited by 13
- 2022Robust Real-World Image Super-Resolution against Adversarial Attackscited by 11
- 2021Deep Image Destruction: Vulnerability of Deep Image-to-Image Models against Adversarial Attackscited by 8
- 2020Super-resolution Variational Auto-Encoderscited by 7
- 2022On Adversarial Robustness of Deep Image Deblurringcited by 7
Built on by
Citing papers per year: 2022: 1; 2023: 3; 2024: 5; 2025: 4.
13 papers.
Sort:
By area:
- 2023Image Denoising: The Deep Learning Revolution and Beyond -- A Survey Paper --cited by 71
- 2024Idempotence and Perceptual Image Compressioncited by 27
- 2025Compressed Image Generation with Denoising Diffusion Codebook Modelscited by 24
- 2024Degradation-Aware Residual-Conditioned Optimal Transport for Unified Image Restorationcited by 21
- 2023Deep Optimal Transport: A Practical Algorithm for Photo-realistic Image Restorationcited by 15
- 2022High-Perceptual Quality JPEG Decoding via Posterior Samplingcited by 8
- 2023The Perception-Robustness Tradeoff in Deterministic Image Restorationcited by 7
- 2024Perceptual Fairness in Image Restorationcited by 2
- 2024pcaGAN: Improving Posterior-Sampling cGANs via Principal Component Regularizationcited by 2
- 2025Double Blind Imaging with Generative Modelingcited by 1
- 2025Generative AI Meets 6G and Beyond: Diffusion Models for Semantic Communicationscited by 1
- 2024Stochastic BIQA: Median Randomized Smoothing for Certified Blind Image Quality Assessmentcited by 0
1 more
- 2025Generative AI Meets 6G and Beyond: Diffusion Models for Semantic Communications11 Nov 2025
- 2025On Inverse Problems, Parameter Estimation, and Domain Generalization6 Jun 2025
- 2025Double Blind Imaging with Generative Modeling27 Mar 2025
- 2025Compressed Image Generation with Denoising Diffusion Codebook Models3 Feb 2025
- 2024Stochastic BIQA: Median Randomized Smoothing for Certified Blind Image Quality Assessment19 Nov 2024
- 2024Degradation-Aware Residual-Conditioned Optimal Transport for Unified Image Restoration3 Nov 2024
- 2024pcaGAN: Improving Posterior-Sampling cGANs via Principal Component Regularization1 Nov 2024
- 2024Perceptual Fairness in Image Restoration22 May 2024
- 2024Idempotence and Perceptual Image Compression17 Jan 2024
- 2023The Perception-Robustness Tradeoff in Deterministic Image Restoration14 Nov 2023
- 2023Deep Optimal Transport: A Practical Algorithm for Photo-realistic Image Restoration4 Jun 2023
- 2023Image Denoising: The Deep Learning Revolution and Beyond -- A Survey Paper --9 Jan 2023
1 more
- 2022High-Perceptual Quality JPEG Decoding via Posterior Sampling21 Nov 2022
- 2023Image Denoising: The Deep Learning Revolution and Beyond -- A Survey Paper --cited by 71
- 2024Idempotence and Perceptual Image Compressioncited by 27
- 2024Degradation-Aware Residual-Conditioned Optimal Transport for Unified Image Restorationcited by 21
- 2023Deep Optimal Transport: A Practical Algorithm for Photo-realistic Image Restorationcited by 15
- 2022High-Perceptual Quality JPEG Decoding via Posterior Samplingcited by 8
- 2023The Perception-Robustness Tradeoff in Deterministic Image Restorationcited by 7
- 2024Perceptual Fairness in Image Restorationcited by 2
- 2024pcaGAN: Improving Posterior-Sampling cGANs via Principal Component Regularizationcited by 2
- 2025Double Blind Imaging with Generative Modelingcited by 1
- 2024Stochastic BIQA: Median Randomized Smoothing for Certified Blind Image Quality Assessmentcited by 0
- 2025On Inverse Problems, Parameter Estimation, and Domain Generalizationcited by 0
- 2025On Inverse Problems, Parameter Estimation, and Domain Generalization6 Jun 2025
- 2025Double Blind Imaging with Generative Modeling27 Mar 2025
- 2024Stochastic BIQA: Median Randomized Smoothing for Certified Blind Image Quality Assessment19 Nov 2024
- 2024Degradation-Aware Residual-Conditioned Optimal Transport for Unified Image Restoration3 Nov 2024
- 2024pcaGAN: Improving Posterior-Sampling cGANs via Principal Component Regularization1 Nov 2024
- 2024Perceptual Fairness in Image Restoration22 May 2024
- 2024Idempotence and Perceptual Image Compression17 Jan 2024
- 2023The Perception-Robustness Tradeoff in Deterministic Image Restoration14 Nov 2023
- 2023Deep Optimal Transport: A Practical Algorithm for Photo-realistic Image Restoration4 Jun 2023
- 2023Image Denoising: The Deep Learning Revolution and Beyond -- A Survey Paper --9 Jan 2023
- 2022High-Perceptual Quality JPEG Decoding via Posterior Sampling21 Nov 2022