mlsanityData to 7 Oct 2026

Reasons for the Superiority of Stochastic Estimators over Deterministic Ones: Robustness, Consistency and Perceptual Quality

arXiv 2211.08944 ↗First posted 16 Nov 2022eess.IV cs.CV cs.LGcited by 13

Not on the map. Why?

Abstract (arXiv)

Stochastic restoration algorithms allow to explore the space of solutions that correspond to the degraded input. In this paper we reveal additional fundamental advantages of stochastic methods over deterministic ones, which further motivate their use. First, we prove that any restoration algorithm that attains perfect perceptual quality and whose outputs are consistent with the input must be a posterior sampler, and is thus required to be stochastic. Second, we illustrate that while deterministic restoration algorithms may attain high perceptual quality, this can be achieved only by filling up the space of all possible source images using an extremely sensitive mapping, which makes them highly vulnerable to adversarial attacks. Indeed, we show that enforcing deterministic models to be robust to such attacks profoundly hinders their perceptual quality, while robustifying stochastic models hardly influences their perceptual quality, and improves their output variability. These findings provide a motivation to foster progress in stochastic restoration methods, paving the way to better recovery algorithms.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 45 of its 66 references that are in the map. First posted on arXiv 16 Nov 2022.

Builds on

45 of 66 references.

References · 45

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  5. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  6. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  7. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  8. 2014Deep Learning Face Attributes in the Wildcited by 3,679
  9. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
  10. 2021Image Super-Resolution via Iterative Refinementcited by 1,506
  11. 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
  12. 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,250
33 more
  1. 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,218
  2. 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,199
  3. 2022Denoising Diffusion Restoration Modelscited by 951
  4. 2016Adversarial Machine Learning at Scalecited by 934
  5. 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 925
  6. 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 902
  7. 2018Which Training Methods for GANs do actually Converge?cited by 672
  8. 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
  9. 2017The Perception-Distortion Tradeoffcited by 582
  10. 2018Generative Image Inpainting with Contextual Attentioncited by 578
  11. 2018Assessing Generative Models via Precision and Recallcited by 401
  12. 2017A Downsampled Variant of ImageNet as an Alternative to the CIFAR datasetscited by 374
  13. 2015Deep multi-scale video prediction beyond mean square errorcited by 297
  14. 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networkscited by 219
  15. 2019On instabilities of deep learning in image reconstruction - Does AI come at a cost?cited by 211
  16. 2020SRFlow: Learning the Super-Resolution Space with Normalizing Flowcited by 209
  17. 2021SNIPS: Solving Noisy Inverse Problems Stochasticallycited by 191
  18. 2020Contextual Residual Aggregation for Ultra High-Resolution Image Inpaintingcited by 124
  19. 2019Diversity-Sensitive Conditional Generative Adversarial Networkscited by 77
  20. 2021A Theory of the Distortion-Perception Tradeoff in Wasserstein Spacecited by 52
  21. 2022Towards Robust Rain Removal Against Adversarial Attacks: A Comprehensive Benchmark Analysis and Beyondcited by 48
  22. 2021Stochastic Image Denoising by Sampling from the Posterior Distributioncited by 45
  23. 2019Explorable Super Resolutioncited by 44
  24. 2017Deep Generative Adversarial Compression Artifact Removalcited by 37
  25. 2019Evaluating Robustness of Deep Image Super-Resolution against Adversarial Attackscited by 37
  26. 2021High Perceptual Quality Image Denoising with a Posterior Sampling CGANcited by 33
  27. 2020Improving Robustness of Deep-Learning-Based Image Reconstructioncited by 23
  28. 2021Variational AutoEncoder for Reference based Image Super-Resolutioncited by 18
  29. 2022Towards Adversarially Robust Deep Image Denoisingcited by 13
  30. 2022Robust Real-World Image Super-Resolution against Adversarial Attackscited by 11
  31. 2021Deep Image Destruction: Vulnerability of Deep Image-to-Image Models against Adversarial Attackscited by 8
  32. 2020Super-resolution Variational Auto-Encoderscited by 7
  33. 2022On Adversarial Robustness of Deep Image Deblurringcited by 7

Built on by

Cited by year

Citing papers per year: 2022: 1; 2023: 3; 2024: 5; 2025: 4.

13 papers.

Sort:

By area: