mlsanityData to 7 Oct 2026

Deep priors for satellite image restoration with accurate uncertainties

arXiv 2412.04130 ↗First posted 5 Dec 2024cs.CV eess.IV physics.opticscited by 1

Not on the map. Why?

Abstract (arXiv)

Satellite optical images, upon their on-ground receipt, offer a distorted view of the observed scene. Their restoration, including denoising, deblurring, and sometimes super-resolution, is required before their exploitation. Moreover, quantifying the uncertainties related to this restoration helps to reduce the risks of misinterpreting the image content. Deep learning methods are now state-of-the-art for satellite image restoration. Among them, direct inversion methods train a specific network for each sensor, and generally provide a point estimation of the restored image without the associated uncertainties. Alternatively, deep regularization (DR) methods learn a deep prior on target images before plugging it, as the regularization term, into a model-based optimization scheme. This allows for restoring images from several sensors with a single network and possibly for estimating associated uncertainties. In this paper, we introduce VBLE-xz, a DR method that solves the inverse problem in the latent space of a variational compressive autoencoder (CAE). We adapt the regularization strength by modulating the bitrate of the trained CAE with a training-free approach. Then, VBLE-xz estimates relevant uncertainties jointly in the latent and in the image spaces by sampling an explicit posterior estimated within variational inference. This enables fast posterior sampling, unlike state-of-the-art DR methods that use Markov chains or diffusion-based approaches. We conduct a comprehensive set of experiments on very high-resolution simulated and real Pl'eiades images, asserting the performance, robustness and scalability of the proposed method. They demonstrate that VBLE-xz represents a compelling alternative to direct inversion methods when uncertainty quantification is required. The code associated to this paper is available in https://github.com/MaudBqrd/VBLExz.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 56 of its 96 references that are in the map. First posted on arXiv 5 Dec 2024.

Builds on

56 of 96 references.

References · 56

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2022Generative Adversarial Networkscited by 5,603
  4. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  5. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
  6. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  7. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
  8. 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,539
  9. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
  10. 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,375
  11. 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,352
  12. 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,250
38 more
  1. 2014NICE: Non-linear Independent Components Estimationcited by 1,052
  2. 2022Denoising Diffusion Restoration Modelscited by 951
  3. 2018Variational image compression with a scale hyperpriorcited by 910
  4. 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
  5. 2021Multi-Stage Progressive Image Restorationcited by 813
  6. 2018Residual Dense Network for Image Super-Resolutioncited by 796
  7. 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 792
  8. 2016End-to-end Optimized Image Compressioncited by 673
  9. 2018Joint Autoregressive and Hierarchical Priors for Learned Image Compressioncited by 642
  10. 2020Learned Image Compression with Discretized Gaussian Mixture Likelihoods and Attention Modulescited by 570
  11. 2020Plug-and-Play Image Restoration with Deep Denoiser Priorcited by 467
  12. 2017Learning Deep CNN Denoiser Prior for Image Restorationcited by 407
  13. 2017Compressed Sensing using Generative Modelscited by 337
  14. 2023Denoising Diffusion Models for Plug-and-Play Image Restorationcited by 335
  15. 2020CompressAI: a PyTorch library and evaluation platform for end-to-end compression researchcited by 271
  16. 2016Plug-and-Play ADMM for Image Restoration: Fixed Point Convergence and Applicationscited by 244
  17. 2019Deep Plug-and-Play Super-Resolution for Arbitrary Blur Kernelscited by 112
  18. 2021Gradient Step Denoiser for convergent Plug-and-Playcited by 107
  19. 2021Bayesian imaging using Plug & Play priors: when Langevin meets Tweediecited by 96
  20. 2023Refusion: Enabling Large-Size Realistic Image Restoration with Latent-Space Diffusion Modelscited by 86
  21. 2016Efficient Bayesian computation by proximal Markov chain Monte Carlo: when Langevin meets Moreaucited by 83
  22. 2021Intermediate Layer Optimization for Inverse Problems using Deep Generative Modelscited by 70
  23. 2020Simple and Effective VAE Training with Calibrated Decoderscited by 57
  24. 2021Variable-Rate Deep Image Compression through Spatially-Adaptive Feature Transformcited by 56
  25. 2019Variable Rate Deep Image Compression with Modulated Autoencodercited by 39
  26. 2021Trumpets: Injective Flows for Inference and Inverse Problemscited by 36
  27. 2018Structured Uncertainty Prediction Networkscited by 34
  28. 2018Modeling Sparse Deviations for Compressed Sensing using Generative Modelscited by 33
  29. 2020Bayesian Image Reconstruction using Deep Generative Modelscited by 29
  30. 2021Solving Inverse Problems by Joint Posterior Maximization with Autoencoding Priorcited by 24
  31. 2021Bayesian Imaging With Data-Driven Priors Encoded by Neural Networks: Theory, Methods, and Algorithmscited by 24
  32. 2021Regularising Inverse Problems with Generative Machine Learning Modelscited by 22
  33. 2022Deep Plug-and-Play Prior for Hyperspectral Image Restorationcited by 22
  34. 2023A dimension-reduced variational approach for solving physics-based inverse problems using generative adversarial network priors and normalizing flowscited by 12
  35. 2024Incorporating Degradation Estimation in Light Field Spatial Super-Resolutioncited by 12
  36. 2022Bayesian Image Super-Resolution with Deep Modeling of Image Statisticscited by 11
  37. 2020Super-Resolving Commercial Satellite Imagery Using Realistic Training Datacited by 6
  38. 2023Inverse problem regularization with hierarchical variational autoencoderscited by 6

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.