Deep priors for satellite image restoration with accurate uncertainties
Not on the map. Why?
Abstract (arXiv)
Satellite optical images, upon their on-ground receipt, offer a distorted view of the observed scene. Their restoration, including denoising, deblurring, and sometimes super-resolution, is required before their exploitation. Moreover, quantifying the uncertainties related to this restoration helps to reduce the risks of misinterpreting the image content. Deep learning methods are now state-of-the-art for satellite image restoration. Among them, direct inversion methods train a specific network for each sensor, and generally provide a point estimation of the restored image without the associated uncertainties. Alternatively, deep regularization (DR) methods learn a deep prior on target images before plugging it, as the regularization term, into a model-based optimization scheme. This allows for restoring images from several sensors with a single network and possibly for estimating associated uncertainties. In this paper, we introduce VBLE-xz, a DR method that solves the inverse problem in the latent space of a variational compressive autoencoder (CAE). We adapt the regularization strength by modulating the bitrate of the trained CAE with a training-free approach. Then, VBLE-xz estimates relevant uncertainties jointly in the latent and in the image spaces by sampling an explicit posterior estimated within variational inference. This enables fast posterior sampling, unlike state-of-the-art DR methods that use Markov chains or diffusion-based approaches. We conduct a comprehensive set of experiments on very high-resolution simulated and real Pl'eiades images, asserting the performance, robustness and scalability of the proposed method. They demonstrate that VBLE-xz represents a compelling alternative to direct inversion methods when uncertainty quantification is required. The code associated to this paper is available in https://github.com/MaudBqrd/VBLExz.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 56 of its 96 references that are in the map. First posted on arXiv 5 Dec 2024.
Builds on
56 of 96 references.
References · 56
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2022Generative Adversarial Networkscited by 5,603
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,539
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,375
- 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,352
- 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,250
38 more
- 2014NICE: Non-linear Independent Components Estimationcited by 1,052
- 2022Denoising Diffusion Restoration Modelscited by 951
- 2018Variational image compression with a scale hyperpriorcited by 910
- 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
- 2021Multi-Stage Progressive Image Restorationcited by 813
- 2018Residual Dense Network for Image Super-Resolutioncited by 796
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 792
- 2016End-to-end Optimized Image Compressioncited by 673
- 2018Joint Autoregressive and Hierarchical Priors for Learned Image Compressioncited by 642
- 2020Learned Image Compression with Discretized Gaussian Mixture Likelihoods and Attention Modulescited by 570
- 2020Plug-and-Play Image Restoration with Deep Denoiser Priorcited by 467
- 2017Learning Deep CNN Denoiser Prior for Image Restorationcited by 407
- 2017Compressed Sensing using Generative Modelscited by 337
- 2023Denoising Diffusion Models for Plug-and-Play Image Restorationcited by 335
- 2020CompressAI: a PyTorch library and evaluation platform for end-to-end compression researchcited by 271
- 2016Plug-and-Play ADMM for Image Restoration: Fixed Point Convergence and Applicationscited by 244
- 2019Deep Plug-and-Play Super-Resolution for Arbitrary Blur Kernelscited by 112
- 2021Gradient Step Denoiser for convergent Plug-and-Playcited by 107
- 2021Bayesian imaging using Plug & Play priors: when Langevin meets Tweediecited by 96
- 2023Refusion: Enabling Large-Size Realistic Image Restoration with Latent-Space Diffusion Modelscited by 86
- 2016Efficient Bayesian computation by proximal Markov chain Monte Carlo: when Langevin meets Moreaucited by 83
- 2021Intermediate Layer Optimization for Inverse Problems using Deep Generative Modelscited by 70
- 2020Simple and Effective VAE Training with Calibrated Decoderscited by 57
- 2021Variable-Rate Deep Image Compression through Spatially-Adaptive Feature Transformcited by 56
- 2019Variable Rate Deep Image Compression with Modulated Autoencodercited by 39
- 2021Trumpets: Injective Flows for Inference and Inverse Problemscited by 36
- 2018Structured Uncertainty Prediction Networkscited by 34
- 2018Modeling Sparse Deviations for Compressed Sensing using Generative Modelscited by 33
- 2020Bayesian Image Reconstruction using Deep Generative Modelscited by 29
- 2021Solving Inverse Problems by Joint Posterior Maximization with Autoencoding Priorcited by 24
- 2021Bayesian Imaging With Data-Driven Priors Encoded by Neural Networks: Theory, Methods, and Algorithmscited by 24
- 2021Regularising Inverse Problems with Generative Machine Learning Modelscited by 22
- 2022Deep Plug-and-Play Prior for Hyperspectral Image Restorationcited by 22
- 2023A dimension-reduced variational approach for solving physics-based inverse problems using generative adversarial network priors and normalizing flowscited by 12
- 2024Incorporating Degradation Estimation in Light Field Spatial Super-Resolutioncited by 12
- 2022Bayesian Image Super-Resolution with Deep Modeling of Image Statisticscited by 11
- 2020Super-Resolving Commercial Satellite Imagery Using Realistic Training Datacited by 6
- 2023Inverse problem regularization with hierarchical variational autoencoderscited by 6
50 most cited of 56 All 56 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.