Blind Image Deconvolution using Deep Generative Priors
Not on the map. Why?
Abstract (arXiv)
This paper proposes a novel approach to regularize the textitill-posed and textitnon-linear blind image deconvolution (blind deblurring) using deep generative networks as priors. We employ two separate generative models --- one trained to produce sharp images while the other trained to generate blur kernels from lower-dimensional parameters. To deblur, we propose an alternating gradient descent scheme operating in the latent lower-dimensional space of each of the pretrained generative models. Our experiments show promising deblurring results on images even under large blurs, and heavy noise. To address the shortcomings of generative models such as mode collapse, we augment our generative priors with classical image priors and report improved performance on complex image datasets. The deblurring performance depends on how well the range of the generator spans the image class. Interestingly, our experiments show that even an untrained structured (convolutional) generative networks acts as an image prior in the image deblurring context allowing us to extend our results to more diverse natural image datasets.
Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Feb 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 9; 2023: 8; 2024: 6; 2025: 7; 2026: 1.
40 papers.
Sort:
By area:
- 2021Deblurring via Stochastic Refinementcited by 248
- 2023Generative Diffusion Prior for Unified Image Restoration and Enhancementcited by 198
- 2022Generative Modelling With Inverse Heat Dissipationcited by 164
- 2023Inversion by Direct Iteration: An Alternative to Denoising Diffusion for Image Restorationcited by 164
- 2021Early Stopping for Deep Image Priorcited by 44
- 2021Instance-Optimal Compressed Sensing via Posterior Samplingcited by 43
- 2022Spatially-Adaptive Multilayer Selection for GAN Inversion and Editingcited by 39
- 2023Explicitly Minimizing the Blur Error of Variational Autoencoderscited by 29
- 2021Regularising Inverse Problems with Generative Machine Learning Modelscited by 22
- 2021End-to-end Alternating Optimization for Blind Super Resolutioncited by 17
- 2023Manifold Learning by Mixture Models of VAEs for Inverse Problemscited by 16
- 2022TurbuGAN: An Adversarial Learning Approach to Spatially-Varying Multiframe Blind Deconvolution with Applications to Imaging Through Turbulencecited by 11
28 more
- 2022Blind Image Deblurring with Unknown Kernel Size and Substantial Noisecited by 10
- 2023Block Coordinate Plug-and-Play Methods for Blind Inverse Problemscited by 8
- 2022On Adversarial Robustness of Deep Image Deblurringcited by 7
- 2024Makeup-Guided Facial Privacy Protection via Untrained Neural Network Priorscited by 7
- 2025Integrating Intermediate Layer Optimization and Projected Gradient Descent for Solving Inverse Problems with Diffusion Modelscited by 7
- 2025First-Place Solution to NeurIPS 2024 Invisible Watermark Removal Challengecited by 7
- 2022Continuous Generative Neural Networks: A Wavelet-Based Architecture in Function Spacescited by 6
- 2022Optimization for Amortized Inverse Problemscited by 6
- 2023Leveraging Variational Autoencoders for Parameterized MMSE Estimationcited by 6
- 2022Blind Image Deconvolution Using Variational Deep Image Priorcited by 5
- 2023FLAIR: A Conditional Diffusion Framework with Applications to Face Video Restorationcited by 5
- 2021A Deep Variational Bayesian Framework for Blind Image Deblurringcited by 3
- 2022Training Adaptive Reconstruction Networks for Blind Inverse Problemscited by 3
- 2024Blind Image Deconvolution by Generative-based Kernel Prior and Initializer via Latent Encodingcited by 3
- 2024The Star Geometry of Critic-Based Regularizer Learningcited by 3
- 2021Wiener Guided DIP for Unsupervised Blind Image Deconvolutioncited by 2
- 2023A Comprehensive Survey on Deep Neural Image Deblurringcited by 2
- 2024Survey on Visual Signal Coding and Processing with Generative Models: Technologies, Standards and Optimizationcited by 2
- 2024Lightening Anything in Medical Imagescited by 2
- 2021SL-CycleGAN: Blind Motion Deblurring in Cycles using Sparse Learningcited by 1
- 2021Face Deblurring Based on Separable Normalization and Adaptive Denormalizationcited by 1
- 2025AstroClearNet: Deep image prior for multi-frame astronomical image restorationcited by 1
- 2025Estimating Dataset Dimension via Singular Metrics under the Manifold Hypothesis: Application to Inverse Problemscited by 1
- 2024Towards Lensless Image Deblurring with Prior-Embedded Implicit Neural Representations in the Low-Data Regimecited by 0
- 2025RELD: Regularization by Latent Diffusion Models for Image Restorationcited by 0
- 2025Generative Latent Kernel Modeling for Blind Motion Deblurringcited by 0
- 2025cryoSENSE: Compressive Sensing Enables High-throughput Microscopy with Sparse and Generative Priors on the Protein Cryo-EM Image Manifoldcited by 0
- 2026Feature-based Inversion of 2.5D Controlled Source Electromagnetic Data using Generative Priorscited by 0
- 2026Feature-based Inversion of 2.5D Controlled Source Electromagnetic Data using Generative Priors5 Jan 2026
- 2025cryoSENSE: Compressive Sensing Enables High-throughput Microscopy with Sparse and Generative Priors on the Protein Cryo-EM Image Manifold17 Nov 2025
- 2025First-Place Solution to NeurIPS 2024 Invisible Watermark Removal Challenge28 Aug 2025
- 2025Generative Latent Kernel Modeling for Blind Motion Deblurring12 Jul 2025
- 2025Estimating Dataset Dimension via Singular Metrics under the Manifold Hypothesis: Application to Inverse Problems9 Jul 2025
- 2025Integrating Intermediate Layer Optimization and Projected Gradient Descent for Solving Inverse Problems with Diffusion Models27 May 2025
- 2025AstroClearNet: Deep image prior for multi-frame astronomical image restoration8 Apr 2025
- 2025RELD: Regularization by Latent Diffusion Models for Image Restoration28 Mar 2025
- 2024Towards Lensless Image Deblurring with Prior-Embedded Implicit Neural Representations in the Low-Data Regime27 Nov 2024
- 2024The Star Geometry of Critic-Based Regularizer Learning29 Aug 2024
- 2024Makeup-Guided Facial Privacy Protection via Untrained Neural Network Priors20 Aug 2024
- 2024Blind Image Deconvolution by Generative-based Kernel Prior and Initializer via Latent Encoding20 Jul 2024
28 more
- 2024Lightening Anything in Medical Images1 Jun 2024
- 2024Survey on Visual Signal Coding and Processing with Generative Models: Technologies, Standards and Optimization23 May 2024
- 2023FLAIR: A Conditional Diffusion Framework with Applications to Face Video Restoration26 Nov 2023
- 2023A Comprehensive Survey on Deep Neural Image Deblurring7 Oct 2023
- 2023Leveraging Variational Autoencoders for Parameterized MMSE Estimation11 Jul 2023
- 2023Block Coordinate Plug-and-Play Methods for Blind Inverse Problems22 May 2023
- 2023Explicitly Minimizing the Blur Error of Variational Autoencoders12 Apr 2023
- 2023Generative Diffusion Prior for Unified Image Restoration and Enhancement3 Apr 2023
- 2023Manifold Learning by Mixture Models of VAEs for Inverse Problems27 Mar 2023
- 2023Inversion by Direct Iteration: An Alternative to Denoising Diffusion for Image Restoration20 Mar 2023
- 2022Optimization for Amortized Inverse Problems25 Oct 2022
- 2022On Adversarial Robustness of Deep Image Deblurring5 Oct 2022
- 2022Blind Image Deblurring with Unknown Kernel Size and Substantial Noise18 Aug 2022
- 2022Generative Modelling With Inverse Heat Dissipation21 Jun 2022
- 2022Spatially-Adaptive Multilayer Selection for GAN Inversion and Editing16 Jun 2022
- 2022Continuous Generative Neural Networks: A Wavelet-Based Architecture in Function Spaces29 May 2022
- 2022TurbuGAN: An Adversarial Learning Approach to Spatially-Varying Multiframe Blind Deconvolution with Applications to Imaging Through Turbulence13 Mar 2022
- 2022Training Adaptive Reconstruction Networks for Blind Inverse Problems23 Feb 2022
- 2022Blind Image Deconvolution Using Variational Deep Image Prior1 Feb 2022
- 2021Wiener Guided DIP for Unsupervised Blind Image Deconvolution19 Dec 2021
- 2021Face Deblurring Based on Separable Normalization and Adaptive Denormalization18 Dec 2021
- 2021Early Stopping for Deep Image Prior11 Dec 2021
- 2021Deblurring via Stochastic Refinement5 Dec 2021
- 2021SL-CycleGAN: Blind Motion Deblurring in Cycles using Sparse Learning7 Nov 2021
- 2021Regularising Inverse Problems with Generative Machine Learning Models22 Jul 2021
- 2021Instance-Optimal Compressed Sensing via Posterior Sampling21 Jun 2021
- 2021A Deep Variational Bayesian Framework for Blind Image Deblurring5 Jun 2021
- 2021End-to-end Alternating Optimization for Blind Super Resolution14 May 2021
- 2021Deblurring via Stochastic Refinementcited by 248
- 2023Generative Diffusion Prior for Unified Image Restoration and Enhancementcited by 198
- 2023Inversion by Direct Iteration: An Alternative to Denoising Diffusion for Image Restorationcited by 164
- 2025Integrating Intermediate Layer Optimization and Projected Gradient Descent for Solving Inverse Problems with Diffusion Modelscited by 7
- 2025RELD: Regularization by Latent Diffusion Models for Image Restorationcited by 0
- 2025cryoSENSE: Compressive Sensing Enables High-throughput Microscopy with Sparse and Generative Priors on the Protein Cryo-EM Image Manifoldcited by 0
- 2025cryoSENSE: Compressive Sensing Enables High-throughput Microscopy with Sparse and Generative Priors on the Protein Cryo-EM Image Manifold17 Nov 2025
- 2025Integrating Intermediate Layer Optimization and Projected Gradient Descent for Solving Inverse Problems with Diffusion Models27 May 2025
- 2025RELD: Regularization by Latent Diffusion Models for Image Restoration28 Mar 2025
- 2023Generative Diffusion Prior for Unified Image Restoration and Enhancement3 Apr 2023
- 2023Inversion by Direct Iteration: An Alternative to Denoising Diffusion for Image Restoration20 Mar 2023
- 2021Deblurring via Stochastic Refinement5 Dec 2021
- 2022Generative Modelling With Inverse Heat Dissipationcited by 164
- 2021Early Stopping for Deep Image Priorcited by 44
- 2021Instance-Optimal Compressed Sensing via Posterior Samplingcited by 43
- 2022Spatially-Adaptive Multilayer Selection for GAN Inversion and Editingcited by 39
- 2023Explicitly Minimizing the Blur Error of Variational Autoencoderscited by 29
- 2021Regularising Inverse Problems with Generative Machine Learning Modelscited by 22
- 2021End-to-end Alternating Optimization for Blind Super Resolutioncited by 17
- 2023Manifold Learning by Mixture Models of VAEs for Inverse Problemscited by 16
- 2022TurbuGAN: An Adversarial Learning Approach to Spatially-Varying Multiframe Blind Deconvolution with Applications to Imaging Through Turbulencecited by 11
- 2022Blind Image Deblurring with Unknown Kernel Size and Substantial Noisecited by 10
- 2023Block Coordinate Plug-and-Play Methods for Blind Inverse Problemscited by 8
- 2022On Adversarial Robustness of Deep Image Deblurringcited by 7
12 most cited of 34 All 34 (JSON)
- 2026Feature-based Inversion of 2.5D Controlled Source Electromagnetic Data using Generative Priors5 Jan 2026
- 2025First-Place Solution to NeurIPS 2024 Invisible Watermark Removal Challenge28 Aug 2025
- 2025Generative Latent Kernel Modeling for Blind Motion Deblurring12 Jul 2025
- 2025Estimating Dataset Dimension via Singular Metrics under the Manifold Hypothesis: Application to Inverse Problems9 Jul 2025
- 2025AstroClearNet: Deep image prior for multi-frame astronomical image restoration8 Apr 2025
- 2024Towards Lensless Image Deblurring with Prior-Embedded Implicit Neural Representations in the Low-Data Regime27 Nov 2024
- 2024The Star Geometry of Critic-Based Regularizer Learning29 Aug 2024
- 2024Makeup-Guided Facial Privacy Protection via Untrained Neural Network Priors20 Aug 2024
- 2024Blind Image Deconvolution by Generative-based Kernel Prior and Initializer via Latent Encoding20 Jul 2024
- 2024Lightening Anything in Medical Images1 Jun 2024
- 2024Survey on Visual Signal Coding and Processing with Generative Models: Technologies, Standards and Optimization23 May 2024
- 2023FLAIR: A Conditional Diffusion Framework with Applications to Face Video Restoration26 Nov 2023
12 newest of 34 All 34 (JSON)