mlsanityData to 7 Oct 2026

Provably Convergent Algorithms for Solving Inverse Problems Using Generative Models

arXiv 2105.06371 ↗First posted 13 May 2021cs.LG stat.MLcited by 1

Not on the map. Why?

Abstract (arXiv)

The traditional approach of hand-crafting priors (such as sparsity) for solving inverse problems is slowly being replaced by the use of richer learned priors (such as those modeled by deep generative networks). In this work, we study the algorithmic aspects of such a learning-based approach from a theoretical perspective. For certain generative network architectures, we establish a simple non-convex algorithmic approach that (a) theoretically enjoys linear convergence guarantees for certain linear and nonlinear inverse problems, and (b) empirically improves upon conventional techniques such as back-propagation. We support our claims with the experimental results for solving various inverse problems. We also propose an extension of our approach that can handle model mismatch (i.e., situations where the generative network prior is not exactly applicable). Together, our contributions serve as building blocks towards a principled use of generative models in inverse problems with more complete algorithmic understanding.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 38 of its 75 references that are in the map. First posted on arXiv 13 May 2021.

Builds on

38 of 75 references.

References · 38

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2014Deep Learning Face Attributes in the Wildcited by 3,679
  3. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
  4. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
  5. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
  6. 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,218
  7. 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 902
  8. 2016InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Netscited by 858
  9. 2017Wasserstein GANcited by 635
  10. 2016Generative Visual Manipulation on the Natural Image Manifoldcited by 348
  11. 2017Compressed Sensing using Generative Modelscited by 337
  12. 2017Optimizing the Latent Space of Generative Networkscited by 157
26 more
  1. 2016Semantic Image Inpainting with Deep Generative Modelscited by 156
  2. 2017Non-convex Optimization for Machine Learningcited by 132
  3. 2014Phase Retrieval via Wirtinger Flow: Theory and Algorithmscited by 123
  4. 2017BEGAN: Boundary Equilibrium Generative Adversarial Networkscited by 121
  5. 2016Energy-based Generative Adversarial Networkcited by 119
  6. 2016Neural Photo Editing with Introspective Adversarial Networkscited by 109
  7. 2018Phase Retrieval Under a Generative Priorcited by 73
  8. 2017One Network to Solve Them All --- Solving Linear Inverse Problems using Deep Projection Modelscited by 67
  9. 2013Phase Retrieval using Alternating Minimizationcited by 58
  10. 2018Solving Linear Inverse Problems Using GAN Priors: An Algorithm with Provable Guaranteescited by 58
  11. 2018Compressed Sensing with Deep Image Prior and Learned Regularizationcited by 47
  12. 2017Lensless computational imaging through deep learningcited by 44
  13. 2015A Deep Learning Approach to Structured Signal Recoverycited by 43
  14. 2017Global Guarantees for Enforcing Deep Generative Priors by Empirical Riskcited by 37
  15. 2018Modeling Sparse Deviations for Compressed Sensing using Generative Modelscited by 33
  16. 2019Inverting Deep Generative models, One layer at a timecited by 33
  17. 2019Algorithmic Guarantees for Inverse Imaging with Untrained Network Priorscited by 32
  18. 2013Phase Retrieval from Coded Diffraction Patternscited by 26
  19. 2016PhaseMax: Convex Phase Retrieval via Basis Pursuitcited by 25
  20. 2017Learning to Invert: Signal Recovery via Deep Convolutional Networkscited by 22
  21. 2019Alternating Phase Projected Gradient Descent with Generative Priors for Solving Compressive Phase Retrievalcited by 18
  22. 2018Algorithmic Aspects of Inverse Problems Using Generative Modelscited by 8
  23. 2016Fast Algorithms for Demixing Sparse Signals from Nonlinear Observationscited by 4
  24. 2015Toward Long Distance, Sub-diffraction Imaging Using Coherent Camera Arrayscited by 3
  25. 2015Efficient Compressive Phase Retrieval with Constrained Sensing Vectorscited by 2
  26. 2019GAN-based Projector for Faster Recovery with Convergence Guarantees in Linear Inverse Problemscited by 2

Built on by

Cited by year

Citing papers per year: 2023: 1.

1 paper.