Deep Model-Based Architectures for Inverse Problems under Mismatched Priors
Not on the map. Why?
Abstract (arXiv)
There is a growing interest in deep model-based architectures (DMBAs) for solving imaging inverse problems by combining physical measurement models and learned image priors specified using convolutional neural nets (CNNs). For example, well-known frameworks for systematically designing DMBAs include plug-and-play priors (PnP), deep unfolding (DU), and deep equilibrium models (DEQ). While the empirical performance and theoretical properties of DMBAs have been widely investigated, the existing work in the area has primarily focused on their performance when the desired image prior is known exactly. This work addresses the gap in the prior work by providing new theoretical and numerical insights into DMBAs under mismatched CNN priors. Mismatched priors arise naturally when there is a distribution shift between training and testing data, for example, due to test images being from a different distribution than images used for training the CNN prior. They also arise when the CNN prior used for inference is an approximation of some desired statistical estimator (MAP or MMSE). Our theoretical analysis provides explicit error bounds on the solution due to the mismatched CNN priors under a set of clearly specified assumptions. Our numerical results compare the empirical performance of DMBAs under realistic distribution shifts and approximate statistical estimators.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 39 of its 83 references that are in the map. First posted on arXiv 26 Jul 2022.
Builds on
39 of 83 references.
References · 39
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
- 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,352
- 2019Deep Equilibrium Modelscited by 603
- 2019Algorithm Unrolling: Interpretable, Efficient Deep Learning for Signal and Image Processingcited by 411
- 2017Learning Deep CNN Denoiser Prior for Image Restorationcited by 407
- 2016The Little Engine that Could: Regularization by Denoising (RED)cited by 303
- 2020Deep Learning Techniques for Inverse Problems in Imagingcited by 290
- 2021Robust Compressed Sensing MRI with Deep Generative Priorscited by 284
- 2016Plug-and-Play ADMM for Image Restoration: Fixed Point Convergence and Applicationscited by 244
- 2019Plug-and-Play Methods Provably Converge with Properly Trained Denoiserscited by 197
- 2021Deep Equilibrium Architectures for Inverse Problems in Imagingcited by 126
27 more
- 2019Deep Plug-and-Play Super-Resolution for Arbitrary Blur Kernelscited by 112
- 2017Learning Proximal Operators: Using Denoising Networks for Regularizing Inverse Imaging Problemscited by 107
- 2021Gradient Step Denoiser for convergent Plug-and-Playcited by 107
- 2018Regularization by Denoising: Clarifications and New Interpretationscited by 102
- 2019DeepRED: Deep Image Prior Powered by REDcited by 84
- 2017A Review of Convolutional Neural Networks for Inverse Problems in Imagingcited by 81
- 2018Denoising Prior Driven Deep Neural Network for Image Restorationcited by 80
- 2015Plug-and-Play Priors for Bright Field Electron Tomography and Sparse Interpolationcited by 78
- 2019Plug and play methods for magnetic resonance imaging (long version)cited by 75
- 2018An Online Plug-and-Play Algorithm for Regularized Image Reconstructioncited by 70
- 2014From Denoising to Compressed Sensingcited by 67
- 2019RARE: Image Reconstruction using Deep Priors Learned without Ground Truthcited by 64
- 2017Plug-and-Play Unplugged: Optimization Free Reconstruction using Consensus Equilibriumcited by 58
- 2020Regularization by Denoising via Fixed-Point Projection (RED-PRO)cited by 55
- 2021Measuring Robustness in Deep Learning Based Compressive Sensingcited by 53
- 2020Scalable Plug-and-Play ADMM with Convergence Guaranteescited by 49
- 2018prDeep: Robust Phase Retrieval with a Flexible Deep Networkcited by 46
- 2021Instance-Optimal Compressed Sensing via Posterior Samplingcited by 43
- 2020Provable Convergence of Plug-and-Play Priors with MMSE denoiserscited by 39
- 2020Tuning-free Plug-and-Play Proximal Algorithm for Inverse Imaging Problemscited by 38
- 2022Test-Time Training Can Close the Natural Distribution Shift Performance Gap in Deep Learning Based Compressed Sensingcited by 37
- 2019Block Coordinate Regularization by Denoisingcited by 33
- 2021Recovery Analysis for Plug-and-Play Priors using the Restricted Eigenvalue Conditioncited by 22
- 2020Model Adaptation for Inverse Problems in Imagingcited by 20
- 2020A Fast Stochastic Plug-and-Play ADMM for Imaging Inverse Problemscited by 12
- 2018Regularized Fourier Ptychography using an Online Plug-and-Play Algorithmcited by 7
- 2020Joint Reconstruction and Calibration using Regularization by Denoisingcited by 5
Built on by
Citing papers per year: 2022: 1; 2023: 2; 2024: 2; 2025: 0; 2026: 3.
8 papers.
- 2023Frequency Disentangled Features in Neural Image Compressioncited by 14
- 2023Prior Mismatch and Adaptation in PnP-ADMM with a Nonconvex Convergence Analysiscited by 10
- 2022Robustness of Deep Equilibrium Architectures to Changes in the Measurement Modelcited by 4
- 2024Overcoming Distribution Shifts in Plug-and-Play Methods with Test-Time Trainingcited by 3
- 2024Robustness and Exploration of Variational and Machine Learning Approaches to Inverse Problems: An Overviewcited by 1
- 2026Lipschitz Multiscale Deep Equilibrium Models: A Theoretically Guaranteed and Accelerated Approachcited by 1
- 2026A New Convergence Analysis of Plug-and-Play Proximal Gradient Descent Under Prior Mismatchcited by 0
- 2026Domain Adaptation of Mismatched Proximal Denoiser for Plug-and-Play Image Reconstructioncited by 0
- 2026Domain Adaptation of Mismatched Proximal Denoiser for Plug-and-Play Image Reconstruction16 Jul 2026
- 2026Lipschitz Multiscale Deep Equilibrium Models: A Theoretically Guaranteed and Accelerated Approach3 Feb 2026
- 2026A New Convergence Analysis of Plug-and-Play Proximal Gradient Descent Under Prior Mismatch14 Jan 2026
- 2024Overcoming Distribution Shifts in Plug-and-Play Methods with Test-Time Training15 Mar 2024
- 2024Robustness and Exploration of Variational and Machine Learning Approaches to Inverse Problems: An Overview19 Feb 2024
- 2023Prior Mismatch and Adaptation in PnP-ADMM with a Nonconvex Convergence Analysis29 Sep 2023
- 2023Frequency Disentangled Features in Neural Image Compression4 Aug 2023
- 2022Robustness of Deep Equilibrium Architectures to Changes in the Measurement Model1 Nov 2022