End-to-end reconstruction meets data-driven regularization for inverse problems
Not on the map. Why?
Abstract (arXiv)
We propose an unsupervised approach for learning end-to-end reconstruction operators for ill-posed inverse problems. The proposed method combines the classical variational framework with iterative unrolling, which essentially seeks to minimize a weighted combination of the expected distortion in the measurement space and the Wasserstein-1 distance between the distributions of the reconstruction and ground-truth. More specifically, the regularizer in the variational setting is parametrized by a deep neural network and learned simultaneously with the unrolled reconstruction operator. The variational problem is then initialized with the reconstruction of the unrolled operator and solved iteratively till convergence. Notably, it takes significantly fewer iterations to converge, thanks to the excellent initialization obtained via the unrolled operator. The resulting approach combines the computational efficiency of end-to-end unrolled reconstruction with the well-posedness and noise-stability guarantees of the variational setting. Moreover, we demonstrate with the example of X-ray computed tomography (CT) that our approach outperforms state-of-the-art unsupervised methods, and that it outperforms or is on par with state-of-the-art supervised learned reconstruction approaches.
Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). Builds on 25 of its 49 references that are in the map. First posted on arXiv 7 Jun 2021.
Builds on
25 of 49 references.
References · 25
- 2017Deep Image Priorcited by 1,097
- 2018Computational Optimal Transportcited by 765
- 2016Deep Convolutional Neural Network for Inverse Problems in Imagingcited by 431
- 2019Algorithm Unrolling: Interpretable, Efficient Deep Learning for Signal and Image Processingcited by 411
- 2016The Little Engine that Could: Regularization by Denoising (RED)cited by 303
- 2020Deep Unfolding Network for Image Super-Resolutioncited by 253
- 2017Learned Primal-dual Reconstructioncited by 251
- 2016Plug-and-Play ADMM for Image Restoration: Fixed Point Convergence and Applicationscited by 244
- 2017Image reconstruction by domain transform manifold learningcited by 231
- 2019Plug-and-Play Methods Provably Converge with Properly Trained Denoiserscited by 197
- 2017Solving ill-posed inverse problems using iterative deep neural networkscited by 145
- 2017Learning Proximal Operators: Using Denoising Networks for Regularizing Inverse Imaging Problemscited by 107
13 more
- 2018Adversarial Regularizers in Inverse Problemscited by 102
- 2018Regularization by Denoising: Clarifications and New Interpretationscited by 102
- 2018NETT: Solving Inverse Problems with Deep Neural Networkscited by 89
- 2018An Online Plug-and-Play Algorithm for Regularized Image Reconstructioncited by 70
- 2019RARE: Image Reconstruction using Deep Priors Learned without Ground Truthcited by 64
- 2020Learning Maximally Monotone Operators for Image Recoverycited by 62
- 2020Learned convex regularizers for inverse problemscited by 54
- 2020Total Deep Variation for Linear Inverse Problemscited by 53
- 2020Unsupervised MRI Reconstruction with Generative Adversarial Networkscited by 24
- 2019SIMBA: Scalable Inversion in Optical Tomography using Deep Denoising Priorscited by 16
- 2019Wasserstein GANs for MR Imaging: from Paired to Unpaired Trainingcited by 14
- 2019Unsupervised Deep Basis Pursuit: Learning inverse problems without ground-truth datacited by 10
- 2019Self-supervised learning of inverse problem solvers in medical imagingcited by 8
Built on by
Citing papers per year: 2021: 3; 2022: 6; 2023: 9; 2024: 8; 2025: 5; 2026: 1.
32 papers.
Sort:
- 2022Learned reconstruction methods with convergence guaranteescited by 46
- 2023What's in a Prior? Learned Proximal Networks for Inverse Problemscited by 24
- 2022PatchNR: Learning from Very Few Images by Patch Normalizing Flow Regularizationcited by 22
- 2022Online Deep Equilibrium Learning for Regularization by Denoisingcited by 22
- 2021Deep Bayesian inference for seismic imaging with taskscited by 12
- 2024ASPIRE: Iterative Amortized Posterior Inference for Bayesian Inverse Problemscited by 11
- 2024QN-Mixer: A Quasi-Newton MLP-Mixer Model for Sparse-View CT Reconstructioncited by 6
- 2022CoRRECT: A Deep Unfolding Framework for Motion-Corrected Quantitative R2* Mappingcited by 5
- 2023Solving Low-Dose CT Reconstruction via GAN with Local Coherencecited by 5
- 2025Unsupervised Imaging Inverse Problems with Diffusion Distribution Matchingcited by 5
- 2021Stochastic Primal-Dual Deep Unrollingcited by 4
- 2023NF-ULA: Langevin Monte Carlo with Normalizing Flow Prior for Imaging Inverse Problemscited by 4
20 more
- 2023Provably Convergent Data-Driven Convex-Nonconvex Regularizationcited by 4
- 2023LCOT: Linear circular optimal transportcited by 4
- 2023Unsupervised approaches based on optimal transport and convex analysis for inverse problems in imagingcited by 4
- 2025Benchmarking Self-Supervised Learning Methods for Accelerated MRI Reconstructioncited by 4
- 2024Unsupervised Training of Convex Regularizers using Maximum Likelihood Estimationcited by 3
- 2024Neural Incremental Data Assimilationcited by 3
- 2024Swap-Net: A Memory-Efficient 2.5D Network for Sparse-View 3D Cone Beam CT Reconstructioncited by 3
- 2022Estimating a potential without the agony of the partition functioncited by 2
- 2022A new method for determining Wasserstein 1 optimal transport maps from Kantorovich potentials, with deep learning applicationscited by 2
- 2024A Lipschitz spaces view of infinitely wide shallow neural networkscited by 2
- 2021Trust the Critics: Generatorless and Multipurpose WGANs with Initial Convergence Guaranteescited by 1
- 2023Learned Interferometric Imaging for the SPIDER Instrumentcited by 1
- 2023Learned reconstruction methods for inverse problems: sample error estimatescited by 1
- 2024Robustness and Exploration of Variational and Machine Learning Approaches to Inverse Problems: An Overviewcited by 1
- 2024Debiasing Machine Learning Models by Using Weakly Supervised Learningcited by 1
- 2025Towards Prospective Medical Image Reconstruction via Knowledge-Informed Dynamic Optimal Transportcited by 1
- 2025An invertible generative model for forward and inverse problemscited by 1
- 2025Why the noise model matters: A performance gap in learned regularizationcited by 1
- 2023Learning end-to-end inversion of circular Radon transforms in the partial radial setupcited by 0
- 2026A Distributionally Robust Framework for Learned Reconstructions in Inverse Problemscited by 0
- 2026A Distributionally Robust Framework for Learned Reconstructions in Inverse Problems29 Jun 2026
- 2025Why the noise model matters: A performance gap in learned regularization14 Oct 2025
- 2025An invertible generative model for forward and inverse problems4 Sep 2025
- 2025Unsupervised Imaging Inverse Problems with Diffusion Distribution Matching17 Jun 2025
- 2025Towards Prospective Medical Image Reconstruction via Knowledge-Informed Dynamic Optimal Transport23 May 2025
- 2025Benchmarking Self-Supervised Learning Methods for Accelerated MRI Reconstruction19 Feb 2025
- 2024A Lipschitz spaces view of infinitely wide shallow neural networks18 Oct 2024
- 2024Swap-Net: A Memory-Efficient 2.5D Network for Sparse-View 3D Cone Beam CT Reconstruction29 Sep 2024
- 2024Neural Incremental Data Assimilation21 Jun 2024
- 2024ASPIRE: Iterative Amortized Posterior Inference for Bayesian Inverse Problems8 May 2024
- 2024Unsupervised Training of Convex Regularizers using Maximum Likelihood Estimation8 Apr 2024
- 2024QN-Mixer: A Quasi-Newton MLP-Mixer Model for Sparse-View CT Reconstruction28 Feb 2024
20 more
- 2024Debiasing Machine Learning Models by Using Weakly Supervised Learning23 Feb 2024
- 2024Robustness and Exploration of Variational and Machine Learning Approaches to Inverse Problems: An Overview19 Feb 2024
- 2023Learned reconstruction methods for inverse problems: sample error estimates21 Dec 2023
- 2023Unsupervised approaches based on optimal transport and convex analysis for inverse problems in imaging15 Nov 2023
- 2023What's in a Prior? Learned Proximal Networks for Inverse Problems22 Oct 2023
- 2023LCOT: Linear circular optimal transport9 Oct 2023
- 2023Provably Convergent Data-Driven Convex-Nonconvex Regularization9 Oct 2023
- 2023Solving Low-Dose CT Reconstruction via GAN with Local Coherence24 Sep 2023
- 2023Learning end-to-end inversion of circular Radon transforms in the partial radial setup27 Aug 2023
- 2023NF-ULA: Langevin Monte Carlo with Normalizing Flow Prior for Imaging Inverse Problems17 Apr 2023
- 2023Learned Interferometric Imaging for the SPIDER Instrument24 Jan 2023
- 2022A new method for determining Wasserstein 1 optimal transport maps from Kantorovich potentials, with deep learning applications2 Nov 2022
- 2022CoRRECT: A Deep Unfolding Framework for Motion-Corrected Quantitative R2* Mapping12 Oct 2022
- 2022Estimating a potential without the agony of the partition function19 Aug 2022
- 2022Learned reconstruction methods with convergence guarantees11 Jun 2022
- 2022Online Deep Equilibrium Learning for Regularization by Denoising25 May 2022
- 2022PatchNR: Learning from Very Few Images by Patch Normalizing Flow Regularization24 May 2022
- 2021Trust the Critics: Generatorless and Multipurpose WGANs with Initial Convergence Guarantees30 Nov 2021
- 2021Stochastic Primal-Dual Deep Unrolling19 Oct 2021
- 2021Deep Bayesian inference for seismic imaging with tasks10 Oct 2021
- 2022Learned reconstruction methods with convergence guaranteescited by 46
- 2023What's in a Prior? Learned Proximal Networks for Inverse Problemscited by 24
- 2022PatchNR: Learning from Very Few Images by Patch Normalizing Flow Regularizationcited by 22
- 2022Online Deep Equilibrium Learning for Regularization by Denoisingcited by 22
- 2021Deep Bayesian inference for seismic imaging with taskscited by 12
- 2024ASPIRE: Iterative Amortized Posterior Inference for Bayesian Inverse Problemscited by 11
- 2024QN-Mixer: A Quasi-Newton MLP-Mixer Model for Sparse-View CT Reconstructioncited by 6
- 2022CoRRECT: A Deep Unfolding Framework for Motion-Corrected Quantitative R2* Mappingcited by 5
- 2023Solving Low-Dose CT Reconstruction via GAN with Local Coherencecited by 5
- 2025Unsupervised Imaging Inverse Problems with Diffusion Distribution Matchingcited by 5
- 2021Stochastic Primal-Dual Deep Unrollingcited by 4
- 2023NF-ULA: Langevin Monte Carlo with Normalizing Flow Prior for Imaging Inverse Problemscited by 4
12 most cited of 32 All 32 (JSON)
- 2026A Distributionally Robust Framework for Learned Reconstructions in Inverse Problems29 Jun 2026
- 2025Why the noise model matters: A performance gap in learned regularization14 Oct 2025
- 2025An invertible generative model for forward and inverse problems4 Sep 2025
- 2025Unsupervised Imaging Inverse Problems with Diffusion Distribution Matching17 Jun 2025
- 2025Towards Prospective Medical Image Reconstruction via Knowledge-Informed Dynamic Optimal Transport23 May 2025
- 2025Benchmarking Self-Supervised Learning Methods for Accelerated MRI Reconstruction19 Feb 2025
- 2024A Lipschitz spaces view of infinitely wide shallow neural networks18 Oct 2024
- 2024Swap-Net: A Memory-Efficient 2.5D Network for Sparse-View 3D Cone Beam CT Reconstruction29 Sep 2024
- 2024Neural Incremental Data Assimilation21 Jun 2024
- 2024ASPIRE: Iterative Amortized Posterior Inference for Bayesian Inverse Problems8 May 2024
- 2024Unsupervised Training of Convex Regularizers using Maximum Likelihood Estimation8 Apr 2024
- 2024QN-Mixer: A Quasi-Newton MLP-Mixer Model for Sparse-View CT Reconstruction28 Feb 2024
12 newest of 32 All 32 (JSON)