Total Deep Variation for Linear Inverse Problems
Not on the map. Why?
Abstract (arXiv)
Diverse inverse problems in imaging can be cast as variational problems composed of a task-specific data fidelity term and a regularization term. In this paper, we propose a novel learnable general-purpose regularizer exploiting recent architectural design patterns from deep learning. We cast the learning problem as a discrete sampled optimal control problem, for which we derive the adjoint state equations and an optimality condition. By exploiting the variational structure of our approach, we perform a sensitivity analysis with respect to the learned parameters obtained from different training datasets. Moreover, we carry out a nonlinear eigenfunction analysis, which reveals interesting properties of the learned regularizer. We show state-of-the-art performance for classical image restoration and medical image reconstruction problems.
Key facts. Cited by 53 papers in the map (data through 14 Oct 2026). First posted on arXiv 14 Jan 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 15; 2022: 13; 2023: 8; 2024: 8; 2025: 5; 2026: 4.
53 papers.
Sort:
- 2021Bayesian imaging using Plug & Play priors: when Langevin meets Tweediecited by 97
- 2022A Neural-Network-Based Convex Regularizer for Inverse Problemscited by 41
- 2021End-to-end reconstruction meets data-driven regularization for inverse problemscited by 32
- 2023Learning Weakly Convex Regularizers for Convergent Image-Reconstruction Algorithmscited by 31
- 2021Bayesian Uncertainty Estimation of Learned Variational MRI Reconstructioncited by 30
- 2021Learning the optimal Tikhonov regularizer for inverse problemscited by 26
- 2023What's in a Prior? Learned Proximal Networks for Inverse Problemscited by 25
- 2021Bayesian Imaging With Data-Driven Priors Encoded by Neural Networks: Theory, Methods, and Algorithmscited by 24
- 2021Generalized Normalizing Flows via Markov Chainscited by 23
- 2022PatchNR: Learning from Very Few Images by Patch Normalizing Flow Regularizationcited by 22
- 2022Stable Deep MRI Reconstruction using Generative Priorscited by 21
- 2025Learning Regularization Functionals for Inverse Problems: A Comparative Studycited by 15
38 more
- 2024Weakly Convex Regularisers for Inverse Problems: Convergence of Critical Points and Primal-Dual Optimisationcited by 14
- 2021Coupling Model-Driven and Data-Driven Methods for Remote Sensing Image Restoration and Fusioncited by 11
- 2021Connections between Numerical Algorithms for PDEs and Neural Networkscited by 10
- 2022WPPNets and WPPFlows: The Power of Wasserstein Patch Priors for Superresolutioncited by 10
- 2023Uncertainty Estimation and Propagation in Accelerated MRI Reconstructioncited by 10
- 2022Computed Tomography Reconstruction using Generative Energy-Based Priorscited by 9
- 2021Learning convex regularizers satisfying the variational source condition for inverse problemscited by 8
- 2022PnP-ReG: Learned Regularizing Gradient for Plug-and-Play Gradient Descentcited by 7
- 2024QN-Mixer: A Quasi-Newton MLP-Mixer Model for Sparse-View CT Reconstructioncited by 6
- 2025Diffusion at Absolute Zero: Langevin Sampling Using Successive Moreau Envelopes [conference paper]cited by 6
- 2021Adversarially learned iterative reconstruction for imaging inverse problemscited by 5
- 2022Deep unfolding as iterative regularization for imaging inverse problemscited by 5
- 2022Convergent Data-driven Regularizations for CT Reconstructioncited by 5
- 2023Solving Low-Dose CT Reconstruction via GAN with Local Coherencecited by 5
- 2024Stability of Data-Dependent Ridge-Regularization for Inverse Problemscited by 5
- 2025Good Things Come in Pairs: Paired Autoencoders for Inverse Problemscited by 5
- 2022Fixed-Point Automatic Differentiation of Forward--Backward Splitting Algorithms for Partly Smooth Functionscited by 4
- 2023Provably Convergent Data-Driven Convex-Nonconvex Regularizationcited by 4
- 2021Designing Rotationally Invariant Neural Networks from PDEs and Variational Methodscited by 3
- 2022Learning Variational Models with Unrolling and Bilevel Optimizationcited by 3
- 2024Unsupervised Training of Convex Regularizers using Maximum Likelihood Estimationcited by 3
- 2024Iteratively Refined Image Reconstruction with Learned Attentive Regularizerscited by 3
- 2024The Star Geometry of Critic-Based Regularizer Learningcited by 3
- 2024A primal-dual algorithm for image reconstruction with input-convex neural network regularizerscited by 3
- 2021CDLNet: Noise-Adaptive Convolutional Dictionary Learning Network for Blind Denoising and Demosaicingcited by 2
- 2025Multivariate Fields of Experts for Convergent Image Reconstructioncited by 2
- 2021Deep learning based dictionary learning and tomographic image reconstructioncited by 1
- 2021Supervised learning of analysis-sparsity priors with automatic differentiationcited by 1
- 2022Multimodal learning-based inversion models for the space-time reconstruction of satellite-derived geophysical fieldscited by 1
- 2022Gabor is Enough: Interpretable Deep Denoising with a Gabor Synthesis Dictionary Priorcited by 1
- 2023Learned Interferometric Imaging for the SPIDER Instrumentcited by 1
- 2023Learned reconstruction methods for inverse problems: sample error estimatescited by 1
- 2024Robustness and Exploration of Variational and Machine Learning Approaches to Inverse Problems: An Overviewcited by 1
- 2025Learning Binary Sampling Patterns for Single-Pixel Imaging using Bilevel Optimisationcited by 1
- 2026On the Generalization Behavior of Deep Residual Networks From a Dynamical System Perspectivecited by 1
- 2026Weakly Convex Ridge Regularization for 3D Non-Cartesian MRI Reconstructioncited by 1
- 2021Accelerated First Order Methods for Variational Imagingcited by 0
- 2022Explainable bilevel optimization: an application to the Helsinki deblur challengecited by 0
50 most cited of 53 All 53 (JSON)
- 2026A Distributionally Robust Framework for Learned Reconstructions in Inverse Problems29 Jun 2026
- 2026Semantic Segmentation for Histopathology using Learned Regularization based on Global Proportions27 Apr 2026
- 2026Weakly Convex Ridge Regularization for 3D Non-Cartesian MRI Reconstruction28 Mar 2026
- 2026On the Generalization Behavior of Deep Residual Networks From a Dynamical System Perspective24 Feb 2026
- 2025Learning Regularization Functionals for Inverse Problems: A Comparative Study2 Oct 2025
- 2025Learning Binary Sampling Patterns for Single-Pixel Imaging using Bilevel Optimisation26 Aug 2025
- 2025Multivariate Fields of Experts for Convergent Image Reconstruction8 Aug 2025
- 2025Good Things Come in Pairs: Paired Autoencoders for Inverse Problems10 May 2025
- 2025Diffusion at Absolute Zero: Langevin Sampling Using Successive Moreau Envelopes [conference paper]3 Feb 2025
- 2024A primal-dual algorithm for image reconstruction with input-convex neural network regularizers16 Oct 2024
- 2024The Star Geometry of Critic-Based Regularizer Learning29 Aug 2024
- 2024Iteratively Refined Image Reconstruction with Learned Attentive Regularizers9 Jul 2024
38 more
- 2024Stability of Data-Dependent Ridge-Regularization for Inverse Problems18 Jun 2024
- 2024Unsupervised Training of Convex Regularizers using Maximum Likelihood Estimation8 Apr 2024
- 2024QN-Mixer: A Quasi-Newton MLP-Mixer Model for Sparse-View CT Reconstruction28 Feb 2024
- 2024Robustness and Exploration of Variational and Machine Learning Approaches to Inverse Problems: An Overview19 Feb 2024
- 2024Weakly Convex Regularisers for Inverse Problems: Convergence of Critical Points and Primal-Dual Optimisation1 Feb 2024
- 2023Learned reconstruction methods for inverse problems: sample error estimates21 Dec 2023
- 2023What's in a Prior? Learned Proximal Networks for Inverse Problems22 Oct 2023
- 2023Provably Convergent Data-Driven Convex-Nonconvex Regularization9 Oct 2023
- 2023Solving Low-Dose CT Reconstruction via GAN with Local Coherence24 Sep 2023
- 2023Neural Gradient Regularizer31 Aug 2023
- 2023Learning Weakly Convex Regularizers for Convergent Image-Reconstruction Algorithms21 Aug 2023
- 2023Uncertainty Estimation and Propagation in Accelerated MRI Reconstruction4 Aug 2023
- 2023Learned Interferometric Imaging for the SPIDER Instrument24 Jan 2023
- 2022Convergent Data-driven Regularizations for CT Reconstruction14 Dec 2022
- 2022Deep unfolding as iterative regularization for imaging inverse problems24 Nov 2022
- 2022A Neural-Network-Based Convex Regularizer for Inverse Problems22 Nov 2022
- 2022Stable Deep MRI Reconstruction using Generative Priors25 Oct 2022
- 2022Explainable bilevel optimization: an application to the Helsinki deblur challenge18 Oct 2022
- 2022Learning Variational Models with Unrolling and Bilevel Optimization26 Sep 2022
- 2022Fixed-Point Automatic Differentiation of Forward--Backward Splitting Algorithms for Partly Smooth Functions5 Aug 2022
- 2022PatchNR: Learning from Very Few Images by Patch Normalizing Flow Regularization24 May 2022
- 2022PnP-ReG: Learned Regularizing Gradient for Plug-and-Play Gradient Descent29 Apr 2022
- 2022Gabor is Enough: Interpretable Deep Denoising with a Gabor Synthesis Dictionary Prior23 Apr 2022
- 2022Computed Tomography Reconstruction using Generative Energy-Based Priors23 Mar 2022
- 2022Multimodal learning-based inversion models for the space-time reconstruction of satellite-derived geophysical fields20 Mar 2022
- 2022WPPNets and WPPFlows: The Power of Wasserstein Patch Priors for Superresolution20 Jan 2022
- 2021Supervised learning of analysis-sparsity priors with automatic differentiation15 Dec 2021
- 2021CDLNet: Noise-Adaptive Convolutional Dictionary Learning Network for Blind Denoising and Demosaicing2 Dec 2021
- 2021Generalized Normalizing Flows via Markov Chains24 Nov 2021
- 2021Learning convex regularizers satisfying the variational source condition for inverse problems24 Oct 2021
- 2021Accelerated First Order Methods for Variational Imaging6 Oct 2021
- 2021Designing Rotationally Invariant Neural Networks from PDEs and Variational Methods31 Aug 2021
- 2021Deep learning based dictionary learning and tomographic image reconstruction26 Aug 2021
- 2021Coupling Model-Driven and Data-Driven Methods for Remote Sensing Image Restoration and Fusion13 Aug 2021
- 2021Connections between Numerical Algorithms for PDEs and Neural Networks30 Jul 2021
- 2021Learning the optimal Tikhonov regularizer for inverse problems11 Jun 2021
- 2021End-to-end reconstruction meets data-driven regularization for inverse problems7 Jun 2021
- 2021Adversarially learned iterative reconstruction for imaging inverse problems30 Mar 2021
50 newest of 53 All 53 (JSON)
- 2021Bayesian imaging using Plug & Play priors: when Langevin meets Tweediecited by 97
- 2022A Neural-Network-Based Convex Regularizer for Inverse Problemscited by 41
- 2021End-to-end reconstruction meets data-driven regularization for inverse problemscited by 32
- 2023Learning Weakly Convex Regularizers for Convergent Image-Reconstruction Algorithmscited by 31
- 2021Bayesian Uncertainty Estimation of Learned Variational MRI Reconstructioncited by 30
- 2021Learning the optimal Tikhonov regularizer for inverse problemscited by 26
- 2023What's in a Prior? Learned Proximal Networks for Inverse Problemscited by 25
- 2021Bayesian Imaging With Data-Driven Priors Encoded by Neural Networks: Theory, Methods, and Algorithmscited by 24
- 2021Generalized Normalizing Flows via Markov Chainscited by 23
- 2022PatchNR: Learning from Very Few Images by Patch Normalizing Flow Regularizationcited by 22
- 2022Stable Deep MRI Reconstruction using Generative Priorscited by 21
- 2025Learning Regularization Functionals for Inverse Problems: A Comparative Studycited by 15
12 most cited of 53 All 53 (JSON)
- 2026A Distributionally Robust Framework for Learned Reconstructions in Inverse Problems29 Jun 2026
- 2026Semantic Segmentation for Histopathology using Learned Regularization based on Global Proportions27 Apr 2026
- 2026Weakly Convex Ridge Regularization for 3D Non-Cartesian MRI Reconstruction28 Mar 2026
- 2026On the Generalization Behavior of Deep Residual Networks From a Dynamical System Perspective24 Feb 2026
- 2025Learning Regularization Functionals for Inverse Problems: A Comparative Study2 Oct 2025
- 2025Learning Binary Sampling Patterns for Single-Pixel Imaging using Bilevel Optimisation26 Aug 2025
- 2025Multivariate Fields of Experts for Convergent Image Reconstruction8 Aug 2025
- 2025Good Things Come in Pairs: Paired Autoencoders for Inverse Problems10 May 2025
- 2025Diffusion at Absolute Zero: Langevin Sampling Using Successive Moreau Envelopes [conference paper]3 Feb 2025
- 2024A primal-dual algorithm for image reconstruction with input-convex neural network regularizers16 Oct 2024
- 2024The Star Geometry of Critic-Based Regularizer Learning29 Aug 2024
- 2024Iteratively Refined Image Reconstruction with Learned Attentive Regularizers9 Jul 2024
12 newest of 53 All 53 (JSON)