mlsanityData to 7 Oct 2026

Iteratively Refined Image Reconstruction with Learned Attentive Regularizers

arXiv 2407.06608 ↗First posted 9 Jul 2024eess.IV cs.CV cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

We propose a regularization scheme for image reconstruction that leverages the power of deep learning while hinging on classic sparsity-promoting models. Many deep-learning-based models are hard to interpret and cumbersome to analyze theoretically. In contrast, our scheme is interpretable because it corresponds to the minimization of a series of convex problems. For each problem in the series, a mask is generated based on the previous solution to refine the regularization strength spatially. In this way, the model becomes progressively attentive to the image structure. For the underlying update operator, we prove the existence of a fixed point. As a special case, we investigate a mask generator for which the fixed-point iterations converge to a critical point of an explicit energy functional. In our experiments, we match the performance of state-of-the-art learned variational models for the solution of inverse problems. Additionally, we offer a promising balance between interpretability, theoretical guarantees, reliability, and performance.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 20 of its 49 references that are in the map. First posted on arXiv 9 Jul 2024.

Builds on

20 of 49 references.

References · 20

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2019Deep Equilibrium Modelscited by 603
  3. 2019On instabilities of deep learning in image reconstruction - Does AI come at a cost?cited by 211
  4. 2021Deep Equilibrium Architectures for Inverse Problems in Imagingcited by 126
  5. 2018Adversarial Regularizers in Inverse Problemscited by 102
  6. 2018NETT: Solving Inverse Problems with Deep Neural Networkscited by 89
  7. 2022Proximal Denoiser for Convergent Plug-and-Play Optimization with Nonconvex Regularizationcited by 79
  8. 2020Total Deep Variation for Linear Inverse Problemscited by 53
  9. 2022A Neural-Network-Based Convex Regularizer for Inverse Problemscited by 40
  10. 2022Path Independent Equilibrium Models Can Better Exploit Test-Time Computationcited by 33
  11. 2023Learning Weakly Convex Regularizers for Convergent Image-Reconstruction Algorithmscited by 30
  12. 2022Improving Lipschitz-Constrained Neural Networks by Learning Activation Functionscited by 23
8 more
  1. 2021Regularising Inverse Problems with Generative Machine Learning Modelscited by 22
  2. 2023Learning Regularization Parameter-Maps for Variational Image Reconstruction using Deep Neural Networks and Algorithm Unrollingcited by 14
  3. 2023Learning Sparse and Low-Rank Priors for Image Recovery via Iterative Reweighted Least Squares Minimizationcited by 10
  4. 2022Stability of Image-Reconstruction Algorithmscited by 7
  5. 2016Analytical aspects of spatially adapted total variation regularisationcited by 5
  6. 2024Stability of Data-Dependent Ridge-Regularization for Inverse Problemscited by 5
  7. 2016Learning optimal spatially-dependent regularization parameters in total variation image restorationcited by 4
  8. 2019Tangencies and Polynomial Optimizationcited by 2

Built on by

Cited by year

Citing papers per year: 2025: 3.

3 papers.