mlsanityData to 7 Oct 2026

Invertible ResNets for Inverse Imaging Problems: Competitive Performance with Provable Regularization Properties

arXiv 2409.13482 ↗First posted 20 Sep 2024math.NA cs.LG cs.NAcited by 2

Not on the map. Why?

Abstract (arXiv)

Learning-based methods have demonstrated remarkable performance in solving inverse problems, particularly in image reconstruction tasks. Despite their success, these approaches often lack theoretical guarantees, which are crucial in sensitive applications such as medical imaging. Recent works by Arndt et al addressed this gap by analyzing a data-driven reconstruction method based on invertible residual networks (iResNets). They revealed that, under reasonable assumptions, this approach constitutes a convergent regularization scheme. However, the performance of the reconstruction method was only validated on academic toy problems and small-scale iResNet architectures. In this work, we address this gap by evaluating the performance of iResNets on two real-world imaging tasks: a linear blurring operator and a nonlinear diffusion operator. To do so, we compare the performance of iResNets against state-of-the-art neural networks, revealing their competitiveness at the expense of longer training times. Moreover, we numerically demonstrate the advantages of the iResNet's inherent stability and invertibility by showcasing increased robustness across various scenarios as well as interpretability of the learned operator, thereby reducing the black-box nature of the reconstruction scheme.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 23 of its 36 references that are in the map. First posted on arXiv 20 Sep 2024.

Builds on

23 of 36 references.

References · 23

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  2. 2013Intriguing properties of neural networkscited by 5,114
  3. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
  4. 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
  5. 2019Deep Equilibrium Modelscited by 603
  6. 2019Algorithm Unrolling: Interpretable, Efficient Deep Learning for Signal and Image Processingcited by 411
  7. 2018Invertible Residual Networkscited by 364
  8. 2018Regularisation of Neural Networks by Enforcing Lipschitz Continuitycited by 311
  9. 2019Plug-and-Play Methods Provably Converge with Properly Trained Denoiserscited by 197
  10. 2018Lipschitz-Margin Training: Scalable Certification of Perturbation Invariance for Deep Neural Networkscited by 193
  11. 2018Deep Neural Networks Motivated by Partial Differential Equationscited by 187
  12. 2021Deep Equilibrium Architectures for Inverse Problems in Imagingcited by 126
11 more
  1. 2021Gradient Step Denoiser for convergent Plug-and-Playcited by 107
  2. 2022Proximal Denoiser for Convergent Plug-and-Play Optimization with Nonconvex Regularizationcited by 79
  3. 2020Learned convex regularizers for inverse problemscited by 54
  4. 2022Learned reconstruction methods with convergence guaranteescited by 46
  5. 2020Convolutional Proximal Neural Networks and Plug-and-Play Algorithmscited by 36
  6. 2021CLIP: Cheap Lipschitz Training of Neural Networkscited by 29
  7. 2023Designing Stable Neural Networks using Convex Analysis and ODEscited by 10
  8. 2021Learning convex regularizers satisfying the variational source condition for inverse problemscited by 8
  9. 2022Proximal Residual Flows for Bayesian Inverse Problemscited by 5
  10. 2018Networks for Nonlinear Diffusion Problems in Imagingcited by 3
  11. 2023Convergence analysis of equilibrium methods for inverse problemscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.