Improving Robustness of Deep-Learning-Based Image Reconstruction
Not on the map. Why?
Abstract (arXiv)
Deep-learning-based methods for different applications have been shown vulnerable to adversarial examples. These examples make deployment of such models in safety-critical tasks questionable. Use of deep neural networks as inverse problem solvers has generated much excitement for medical imaging including CT and MRI, but recently a similar vulnerability has also been demonstrated for these tasks. We show that for such inverse problem solvers, one should analyze and study the effect of adversaries in the measurement-space, instead of the signal-space as in previous work. In this paper, we propose to modify the training strategy of end-to-end deep-learning-based inverse problem solvers to improve robustness. We introduce an auxiliary network to generate adversarial examples, which is used in a min-max formulation to build robust image reconstruction networks. Theoretically, we show for a linear reconstruction scheme the min-max formulation results in a singular-value(s) filter regularized solution, which suppresses the effect of adversarial examples occurring because of ill-conditioning in the measurement matrix. We find that a linear network using the proposed min-max learning scheme indeed converges to the same solution. In addition, for non-linear Compressed Sensing (CS) reconstruction using deep networks, we show significant improvement in robustness using the proposed approach over other methods. We complement the theory by experiments for CS on two different datasets and evaluate the effect of increasing perturbations on trained networks. We find the behavior for ill-conditioned and well-conditioned measurement matrices to be qualitatively different.
Key facts. Cited by 23 papers in the map (data through 14 Oct 2026). First posted on arXiv 26 Feb 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 3; 2023: 5; 2024: 4; 2025: 4.
23 papers.
Sort:
By area:
- 2021Deep Equilibrium Architectures for Inverse Problems in Imagingcited by 127
- 2021Can stable and accurate neural networks be computed? -- On the barriers of deep learning and Smale's 18th problemcited by 53
- 2022How to Robustify Black-Box ML Models? A Zeroth-Order Optimization Perspectivecited by 39
- 2021Center Smoothing: Certified Robustness for Networks with Structured Outputscited by 18
- 2023Survey on Adversarial Attack and Defense for Medical Image Analysis: Methods and Challengescited by 17
- 2021A review and experimental evaluation of deep learning methods for MRI reconstructioncited by 13
- 2022Reasons for the Superiority of Stochastic Estimators over Deterministic Ones: Robustness, Consistency and Perceptual Qualitycited by 13
- 2023Certified Zeroth-order Black-Box Defense with Robust UNet Denoisercited by 11
- 2023Learning Provably Robust Estimators for Inverse Problems via Jitteringcited by 8
- 2022On Adversarial Robustness of Deep Image Deblurringcited by 7
- 2024Glimpse: Generalized Locality for Scalable and Robust CTcited by 6
- 2021On Instabilities of Conventional Multi-Coil MRI Reconstruction to Small Adverserial Perturbationscited by 4
11 more
- 2021Subtle Data Crimes: Naively training machine learning algorithms could lead to overly-optimistic resultscited by 4
- 2023Data-iterative Optimization Score Model for Stable Ultra-Sparse-View CT Reconstructioncited by 3
- 2021Noise2Recon: Enabling Joint MRI Reconstruction and Denoising with Semi-Supervised and Self-Supervised Learningcited by 2
- 2024Do stable neural networks exist for classification problems? -- A new view on stability in AIcited by 2
- 2025How many measurements are enough? Bayesian recovery in inverse problems with general distributionscited by 2
- 2023Can Adversarial Examples Be Parsed to Reveal Victim Model Information?cited by 1
- 2024Evaluating Adversarial Robustness of Low dose CT Recoverycited by 1
- 2024Robustness and Exploration of Variational and Machine Learning Approaches to Inverse Problems: An Overviewcited by 1
- 2025Training-Free Adversarial Robustness in Computational MRIcited by 0
- 2025Hallucinations in medical devicescited by 0
- 2025Adversarial generalization of unfolding (model-based) networkscited by 0
- 2025Adversarial generalization of unfolding (model-based) networks18 Sep 2025
- 2025Hallucinations in medical devices18 Aug 2025
- 2025How many measurements are enough? Bayesian recovery in inverse problems with general distributions15 May 2025
- 2025Training-Free Adversarial Robustness in Computational MRI3 Jan 2025
- 2024Robustness and Exploration of Variational and Machine Learning Approaches to Inverse Problems: An Overview19 Feb 2024
- 2024Evaluating Adversarial Robustness of Low dose CT Recovery18 Feb 2024
- 2024Do stable neural networks exist for classification problems? -- A new view on stability in AI15 Jan 2024
- 2024Glimpse: Generalized Locality for Scalable and Robust CT1 Jan 2024
- 2023Data-iterative Optimization Score Model for Stable Ultra-Sparse-View CT Reconstruction28 Aug 2023
- 2023Learning Provably Robust Estimators for Inverse Problems via Jittering24 Jul 2023
- 2023Certified Zeroth-order Black-Box Defense with Robust UNet Denoiser13 Apr 2023
- 2023Survey on Adversarial Attack and Defense for Medical Image Analysis: Methods and Challenges24 Mar 2023
11 more
- 2023Can Adversarial Examples Be Parsed to Reveal Victim Model Information?13 Mar 2023
- 2022Reasons for the Superiority of Stochastic Estimators over Deterministic Ones: Robustness, Consistency and Perceptual Quality16 Nov 2022
- 2022On Adversarial Robustness of Deep Image Deblurring5 Oct 2022
- 2022How to Robustify Black-Box ML Models? A Zeroth-Order Optimization Perspective27 Mar 2022
- 2021Noise2Recon: Enabling Joint MRI Reconstruction and Denoising with Semi-Supervised and Self-Supervised Learning30 Sep 2021
- 2021A review and experimental evaluation of deep learning methods for MRI reconstruction17 Sep 2021
- 2021Subtle Data Crimes: Naively training machine learning algorithms could lead to overly-optimistic results16 Sep 2021
- 2021On Instabilities of Conventional Multi-Coil MRI Reconstruction to Small Adverserial Perturbations25 Feb 2021
- 2021Center Smoothing: Certified Robustness for Networks with Structured Outputs19 Feb 2021
- 2021Deep Equilibrium Architectures for Inverse Problems in Imaging16 Feb 2021
- 2021Can stable and accurate neural networks be computed? -- On the barriers of deep learning and Smale's 18th problem20 Jan 2021
- 2021Deep Equilibrium Architectures for Inverse Problems in Imagingcited by 127
- 2021Can stable and accurate neural networks be computed? -- On the barriers of deep learning and Smale's 18th problemcited by 53
- 2022How to Robustify Black-Box ML Models? A Zeroth-Order Optimization Perspectivecited by 39
- 2021Center Smoothing: Certified Robustness for Networks with Structured Outputscited by 18
- 2023Survey on Adversarial Attack and Defense for Medical Image Analysis: Methods and Challengescited by 17
- 2021A review and experimental evaluation of deep learning methods for MRI reconstructioncited by 13
- 2022Reasons for the Superiority of Stochastic Estimators over Deterministic Ones: Robustness, Consistency and Perceptual Qualitycited by 13
- 2023Certified Zeroth-order Black-Box Defense with Robust UNet Denoisercited by 11
- 2023Learning Provably Robust Estimators for Inverse Problems via Jitteringcited by 8
- 2022On Adversarial Robustness of Deep Image Deblurringcited by 7
- 2024Glimpse: Generalized Locality for Scalable and Robust CTcited by 6
- 2021On Instabilities of Conventional Multi-Coil MRI Reconstruction to Small Adverserial Perturbationscited by 4
12 most cited of 22 All 22 (JSON)
- 2025Adversarial generalization of unfolding (model-based) networks18 Sep 2025
- 2025Hallucinations in medical devices18 Aug 2025
- 2025How many measurements are enough? Bayesian recovery in inverse problems with general distributions15 May 2025
- 2025Training-Free Adversarial Robustness in Computational MRI3 Jan 2025
- 2024Robustness and Exploration of Variational and Machine Learning Approaches to Inverse Problems: An Overview19 Feb 2024
- 2024Evaluating Adversarial Robustness of Low dose CT Recovery18 Feb 2024
- 2024Do stable neural networks exist for classification problems? -- A new view on stability in AI15 Jan 2024
- 2024Glimpse: Generalized Locality for Scalable and Robust CT1 Jan 2024
- 2023Learning Provably Robust Estimators for Inverse Problems via Jittering24 Jul 2023
- 2023Certified Zeroth-order Black-Box Defense with Robust UNet Denoiser13 Apr 2023
- 2023Survey on Adversarial Attack and Defense for Medical Image Analysis: Methods and Challenges24 Mar 2023
- 2023Can Adversarial Examples Be Parsed to Reveal Victim Model Information?13 Mar 2023
12 newest of 22 All 22 (JSON)