Understanding Adversarial Attacks on Deep Learning Based Medical Image Analysis Systems
Not on the map. Why?
Abstract (arXiv)
Deep neural networks (DNNs) have become popular for medical image analysis tasks like cancer diagnosis and lesion detection. However, a recent study demonstrates that medical deep learning systems can be compromised by carefully-engineered adversarial examples/attacks with small imperceptible perturbations. This raises safety concerns about the deployment of these systems in clinical settings. In this paper, we provide a deeper understanding of adversarial examples in the context of medical images. We find that medical DNN models can be more vulnerable to adversarial attacks compared to models for natural images, according to two different viewpoints. Surprisingly, we also find that medical adversarial attacks can be easily detected, i.e., simple detectors can achieve over 98% detection AUC against state-of-the-art attacks, due to fundamental feature differences compared to normal examples. We believe these findings may be a useful basis to approach the design of more explainable and secure medical deep learning systems.
Key facts. Cited by 151 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Jul 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 34; 2022: 37; 2023: 22; 2024: 26; 2025: 26; 2026: 6.
151 papers.
Sort:
By area:
- 2021Neural Attention Distillation: Erasing Backdoor Triggers from Deep Neural Networkscited by 313
- 2022Transformers in Medical Imaging: A Surveycited by 245
- 2021VT-ADL: A Vision Transformer Network for Image Anomaly Detection and Localizationcited by 222
- 2021Unlearnable Examples: Making Personal Data Unexploitablecited by 188
- 2023Sociotechnical Safety Evaluation of Generative AI Systemscited by 154
- 2021Revisiting Adversarial Robustness Distillation: Robust Soft Labels Make Student Bettercited by 77
- 2021Improving Adversarial Robustness via Channel-wise Activation Suppressingcited by 76
- 2021When Does Contrastive Learning Preserve Adversarial Robustness from Pretraining to Finetuning?cited by 76
- 2021Exploring Architectural Ingredients of Adversarially Robust Deep Neural Networkscited by 73
- 2022Trustworthy clinical AI solutions: a unified review of uncertainty quantification in deep learning models for medical image analysiscited by 62
- 2023CFA: Class-wise Calibrated Fair Adversarial Trainingcited by 53
- 2024Explainable Artificial Intelligence: A Survey of Needs, Techniques, Applications, and Future Directioncited by 46
38 more
- 2022Self-Ensemble Adversarial Training for Improved Robustnesscited by 38
- 2022DCSAU-Net: A Deeper and More Compact Split-Attention U-Net for Medical Image Segmentationcited by 37
- 2022Towards Understanding and Boosting Adversarial Transferability from a Distribution Perspectivecited by 36
- 2022SAFE: Sensitivity-Aware Features for Out-of-Distribution Object Detectioncited by 33
- 2022The Many Faces of Adversarial Riskcited by 28
- 2022A Survey of Adversarial Defences and Robustness in NLPcited by 22
- 2021Removing Adversarial Noise in Class Activation Feature Spacecited by 18
- 2023Survey on Adversarial Attack and Defense for Medical Image Analysis: Methods and Challengescited by 16
- 2023Adversarial Examples Are Not Real Featurescited by 16
- 2021Towards Evaluating the Robustness of Deep Diagnostic Models by Adversarial Attackcited by 15
- 2021Explainable Deep Learning in Healthcare: A Methodological Survey from an Attribution Viewcited by 15
- 2021Towards Robust General Medical Image Segmentationcited by 14
- 2023Sharpness-Aware Minimization Alone can Improve Adversarial Robustnesscited by 14
- 2022Improving Adversarial Robustness via Mutual Information Estimationcited by 13
- 2024The Effect of Intrinsic Dataset Properties on Generalization: Unraveling Learning Differences Between Natural and Medical Imagescited by 13
- 2021Fooling Adversarial Training with Inducing Noisecited by 12
- 2021ℓ_∞-Robustness and Beyond: Unleashing Efficient Adversarial Trainingcited by 11
- 2022Improving Adversarial Robustness by Putting More Regularizations on Less Robust Samplescited by 11
- 2021Stabilized Medical Image Attackscited by 10
- 2021When and How to Fool Explainable Models (and Humans) with Adversarial Examplescited by 10
- 2024Game-Theoretic Defenses for Robust Conformal Prediction Against Adversarial Attacks in Medical Imagingcited by 10
- 2021MixACM: Mixup-Based Robustness Transfer via Distillation of Activated Channel Mapscited by 9
- 2021MedRDF: A Robust and Retrain-Less Diagnostic Framework for Medical Pretrained Models Against Adversarial Attackcited by 9
- 2022Adversarial Robustness through the Lens of Convolutional Filterscited by 9
- 2022Adversarial Coreset Selection for Efficient Robust Trainingcited by 9
- 2023It Is All About Data: A Survey on the Effects of Data on Adversarial Robustnesscited by 9
- 2021What Do Deep Nets Learn? Class-wise Patterns Revealed in the Input Spacecited by 8
- 2021Modeling Adversarial Noise for Adversarial Trainingcited by 8
- 2022VisCUIT: Visual Auditor for Bias in CNN Image Classifiercited by 8
- 2022Deep Learning for Medical Image Registration: A Comprehensive Reviewcited by 8
- 2022Explainable, Domain-Adaptive, and Federated Artificial Intelligence in Medicinecited by 8
- 2023Exploring adversarial attacks in federated learning for medical imagingcited by 8
- 2024Enhancing Adversarial Robustness of Vision-Language Models through Low-Rank Adaptationcited by 8
- 2021Adversarial Attacks and Defenses in Physiological Computing: A Systematic Reviewcited by 7
- 2021Attack-agnostic Adversarial Detection on Medical Data Using Explainable Machine Learningcited by 7
- 2021Now You See It, Now You Dont: Adversarial Vulnerabilities in Computational Pathologycited by 7
- 2022Understanding the Vulnerability of Skeleton-based Human Activity Recognition via Black-box Attackcited by 7
- 2024AdvQDet: Detecting Query-Based Adversarial Attacks with Adversarial Contrastive Prompt Tuningcited by 7
50 most cited of 151 All 151 (JSON)
- 2026Text-Guided Diffusion-Based Adversarial Attacks on Chest X-Ray Images29 Aug 2026
- 2026Stain-Aware Wavelet Regularization for Instant Adversarial Purification in Histopathology7 Jun 2026
- 2026RRISE: Robust Radius Inference via a Surrogate Estimator1 Jun 2026
- 2026Robust and Explainable Divide-and-Conquer Learning for Intrusion Detection3 May 2026
- 2026Beyond Attack Success Rate: A Multi-Metric Evaluation of Adversarial Transferability in Medical Imaging Models16 Apr 2026
- 2026A Unified Perspective on Adversarial Membership Manipulation in Vision Models3 Apr 2026
- 2025Sample-wise Adaptive Weighting for Transfer Consistency in Adversarial Distillation11 Dec 2025
- 2025Enhancing Adversarial Transferability through Block Stretch and Shrink21 Nov 2025
- 2025Layer-wise Noise Guided Selective Wavelet Reconstruction for Robust Medical Image Segmentation20 Nov 2025
- 2025When to Trust the Answer: Question-Aligned Semantic Nearest Neighbor Entropy for Safer Surgical VQA3 Nov 2025
- 2025T-MLA: A targeted multiscale log-exponential attack framework for neural image compression2 Nov 2025
- 2025SecureLearn -- An Attack-agnostic Defense for Multiclass Machine Learning Against Data Poisoning Attacks25 Oct 2025
38 more
- 2025Adversarially-Aware Architecture Design for Robust Medical AI Systems23 Oct 2025
- 2025Towards Strong Certified Defense with Universal Asymmetric Randomization22 Oct 2025
- 2025FERD: Fairness-Enhanced Data-Free Robustness Distillation25 Sep 2025
- 2025CIARD: Cyclic Iterative Adversarial Robustness Distillation16 Sep 2025
- 2025Adversarial Attacks on Reinforcement Learning-based Medical Questionnaire Systems: Input-level Perturbation Strategies and Medical Constraint Validation5 Aug 2025
- 2025TRIX- Trading Adversarial Fairness via Mixed Adversarial Training10 Jul 2025
- 2025Are Vision Transformer Representations Semantically Meaningful? A Case Study in Medical Imaging2 Jul 2025
- 2025Robust Training with Data Augmentation for Medical Imaging Classification20 Jun 2025
- 2025Systems-Theoretic and Data-Driven Security Analysis in ML-enabled Medical Devices18 Jun 2025
- 2025ProARD: progressive adversarial robustness distillation: provide wide range of robust students9 Jun 2025
- 2025Adversarial Robustness Analysis of Vision-Language Models in Medical Image Segmentation5 May 2025
- 2025Rethinking Target Label Conditioning in Adversarial Attacks: A 2D Tensor-Guided Generative Approach19 Apr 2025
- 2025Beyond the Generative Learning Trilemma: Generative Model Assessment in Data Scarcity Domains14 Apr 2025
- 2025Are clinicians ethically obligated to disclose their use of medical machine learning systems to patients?31 Mar 2025
- 2025Defending Against Gradient Inversion Attacks for Biomedical Images via Learnable Data Perturbation19 Mar 2025
- 2025MMARD: Improving the Min-Max Optimization Process in Adversarial Robustness Distillation9 Mar 2025
- 2025Long-tailed Adversarial Training with Self-Distillation9 Mar 2025
- 2025Weakly Supervised Pixel-Level Annotation with Visual Interpretability25 Feb 2025
- 2025PAR-AdvGAN: Improving Adversarial Attack Capability with Progressive Auto-Regression AdvGAN16 Feb 2025
- 2025Towards Fair Class-wise Robustness: Class Optimal Distribution Adversarial Training8 Jan 2025
- 2024Prompt2Perturb (P2P): Text-Guided Diffusion-Based Adversarial Attacks on Breast Ultrasound Images13 Dec 2024
- 2024Game-Theoretic Defenses for Robust Conformal Prediction Against Adversarial Attacks in Medical Imaging7 Nov 2024
- 2024FAIR-TAT: Improving Model Fairness Using Targeted Adversarial Training30 Oct 2024
- 2024CausAdv: A Causal-based Framework for Detecting Adversarial Examples29 Oct 2024
- 2024SoK: Security and Privacy Risks of Healthcare AI11 Sep 2024
- 2024Deep Learning Techniques for Hand Vein Biometrics: A Comprehensive Review11 Sep 2024
- 2024Dynamic Guidance Adversarial Distillation with Enhanced Teacher Knowledge3 Sep 2024
- 2024Explainable Artificial Intelligence: A Survey of Needs, Techniques, Applications, and Future Direction30 Aug 2024
- 2024Improving Clean Accuracy via a Tangent-Space Perspective on Adversarial Training27 Aug 2024
- 2024AdvQDet: Detecting Query-Based Adversarial Attacks with Adversarial Contrastive Prompt Tuning4 Aug 2024
- 2024Securing the Diagnosis of Medical Imaging: An In-depth Analysis of AI-Resistant Attacks1 Aug 2024
- 2024Adversarial Robustness in RGB-Skeleton Action Recognition: Leveraging Attention Modality Reweighter29 Jul 2024
- 2024S-E Pipeline: A Vision Transformer (ViT) based Resilient Classification Pipeline for Medical Imaging Against Adversarial Attacks23 Jul 2024
- 2024Federated Adversarial Learning for Robust Autonomous Landing Runway Detection22 Jun 2024
- 2024CF-OPT: Counterfactual Explanations for Structured Prediction28 May 2024
- 2024Robust width: A lightweight and certifiable adversarial defense24 May 2024
- 2024Enhancing Adversarial Robustness of Vision-Language Models through Low-Rank Adaptation20 Apr 2024
- 2024AED-PADA:Improving Generalizability of Adversarial Example Detection via Principal Adversarial Domain Adaptation19 Apr 2024
50 newest of 151 All 151 (JSON)
- 2021Neural Attention Distillation: Erasing Backdoor Triggers from Deep Neural Networkscited by 313
- 2022Transformers in Medical Imaging: A Surveycited by 245
- 2021VT-ADL: A Vision Transformer Network for Image Anomaly Detection and Localizationcited by 222
- 2021Unlearnable Examples: Making Personal Data Unexploitablecited by 188
- 2023Sociotechnical Safety Evaluation of Generative AI Systemscited by 154
- 2021Revisiting Adversarial Robustness Distillation: Robust Soft Labels Make Student Bettercited by 77
- 2021Improving Adversarial Robustness via Channel-wise Activation Suppressingcited by 76
- 2021When Does Contrastive Learning Preserve Adversarial Robustness from Pretraining to Finetuning?cited by 76
- 2021Exploring Architectural Ingredients of Adversarially Robust Deep Neural Networkscited by 73
- 2022Trustworthy clinical AI solutions: a unified review of uncertainty quantification in deep learning models for medical image analysiscited by 62
- 2023CFA: Class-wise Calibrated Fair Adversarial Trainingcited by 53
- 2024Explainable Artificial Intelligence: A Survey of Needs, Techniques, Applications, and Future Directioncited by 46
12 most cited of 144 All 144 (JSON)
- 2026Stain-Aware Wavelet Regularization for Instant Adversarial Purification in Histopathology7 Jun 2026
- 2026RRISE: Robust Radius Inference via a Surrogate Estimator1 Jun 2026
- 2026Robust and Explainable Divide-and-Conquer Learning for Intrusion Detection3 May 2026
- 2026Beyond Attack Success Rate: A Multi-Metric Evaluation of Adversarial Transferability in Medical Imaging Models16 Apr 2026
- 2025Sample-wise Adaptive Weighting for Transfer Consistency in Adversarial Distillation11 Dec 2025
- 2025Enhancing Adversarial Transferability through Block Stretch and Shrink21 Nov 2025
- 2025Layer-wise Noise Guided Selective Wavelet Reconstruction for Robust Medical Image Segmentation20 Nov 2025
- 2025When to Trust the Answer: Question-Aligned Semantic Nearest Neighbor Entropy for Safer Surgical VQA3 Nov 2025
- 2025T-MLA: A targeted multiscale log-exponential attack framework for neural image compression2 Nov 2025
- 2025Adversarially-Aware Architecture Design for Robust Medical AI Systems23 Oct 2025
- 2025Towards Strong Certified Defense with Universal Asymmetric Randomization22 Oct 2025
- 2025FERD: Fairness-Enhanced Data-Free Robustness Distillation25 Sep 2025
12 newest of 144 All 144 (JSON)