Jekyll: Attacking Medical Image Diagnostics using Deep Generative Models
Not on the map. Why?
Abstract (arXiv)
Advances in deep neural networks (DNNs) have shown tremendous promise in the medical domain. However, the deep learning tools that are helping the domain, can also be used against it. Given the prevalence of fraud in the healthcare domain, it is important to consider the adversarial use of DNNs in manipulating sensitive data that is crucial to patient healthcare. In this work, we present the design and implementation of a DNN-based image translation attack on biomedical imagery. More specifically, we propose Jekyll, a neural style transfer framework that takes as input a biomedical image of a patient and translates it to a new image that indicates an attacker-chosen disease condition. The potential for fraudulent claims based on such generated 'fake' medical images is significant, and we demonstrate successful attacks on both X-rays and retinal fundus image modalities. We show that these attacks manage to mislead both medical professionals and algorithmic detection schemes. Lastly, we also investigate defensive measures based on machine learning to detect images generated by Jekyll.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 40 of its 85 references that are in the map. First posted on arXiv 5 Apr 2021.
Builds on
40 of 85 references.
References · 40
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
- 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
- 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
- 2017Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discoverycited by 566
- 2017CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learningcited by 459
- 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
28 more
- 2016Generating Videos with Scene Dynamicscited by 376
- 2017Adversarial Examples: Attacks and Defenses for Deep Learningcited by 350
- 2017Deep Models Under the GAN: Information Leakage from Collaborative Deep Learningcited by 326
- 2018Generative Adversarial Network in Medical Imaging: A Reviewcited by 257
- 2018GAN-based Synthetic Medical Image Augmentation for increased CNN Performance in Liver Lesion Classificationcited by 242
- 2018Pros and Cons of GAN Evaluation Measurescited by 224
- 2018The Malicious Use of Artificial Intelligence: Forecasting, Prevention, and Mitigationcited by 159
- 2018Medical Image Synthesis for Data Augmentation and Anonymization using Generative Adversarial Networkscited by 146
- 2018Synthetic Data Augmentation using GAN for Improved Liver Lesion Classificationcited by 136
- 2016Deep Learning for Identifying Metastatic Breast Cancercited by 93
- 2013Multi-digit Number Recognition from Street View Imagery using Deep Convolutional Neural Networkscited by 84
- 2018CommanderSong: A Systematic Approach for Practical Adversarial Voice Recognitioncited by 63
- 2017SegAN: Adversarial Network with Multi-scale L1 Loss for Medical Image Segmentationcited by 49
- 2017Visual Feature Attribution using Wasserstein GANscited by 47
- 2018CT-Realistic Lung Nodule Simulation from 3D Conditional Generative Adversarial Networks for Robust Lung Segmentationcited by 34
- 2019CT-GAN: Malicious Tampering of 3D Medical Imagery using Deep Learningcited by 31
- 2019Deep Learning in Alzheimer's disease: Diagnostic Classification and Prognostic Prediction using Neuroimaging Datacited by 30
- 2018Identification of Deep Network Generated Images Using Disparities in Color Componentscited by 18
- 2017Retinal Vessel Segmentation in Fundoscopic Images with Generative Adversarial Networkscited by 17
- 2017Automatic Liver Segmentation Using an Adversarial Image-to-Image Networkcited by 17
- 2017Synthetic Iris Presentation Attack using iDCGANcited by 17
- 2017Towards Adversarial Retinal Image Synthesiscited by 13
- 2017Automated Crowdturfing Attacks and Defenses in Online Review Systemscited by 12
- 2018DeepCorr: Strong Flow Correlation Attacks on Tor Using Deep Learningcited by 8
- 2019Automated email Generation for Targeted Attacks using Natural Languagecited by 8
- 2017Adversarial training and dilated convolutions for brain MRI segmentationcited by 6
- 2018Stay On-Topic: Generating Context-specific Fake Restaurant Reviewscited by 4
- 2015RAPTOR: Routing Attacks on Privacy in Torcited by 3
Built on by
Citing papers per year: 2022: 3; 2023: 4; 2024: 2; 2025: 1.
10 papers.
- 2023Learning from data with structured missingnesscited by 24
- 2023The Age of Synthetic Realities: Challenges and Opportunitiescited by 15
- 2023M3Dsynth: A dataset of medical 3D images with AI-generated local manipulationscited by 11
- 2022Private and Reliable Neural Network Inferencecited by 6
- 2022Toward Robust Diagnosis: A Contour Attention Preserving Adversarial Defense for COVID-19 Detectioncited by 3
- 2023Adversarial Medical Image with Hierarchical Feature Hidingcited by 3
- 2024Systematically Assessing the Security Risks of AI/ML-enabled Connected Healthcare Systemscited by 2
- 2024SoK: Security and Privacy Risks of Healthcare AIcited by 2
- 2022AutoMO-Mixer: An automated multi-objective Mixer model for balanced, safe and robust prediction in medicinecited by 1
- 2025Systems-Theoretic and Data-Driven Security Analysis in ML-enabled Medical Devicescited by 0
- 2025Systems-Theoretic and Data-Driven Security Analysis in ML-enabled Medical Devices18 Jun 2025
- 2024SoK: Security and Privacy Risks of Healthcare AI11 Sep 2024
- 2024Systematically Assessing the Security Risks of AI/ML-enabled Connected Healthcare Systems30 Jan 2024
- 2023Adversarial Medical Image with Hierarchical Feature Hiding4 Dec 2023
- 2023M3Dsynth: A dataset of medical 3D images with AI-generated local manipulations14 Sep 2023
- 2023The Age of Synthetic Realities: Challenges and Opportunities9 Jun 2023
- 2023Learning from data with structured missingness4 Apr 2023
- 2022Toward Robust Diagnosis: A Contour Attention Preserving Adversarial Defense for COVID-19 Detection30 Nov 2022
- 2022Private and Reliable Neural Network Inference27 Oct 2022
- 2022AutoMO-Mixer: An automated multi-objective Mixer model for balanced, safe and robust prediction in medicine4 Mar 2022