Data Poisoning Vulnerabilities Across Healthcare AI Architectures: A Security Threat Analysis
On the map: LLM safety and security → Backdoor and data poisoning attacks
Abstract (arXiv)
Healthcare AI systems face major vulnerabilities to data poisoning that current defenses and regulations cannot adequately address. We analyzed eight attack scenarios in four categories: architectural attacks on convolutional neural networks, large language models, and reinforcement learning agents; infrastructure attacks exploiting federated learning and medical documentation systems; critical resource allocation attacks affecting organ transplantation and crisis triage; and supply chain attacks targeting commercial foundation models. Our findings indicate that attackers with access to only 100-500 samples can compromise healthcare AI regardless of dataset size, often achieving over 60 percent success, with detection taking an estimated 6 to 12 months or sometimes not occurring at all. The distributed nature of healthcare infrastructure creates many entry points where insiders with routine access can launch attacks with limited technical skill. Privacy laws such as HIPAA and GDPR can unintentionally shield attackers by restricting the analyses needed for detection. Supply chain weaknesses allow a single compromised vendor to poison models across 50 to 200 institutions. The Medical Scribe Sybil scenario shows how coordinated fake patient visits can poison data through legitimate clinical workflows without requiring a system breach. Current regulations lack mandatory adversarial robustness testing, and federated learning can worsen risks by obscuring attribution. We recommend multilayer defenses including required adversarial testing, ensemble-based detection, privacy-preserving security mechanisms, and international coordination on AI security standards. We also question whether opaque black-box models are suitable for high-stakes clinical decisions, suggesting a shift toward interpretable systems with verifiable safety guarantees.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Backdoor and data poisoning attacks, one of 12 directions in LLM safety and security. Builds on 27 of its 52 references that are in the map. First posted on arXiv 14 Nov 2025.
Builds on
27 of 52 references.
Closest ancestors · 2
Same direction, newest first
- 2025Poisoning Attacks on LLMs Require a Near-constant Number of Poison Samples8 Oct
- 2024SleeperNets: Universal Backdoor Poisoning Attacks Against Reinforcement Learning Agents30 May
Other references · 25
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
- 2019Advances and Open Problems in Federated Learningcited by 3,046
- 2022Large Language Models Encode Clinical Knowledgecited by 1,830
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
- 2018Obfuscated Gradients Give a False Sense of Security: Circumventing Defenses to Adversarial Examplescited by 1,268
- 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,154
- 2018Byzantine-Robust Distributed Learning: Towards Optimal Statistical Ratescited by 711
13 more
- 2019Local Model Poisoning Attacks to Byzantine-Robust Federated Learningcited by 493
- 2018Analyzing Federated Learning through an Adversarial Lenscited by 351
- 2019Robust Aggregation for Federated Learningcited by 317
- 2023Towards Generalist Biomedical AIcited by 289
- 2023Poisoning Language Models During Instruction Tuningcited by 269
- 2021Reading Race: AI Recognises Patient's Racial Identity In Medical Imagescited by 156
- 2021Poisoning and Backdooring Contrastive Learningcited by 151
- 2023Universal Jailbreak Backdoors from Poisoned Human Feedbackcited by 128
- 2020Just How Toxic is Data Poisoning? A Unified Benchmark for Backdoor and Data Poisoning Attackscited by 116
- 2017Byzantine-Tolerant Machine Learningcited by 19
- 2024Persistent Backdoor Attacks in Continual Learningcited by 13
- 2025Leveraging Imperfection with MEDLEY A Multi-Model Approach Harnessing Bias in Medical AIcited by 4
- 2024Explainable Diagnosis Prediction through Neuro-Symbolic Integrationcited by 2
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026AEGIS: An Operational Infrastructure for Post-Market Governance of Adaptive Medical AI Under US and EU Regulationscited by 0
- 2026From Single Chatbots to Governed Agent Ecosystems: An Agentic AI Pattern Catalogue and Orchestration Framework for Mission-Critical Hospital Information Management Systemscited by 0
- 2026Fusing Spectral Signatures and Activation Clustering for Backdoor Detection in Healthcare Imaging Models: Method, Implementation, and Evaluationcited by 0
- 2026Fusing Spectral Signatures and Activation Clustering for Backdoor Detection in Healthcare Imaging Models: Method, Implementation, and Evaluation13 Sep 2026
- 2026From Single Chatbots to Governed Agent Ecosystems: An Agentic AI Pattern Catalogue and Orchestration Framework for Mission-Critical Hospital Information Management Systems7 Aug 2026
- 2026AEGIS: An Operational Infrastructure for Post-Market Governance of Adaptive Medical AI Under US and EU Regulations20 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025A Practical Framework for Evaluating Medical AI Security: Reproducible Assessment of Jailbreaking and Privacy Vulnerabilities Across Clinical Specialties
- 2026Caging the Agents: A Zero Trust Security Architecture for Autonomous AI in Healthcare
- 2025Towards Safe AI Clinicians: A Comprehensive Study on Large Language Model Jailbreaking in Healthcare
- 2025Medical Malice: A Dataset for Context-Aware Safety in Healthcare LLMs
- 2025Detecting and Preventing Data Poisoning Attacks on AI Models
- 2025Many-to-One Adversarial Consensus: Exposing Multi-Agent Collusion Risks in AI-Based Healthcare
- 2026Evaluating Frontier AI Agents as Autonomous Clinical Security Auditors
- 2021Machine Learning with Electronic Health Records is vulnerable to Backdoor Trigger Attacks