Beyond Boundaries: A Comprehensive Survey of Transferable Attacks on AI Systems
On the map: LLM safety and security → Backdoor and data poisoning attacks
Abstract (arXiv)
As Artificial Intelligence (AI) systems increasingly underpin critical applications, from autonomous vehicles to biometric authentication, their vulnerability to transferable attacks presents a growing concern. These attacks, designed to generalize across instances, domains, models, tasks, modalities, or even hardware platforms, pose severe risks to security, privacy, and system integrity. This survey delivers the first comprehensive review of transferable attacks across seven major categories, including evasion, backdoor, data poisoning, model stealing, model inversion, membership inference, and side-channel attacks. We introduce a unified six-dimensional taxonomy: cross-instance, cross-domain, cross-modality, cross-model, cross-task, and cross-hardware, which systematically captures the diverse transfer pathways of adversarial strategies. Through this framework, we examine both the underlying mechanics and practical implications of transferable attacks on AI systems. Furthermore, we review cutting-edge methods for enhancing attack transferability, organized around data augmentation and optimization strategies. By consolidating fragmented research and identifying critical future directions, this work provides a foundational roadmap for understanding, evaluating, and defending against transferable threats in real-world AI systems.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Backdoor and data poisoning attacks, one of 12 directions in LLM safety and security. Builds on 174 of its 311 references that are in the map. First posted on arXiv 20 Nov 2023.
Builds on
174 of 311 references.
Closest ancestors · 11
Same direction, newest first
- 2023Backdoor Attacks and Countermeasures in Natural Language Processing Models: A Comprehensive Security Review12 Sep
- 2023A Comprehensive Overview of Backdoor Attacks in Large Language Models within Communication Networks28 Aug
- 2023NOTABLE: Transferable Backdoor Attacks Against Prompt-based NLP Models28 May
- 2023Backdoor Learning for NLP: Recent Advances, Challenges, and Future Research Directions14 Feb
- 2022A Survey on Backdoor Attack and Defense in Natural Language Processing22 Nov
- 2022PoisonedEncoder: Poisoning the Unlabeled Pre-training Data in Contrastive Learning13 May
- 2022Wild Patterns Reloaded: A Survey of Machine Learning Security against Training Data Poisoning4 May
- 2022Poisoning Attacks and Defenses on Artificial Intelligence: A Survey21 Feb
- 2021Mind the Style of Text! Adversarial and Backdoor Attacks Based on Text Style Transfer14 Oct
- 2021BadPre: Task-agnostic Backdoor Attacks to Pre-trained NLP Foundation Models6 Oct
- 2021BadEncoder: Backdoor Attacks to Pre-trained Encoders in Self-Supervised Learning1 Aug
Other references · 163
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2013Intriguing properties of neural networkscited by 5,155
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2016Pointer Sentinel Mixture Modelscited by 3,096
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,998
- 2016Membership Inference Attacks against Machine Learning Modelscited by 2,281
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
- 2016Adversarial examples in the physical worldcited by 1,769
- 2018Deep Clustering for Unsupervised Learning of Visual Featurescited by 1,028
- 2016Practical Black-Box Attacks against Machine Learningcited by 903
- 2021Membership Inference Attacks From First Principlescited by 878
- 2017Ensemble Adversarial Training: Attacks and Defensescited by 840
38 more
- 2016Universal adversarial perturbationscited by 784
- 2023A Watermark for Large Language Modelscited by 725
- 2019Universal Adversarial Triggers for Attacking and Analyzing NLPcited by 722
- 2015Distillation as a Defense to Adversarial Perturbations against Deep Neural Networkscited by 678
- 2016Stealing Machine Learning Models via Prediction APIscited by 619
- 2018Exploring the Limits of Weakly Supervised Pretrainingcited by 605
- 2018Improving Transferability of Adversarial Examples with Input Diversitycited by 599
- 2016Delving into Transferable Adversarial Examples and Black-box Attackscited by 536
- 2018Threat of Adversarial Attacks on Deep Learning in Computer Vision: A Surveycited by 460
- 2016Transferability in Machine Learning: from Phenomena to Black-Box Attacks using Adversarial Samplescited by 446
- 2019Evading Defenses to Transferable Adversarial Examples by Translation-Invariant Attackscited by 442
- 2020Backdoor Learning: A Surveycited by 426
- 2018Adversarial Attacks on Neural Networks for Graph Datacited by 397
- 2020Label-Only Membership Inference Attackscited by 388
- 2023A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPTcited by 368
- 2019Nesterov Accelerated Gradient and Scale Invariance for Adversarial Attackscited by 355
- 2020Reflection Backdoor: A Natural Backdoor Attack on Deep Neural Networkscited by 349
- 2021Membership Inference Attacks on Machine Learning: A Surveycited by 321
- 2023Are aligned neural networks adversarially aligned?cited by 315
- 2018Adversarial Attack on Graph Structured Datacited by 301
- 2018Knockoff Nets: Stealing Functionality of Black-Box Modelscited by 292
- 2018Adversarial Example Generation with Syntactically Controlled Paraphrase Networkscited by 286
- 2017MagNet: a Two-Pronged Defense against Adversarial Examplescited by 269
- 2020Transfer Learning in Deep Reinforcement Learning: A Surveycited by 265
- 2018Adversarial Attacks and Defences: A Surveycited by 259
- 2019The Secret Revealer: Generative Model-Inversion Attacks Against Deep Neural Networkscited by 246
- 2021Enhancing the Transferability of Adversarial Attacks through Variance Tuningcited by 244
- 2019Adversarial Attacks and Defenses in Images, Graphs and Text: A Reviewcited by 237
- 2019High Accuracy and High Fidelity Extraction of Neural Networkscited by 214
- 2020Reformulating Unsupervised Style Transfer as Paraphrase Generationcited by 183
- 2020Dataset Security for Machine Learning: Data Poisoning, Backdoor Attacks, and Defensescited by 180
- 2018Adversarial Attack and Defense on Graph Data: A Surveycited by 167
- 2020Skip Connections Matter: On the Transferability of Adversarial Examples Generated with ResNetscited by 167
- 2018Physical Adversarial Examples for Object Detectorscited by 163
- 2021Admix: Enhancing the Transferability of Adversarial Attackscited by 156
- 2019Making an Invisibility Cloak: Real World Adversarial Attacks on Object Detectorscited by 155
- 2017Generative Adversarial Perturbationscited by 153
- 2021Investigating Bi-Level Optimization for Learning and Vision from a Unified Perspective: A Survey and Beyondcited by 153
50 most cited of 163 All 163 (JSON)
Built on by
Citing papers per year: 2024: 1; 2025: 2; 2026: 3.
6 papers.
- 2024A Survey on Adversarial Robustness of LiDAR-based Machine Learning Perception in Autonomous Vehiclescited by 3
- 2026Generative Adversarial Perturbations with Cross-paradigm Transferability on Localized Crowd Countingcited by 1
- 2025Images in Motion?: A First Look into Video Leakage in Collaborative Deep Learningcited by 0
- 2025Can You Trust What You See? Alpha Channel No-Box Attacks on Video Object Detectioncited by 0
- 2026Devling into Adversarial Transferability on Image Classification: Review, Benchmark, and Evaluationcited by 0
- 2026Improving Adversarial Transferability on Vision-Language Pre-training Models via Surrogate-Specific Bias Correctioncited by 0
- 2026Improving Adversarial Transferability on Vision-Language Pre-training Models via Surrogate-Specific Bias Correction9 Jun 2026
- 2026Generative Adversarial Perturbations with Cross-paradigm Transferability on Localized Crowd Counting25 Mar 2026
- 2026Devling into Adversarial Transferability on Image Classification: Review, Benchmark, and Evaluation26 Feb 2026
- 2025Can You Trust What You See? Alpha Channel No-Box Attacks on Video Object Detection22 Oct 2025
- 2025Images in Motion?: A First Look into Video Leakage in Collaborative Deep Learning11 Sep 2025
- 2024A Survey on Adversarial Robustness of LiDAR-based Machine Learning Perception in Autonomous Vehicles21 Nov 2024
Similar, not cited
Close in wording, no citation either way
- 2025Catch-Only-One: Non-Transferable Examples for Model-Specific Authorization
- 2026AnchorRep: Defending LLMs Against Cross-Model Adversarial Transfer via Representation Repulsion
- 2025Offensive Security for AI Systems: Concepts, Practices, and Applications
- 2025Exploiting Edge Features for Transferable Adversarial Attacks in Distributed Machine Learning
- 2025Jailbreak Transferability Emerges from Shared Representations
- 2026AVISE: Framework for Evaluating the Security of AI Systems
- 2026Understanding Adversarial Transferability in Vision-Language Models for Autonomous Driving: A Cross-Architecture Analysis
- 2026Phantom Transfer: Data Poisoning can Survive Data-Level Defences