The Space of Transferable Adversarial Examples
Not on the map. Why?
Abstract (arXiv)
Adversarial examples are maliciously perturbed inputs designed to mislead machine learning (ML) models at test-time. They often transfer: the same adversarial example fools more than one model. In this work, we propose novel methods for estimating the previously unknown dimensionality of the space of adversarial inputs. We find that adversarial examples span a contiguous subspace of large (~25) dimensionality. Adversarial subspaces with higher dimensionality are more likely to intersect. We find that for two different models, a significant fraction of their subspaces is shared, thus enabling transferability. In the first quantitative analysis of the similarity of different models' decision boundaries, we show that these boundaries are actually close in arbitrary directions, whether adversarial or benign. We conclude by formally studying the limits of transferability. We derive (1) sufficient conditions on the data distribution that imply transferability for simple model classes and (2) examples of scenarios in which transfer does not occur. These findings indicate that it may be possible to design defenses against transfer-based attacks, even for models that are vulnerable to direct attacks.
Key facts. Cited by 158 papers in the map (data through 14 Oct 2026). First posted on arXiv 11 Apr 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 48; 2022: 35; 2023: 33; 2024: 17; 2025: 18; 2026: 7.
158 papers.
Sort:
By area:
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2021Recent Advances in Adversarial Training for Adversarial Robustnesscited by 279
- 2021Partial success in closing the gap between human and machine visioncited by 185
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2021SoK: How Robust is Image Classification Deep Neural Network Watermarking? (Extended Version)cited by 69
- 2023How Deep Learning Sees the World: A Survey on Adversarial Attacks & Defensescited by 66
- 2022Fingerprinting Deep Neural Networks Globally via Universal Adversarial Perturbationscited by 61
- 2022Towards Data-Free Model Stealing in a Hard Label Settingcited by 58
- 2024An Image Is Worth 1000 Lies: Adversarial Transferability across Prompts on Vision-Language Modelscited by 45
- 2022LGV: Boosting Adversarial Example Transferability from Large Geometric Vicinitycited by 39
- 2021TRS: Transferability Reduced Ensemble via Encouraging Gradient Diversity and Model Smoothnesscited by 38
- 2021Trivial or impossible -- dichotomous data difficulty masks model differences (on ImageNet and beyond)cited by 35
38 more
- 2021GradDiv: Adversarial Robustness of Randomized Neural Networks via Gradient Diversity Regularizationcited by 34
- 2022Marksman Backdoor: Backdoor Attacks with Arbitrary Target Classcited by 33
- 2021Attacking Adversarial Attacks as A Defensecited by 32
- 2021Detecting Adversarial Examples from Sensitivity Inconsistency of Spatial-Transform Domaincited by 29
- 2021Reliably fast adversarial training via latent adversarial perturbationcited by 29
- 2023Generalizable Black-Box Adversarial Attack with Meta Learningcited by 29
- 2021BASAR:Black-box Attack on Skeletal Action Recognitioncited by 26
- 2023Differentially Private Attention Computationcited by 25
- 2021Understanding the Robustness of Skeleton-based Action Recognition under Adversarial Attackcited by 24
- 2021ANCER: Anisotropic Certification via Sample-wise Volume Maximizationcited by 23
- 2024Adversarial Attacks of Vision Tasks in the Past 10 Years: A Surveycited by 23
- 2021Mixed Nash Equilibria in the Adversarial Examples Gamecited by 22
- 2021Closer Look at the Transferability of Adversarial Examples: How They Fool Different Models Differentlycited by 22
- 2025X-Transfer Attacks: Towards Super Transferable Adversarial Attacks on CLIPcited by 21
- 2021Exploring Robustness of Unsupervised Domain Adaptation in Semantic Segmentationcited by 20
- 2023A Survey of Robustness and Safety of 2D and 3D Deep Learning Models Against Adversarial Attackscited by 19
- 2022REAP: A Large-Scale Realistic Adversarial Patch Benchmarkcited by 18
- 2021Adversarial Robustness in Multi-Task Learning: Promises and Illusionscited by 17
- 2021Mutual Adversarial Training: Learning together is better than going alonecited by 17
- 2021Security and Privacy for Artificial Intelligence: Opportunities and Challengescited by 16
- 2022Existence and Minimax Theorems for Adversarial Surrogate Risks in Binary Classificationcited by 15
- 2023A LLM Assisted Exploitation of AI-Guardiancited by 15
- 2022Foiling Explanations in Deep Neural Networkscited by 14
- 2022Minimizing Maximum Model Discrepancy for Transferable Black-box Targeted Attackscited by 14
- 2021On the Robustness of Domain Constraintscited by 11
- 2022D4: Detection of Adversarial Diffusion Deepfakes Using Disjoint Ensemblescited by 11
- 2021Adversarial Attack Framework on Graph Embedding Models with Limited Knowledgecited by 10
- 2022AS2T: Arbitrary Source-To-Target Adversarial Attack on Speaker Recognition Systemscited by 10
- 2023Attacking Perceptual Similarity Metricscited by 10
- 2024Hard-label based Small Query Black-box Adversarial Attackcited by 10
- 2024Medical MLLM is Vulnerable: Cross-Modality Jailbreak and Mismatched Attacks on Medical Multimodal Large Language Modelscited by 10
- 2021Nonlinear Projection Based Gradient Estimation for Query Efficient Blackbox Attackscited by 9
- 2021Fairness Properties of Face Recognition and Obfuscation Systemscited by 9
- 2021Demystifying the Transferability of Adversarial Attacks in Computer Networkscited by 9
- 2022On the Role of Generalization in Transferability of Adversarial Examplescited by 9
- 2022How many perturbations break this model? Evaluating robustness beyond adversarial accuracycited by 9
- 2021Progressive-Scale Boundary Blackbox Attack via Projective Gradient Estimationcited by 8
- 2021Adversarial Transfer Attacks With Unknown Data and Class Overlapcited by 8
50 most cited of 158 All 158 (JSON)
- 2026Adversarial Training Without Input Gradients via Low-Rank Householder Expansions27 Aug 2026
- 2026Reasoning as a Double-Edged Sword: Architecture and Cross-Stage Robustness in Vision-Language-Action Models20 Jul 2026
- 2026Toward Understanding Adversarial Distillation: Why Robust Teachers Fail21 May 2026
- 2026VectorSmuggle: Steganographic Exfiltration in Embedding Stores and a Cryptographic Provenance Defense13 May 2026
- 2026Almost for Free: Crafting Adversarial Examples with Convolutional Image Filters1 May 2026
- 2026Removing the Trigger, Not the Backdoor: Alternative Triggers and Latent Backdoors10 Mar 2026
- 2026The Unseen Threat: Residual Knowledge in Machine Unlearning under Perturbed Samples29 Jan 2026
- 2025Sample-wise Adaptive Weighting for Transfer Consistency in Adversarial Distillation11 Dec 2025
- 2025Angular Gradient Sign Method: Uncovering Vulnerabilities in Hyperbolic Networks17 Nov 2025
- 2025Quantifying the Risk of Transferred Black Box Attacks7 Nov 2025
- 2025Toward Understanding the Transferability of Adversarial Suffixes in Large Language Models24 Oct 2025
- 2025Test-Time Defense Against Adversarial Attacks via Stochastic Resonance of Latent Ensembles3 Oct 2025
38 more
- 2025Understanding Adversarial Transfer: Why Representation-Space Attacks Fail Where Data-Space Attacks Succeed1 Oct 2025
- 2025Merge Now, Regret Later: The Hidden Cost of Model Merging Is Adversarial Transferability28 Sep 2025
- 2025SEGA: A Transferable Signed Ensemble Gaussian Black-Box Attack against No-Reference Image Quality Assessment Models23 Sep 2025
- 2025TriQDef: Disrupting Semantic and Gradient Alignment to Prevent Adversarial Patch Transferability in Quantized Neural Networks16 Aug 2025
- 2025SAM Encoder Breach by Adversarial Simplicial Complex Triggers Downstream Model Failures8 Aug 2025
- 2025Doppelganger Method: Breaking Role Consistency in LLM Agent via Prompt-based Transferable Adversarial Attack17 Jun 2025
- 2025Privacy Leaks by Adversaries: Adversarial Iterations for Membership Inference Attack3 Jun 2025
- 2025Demystifying Adversarial Robustness in Diffusion Models: Compression, Randomness, and Geometry28 May 2025
- 2025X-Transfer Attacks: Towards Super Transferable Adversarial Attacks on CLIP8 May 2025
- 2025Narrowing Class-Wise Robustness Gaps in Adversarial Training20 Mar 2025
- 2025LISArD: Learning Image Similarity to Defend Against Gray-box Adversarial Attacks27 Feb 2025
- 2025Improving Adversarial Transferability in MLLMs via Dynamic Vision-Language Alignment Attack27 Feb 2025
- 2025Information-Geometric Inverse Distillation for Enhancing Adversarial Transferability24 Feb 2025
- 2024RobustBlack: Challenging Black-Box Adversarial Attacks on State-of-the-Art Defenses30 Dec 2024
- 2024Traversing the Subspace of Adversarial Patches2 Dec 2024
- 2024Adversarial Attacks of Vision Tasks in the Past 10 Years: A Survey31 Oct 2024
- 2024Understanding Model Ensemble in Transferable Adversarial Attack9 Oct 2024
- 2024Toward Improving Synthetic Audio Spoofing Detection Robustness via Meta-Learning and Disentangled Training With Adversarial Examples23 Aug 2024
- 2024Towards Physical World Backdoor Attacks against Skeleton Action Recognition16 Aug 2024
- 2024On the Robustness of Malware Detectors to Adversarial Samples5 Aug 2024
- 2024Label Augmentation for Neural Networks Robustness4 Aug 2024
- 2024SemiAdv: Query-Efficient Black-Box Adversarial Attack with Unlabeled Images13 Jul 2024
- 2024Graph Neural Backdoor: Fundamentals, Methodologies, Applications, and Future Directions15 Jun 2024
- 2024Medical MLLM is Vulnerable: Cross-Modality Jailbreak and Mismatched Attacks on Medical Multimodal Large Language Models26 May 2024
- 2024Properties that allow or prohibit transferability of adversarial attacks among quantized networks15 May 2024
- 2024Ensemble Adversarial Defense via Integration of Multiple Dispersed Low Curvature Models25 Mar 2024
- 2024An Image Is Worth 1000 Lies: Adversarial Transferability across Prompts on Vision-Language Models14 Mar 2024
- 2024Hard-label based Small Query Black-box Adversarial Attack9 Mar 2024
- 2024Distilling Adversarial Robustness Using Heterogeneous Teachers23 Feb 2024
- 2024VGMShield: Mitigating Misuse of Video Generative Models20 Feb 2024
- 2023LRS: Enhancing Adversarial Transferability through Lipschitz Regularized Surrogate20 Dec 2023
- 2023Adversarial Robustness on Image Classification with k-means15 Dec 2023
- 2023A Simple Framework to Enhance the Adversarial Robustness of Deep Learning-based Intrusion Detection System6 Dec 2023
- 2023AdvGen: Physical Adversarial Attack on Face Presentation Attack Detection Systems20 Nov 2023
- 2023GIST: Generated Inputs Sets Transferability in Deep Learning1 Nov 2023
- 2023Unscrambling the Rectification of Adversarial Attacks Transferability across Computer Networks26 Oct 2023
- 2023PubDef: Defending Against Transfer Attacks From Public Models26 Oct 2023
- 2023A minimax optimal control approach for robust neural ODEs26 Oct 2023
50 newest of 158 All 158 (JSON)
- 2024An Image Is Worth 1000 Lies: Adversarial Transferability across Prompts on Vision-Language Modelscited by 45
- 2024Adversarial Attacks of Vision Tasks in the Past 10 Years: A Surveycited by 23
- 2025X-Transfer Attacks: Towards Super Transferable Adversarial Attacks on CLIPcited by 21
- 2024Medical MLLM is Vulnerable: Cross-Modality Jailbreak and Mismatched Attacks on Medical Multimodal Large Language Modelscited by 10
- 2025Improving Adversarial Transferability in MLLMs via Dynamic Vision-Language Alignment Attackcited by 1
- 2025X-Transfer Attacks: Towards Super Transferable Adversarial Attacks on CLIP8 May 2025
- 2025Improving Adversarial Transferability in MLLMs via Dynamic Vision-Language Alignment Attack27 Feb 2025
- 2024Adversarial Attacks of Vision Tasks in the Past 10 Years: A Survey31 Oct 2024
- 2024Medical MLLM is Vulnerable: Cross-Modality Jailbreak and Mismatched Attacks on Medical Multimodal Large Language Models26 May 2024
- 2024An Image Is Worth 1000 Lies: Adversarial Transferability across Prompts on Vision-Language Models14 Mar 2024
- 2024Distilling Adversarial Robustness Using Heterogeneous Teacherscited by 3
- 2021Understanding Robustness in Teacher-Student Setting: A New Perspectivecited by 1
- 2022Look Closer to Your Enemy: Learning to Attack via Teacher-Student Mimickingcited by 0
- 2026Toward Understanding Adversarial Distillation: Why Robust Teachers Failcited by 0
- 2026Toward Understanding Adversarial Distillation: Why Robust Teachers Fail21 May 2026
- 2024Distilling Adversarial Robustness Using Heterogeneous Teachers23 Feb 2024
- 2022Look Closer to Your Enemy: Learning to Attack via Teacher-Student Mimicking27 Jul 2022
- 2021Understanding Robustness in Teacher-Student Setting: A New Perspective25 Feb 2021
- 2026The Unseen Threat: Residual Knowledge in Machine Unlearning under Perturbed Samplescited by 4
- 2025Privacy Leaks by Adversaries: Adversarial Iterations for Membership Inference Attackcited by 2
- 2025Understanding Adversarial Transfer: Why Representation-Space Attacks Fail Where Data-Space Attacks Succeedcited by 1
- 2025Toward Understanding the Transferability of Adversarial Suffixes in Large Language Modelscited by 1
- 2026The Unseen Threat: Residual Knowledge in Machine Unlearning under Perturbed Samples29 Jan 2026
- 2025Toward Understanding the Transferability of Adversarial Suffixes in Large Language Models24 Oct 2025
- 2025Understanding Adversarial Transfer: Why Representation-Space Attacks Fail Where Data-Space Attacks Succeed1 Oct 2025
- 2025Privacy Leaks by Adversaries: Adversarial Iterations for Membership Inference Attack3 Jun 2025
- 2021Recent Advances in Adversarial Training for Adversarial Robustnesscited by 279
- 2021Partial success in closing the gap between human and machine visioncited by 185
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2021SoK: How Robust is Image Classification Deep Neural Network Watermarking? (Extended Version)cited by 69
- 2023How Deep Learning Sees the World: A Survey on Adversarial Attacks & Defensescited by 66
- 2022Fingerprinting Deep Neural Networks Globally via Universal Adversarial Perturbationscited by 61
- 2022Towards Data-Free Model Stealing in a Hard Label Settingcited by 58
- 2022LGV: Boosting Adversarial Example Transferability from Large Geometric Vicinitycited by 39
- 2021TRS: Transferability Reduced Ensemble via Encouraging Gradient Diversity and Model Smoothnesscited by 38
- 2021Trivial or impossible -- dichotomous data difficulty masks model differences (on ImageNet and beyond)cited by 35
- 2021GradDiv: Adversarial Robustness of Randomized Neural Networks via Gradient Diversity Regularizationcited by 34
- 2022Marksman Backdoor: Backdoor Attacks with Arbitrary Target Classcited by 33
12 most cited of 139 All 139 (JSON)
- 2026Adversarial Training Without Input Gradients via Low-Rank Householder Expansions27 Aug 2026
- 2026Almost for Free: Crafting Adversarial Examples with Convolutional Image Filters1 May 2026
- 2026Removing the Trigger, Not the Backdoor: Alternative Triggers and Latent Backdoors10 Mar 2026
- 2025Sample-wise Adaptive Weighting for Transfer Consistency in Adversarial Distillation11 Dec 2025
- 2025Angular Gradient Sign Method: Uncovering Vulnerabilities in Hyperbolic Networks17 Nov 2025
- 2025Quantifying the Risk of Transferred Black Box Attacks7 Nov 2025
- 2025Test-Time Defense Against Adversarial Attacks via Stochastic Resonance of Latent Ensembles3 Oct 2025
- 2025Merge Now, Regret Later: The Hidden Cost of Model Merging Is Adversarial Transferability28 Sep 2025
- 2025SEGA: A Transferable Signed Ensemble Gaussian Black-Box Attack against No-Reference Image Quality Assessment Models23 Sep 2025
- 2025TriQDef: Disrupting Semantic and Gradient Alignment to Prevent Adversarial Patch Transferability in Quantized Neural Networks16 Aug 2025
- 2025SAM Encoder Breach by Adversarial Simplicial Complex Triggers Downstream Model Failures8 Aug 2025
- 2025Narrowing Class-Wise Robustness Gaps in Adversarial Training20 Mar 2025
12 newest of 139 All 139 (JSON)