Enhancing Adversarial Example Transferability with an Intermediate Level Attack
Not on the map. Why?
Abstract (arXiv)
Neural networks are vulnerable to adversarial examples, malicious inputs crafted to fool trained models. Adversarial examples often exhibit black-box transfer, meaning that adversarial examples for one model can fool another model. However, adversarial examples are typically overfit to exploit the particular architecture and feature representation of a source model, resulting in sub-optimal black-box transfer attacks to other target models. We introduce the Intermediate Level Attack (ILA), which attempts to fine-tune an existing adversarial example for greater black-box transferability by increasing its perturbation on a pre-specified layer of the source model, improving upon state-of-the-art methods. We show that we can select a layer of the source model to perturb without any knowledge of the target models while achieving high transferability. Additionally, we provide some explanatory insights regarding our method and the effect of optimizing for adversarial examples using intermediate feature maps. Our code is available at https://github.com/CUVL/Intermediate-Level-Attack.
Key facts. Cited by 139 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Jul 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 27; 2022: 21; 2023: 34; 2024: 25; 2025: 22; 2026: 10.
139 papers.
Sort:
By area:
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2021Feature Importance-aware Transferable Adversarial Attackscited by 125
- 2022Improving Adversarial Transferability via Neuron Attribution-Based Attackscited by 92
- 2021On Improving Adversarial Transferability of Vision Transformerscited by 70
- 2022Boosting the Transferability of Adversarial Attacks with Reverse Adversarial Perturbationcited by 67
- 2023VLATTACK: Multimodal Adversarial Attacks on Vision-Language Tasks via Pre-trained Modelscited by 66
- 2021On Generating Transferable Targeted Perturbationscited by 65
- 2021Adversarial Attacks On Multi-Agent Communicationcited by 48
- 2023A Survey on Transferability of Adversarial Examples across Deep Neural Networkscited by 43
- 2021TRS: Transferability Reduced Ensemble via Encouraging Gradient Diversity and Model Smoothnesscited by 37
- 2024Chain of Attack: On the Robustness of Vision-Language Models Against Transfer-Based Adversarial Attackscited by 37
- 2022Towards Understanding and Boosting Adversarial Transferability from a Distribution Perspectivecited by 36
38 more
- 2022Transferable Adversarial Attack based on Integrated Gradientscited by 35
- 2023Diversifying the High-level Features for better Adversarial Transferabilitycited by 34
- 2021A Little Robustness Goes a Long Way: Leveraging Robust Features for Targeted Transfer Attackscited by 33
- 2021ModelDiff: Testing-Based DNN Similarity Comparison for Model Reuse Detectioncited by 33
- 2023Making Substitute Models More Bayesian Can Enhance Transferability of Adversarial Examplescited by 32
- 2021Boosting Transferability of Targeted Adversarial Examples via Hierarchical Generative Networkscited by 31
- 2023Generalizable Black-Box Adversarial Attack with Meta Learningcited by 29
- 2023Improving Adversarial Transferability via Intermediate-level Perturbation Decaycited by 29
- 2021Adversarial Attacks on Black Box Video Classifiers: Leveraging the Power of Geometric Transformationscited by 28
- 2023Rethinking the Backward Propagation for Adversarial Transferabilitycited by 27
- 2022Investigating Top-k White-Box and Transferable Black-box Attackcited by 26
- 2022Restricted Black-box Adversarial Attack Against DeepFake Face Swappingcited by 25
- 2022Universal Adversarial Examples in Remote Sensing: Methodology and Benchmarkcited by 24
- 2021Understanding the Robustness of Skeleton-based Action Recognition under Adversarial Attackcited by 23
- 2024Adversarial Attacks of Vision Tasks in the Past 10 Years: A Surveycited by 22
- 2024Transferable Adversarial Attacks on SAM and Its Downstream Modelscited by 20
- 2023Attacks in Adversarial Machine Learning: A Systematic Survey from the Life-cycle Perspectivecited by 19
- 2023A Survey of Robustness and Safety of 2D and 3D Deep Learning Models Against Adversarial Attackscited by 19
- 2023Logit Margin Matters: Improving Transferable Targeted Adversarial Attack by Logit Calibrationcited by 18
- 2024Boosting Adversarial Transferability across Model Genus by Deformation-Constrained Warpingcited by 18
- 2024Improved Generation of Adversarial Examples Against Safety-aligned LLMscited by 17
- 2021Training Meta-Surrogate Model for Transferable Adversarial Attackcited by 15
- 2021Adversarial Examples on Segmentation Models Can be Easy to Transfercited by 15
- 2022Strong Transferable Adversarial Attacks via Ensembled Asymptotically Normal Distribution Learningcited by 15
- 2022Towards Good Practices in Evaluating Transfer Adversarial Attackscited by 14
- 2025Intermediate Layer Classifiers for OOD generalizationcited by 14
- 2021Learning to Learn Transferable Attackcited by 13
- 2022Towards Lightweight Black-Box Attacks against Deep Neural Networkscited by 13
- 2023Mitigating Accuracy-Robustness Trade-off via Balanced Multi-Teacher Adversarial Distillationcited by 13
- 2023Reliable Evaluation of Adversarial Transferabilitycited by 12
- 2023StyLess: Boosting the Transferability of Adversarial Examplescited by 11
- 2024As Firm As Their Foundations: Can open-sourced foundation models be used to create adversarial examples for downstream tasks?cited by 11
- 2024Trustworthy Federated Learning: Privacy, Security, and Beyondcited by 11
- 2025MMT-ARD: Multimodal Multi-Teacher Adversarial Distillation for Robust Vision-Language Modelscited by 11
- 2022PointCAT: Contrastive Adversarial Training for Robust Point Cloud Recognitioncited by 10
- 2024VQAttack: Transferable Adversarial Attacks on Visual Question Answering via Pre-trained Modelscited by 10
- 2022An Intermediate-level Attack Framework on The Basis of Linear Regressioncited by 9
- 2021What Do Deep Nets Learn? Class-wise Patterns Revealed in the Input Spacecited by 8
50 most cited of 139 All 139 (JSON)
- 2026Anchoring Adversarial Trajectories to Data Manifolds: A Bilevel Transfer Optimization Framework30 Sep 2026
- 2026One Attack to Fool Them All: Highly Transferable Black-Box Adversarial Attacks on Frontier MLLMs27 Sep 2026
- 2026Text-Anchored Semantic Perturbations for Transferable Jailbreak Attacks on Multimodal Large Language Models23 Aug 2026
- 2026Perspective-Invariant Attack with Enhanced Transferability of Adversarial Examples15 Aug 2026
- 2026Towards Universal Physical Adversarial Attacks via a Joint Multi-Objective and Multi-Model Optimization Framework18 May 2026
- 2026Intermediate Representations are Strong AI-Generated Image Detectors5 May 2026
- 2026Contract And Conquer: How to Provably Compute Adversarial Examples for a Black-Box Model?11 Mar 2026
- 2026Devling into Adversarial Transferability on Image Classification: Review, Benchmark, and Evaluation26 Feb 2026
- 2026LAMP: Learning Universal Adversarial Perturbations for Multi-Image Tasks via Pre-trained Models29 Jan 2026
- 2026Feature-Space Smoothing: Certified Robustness of Deep Representations22 Jan 2026
- 2025AnchorHOI: Zero-shot Generation of 4D Human-Object Interaction via Anchor-based Prior Distillation16 Dec 2025
- 2025One Leak Away: How Pretrained Model Exposure Amplifies Jailbreak Risks in Finetuned LLMs14 Dec 2025
38 more
- 2025Rethinking the Use of Vision Transformers for AI-Generated Image Detection4 Dec 2025
- 2025Enhancing Adversarial Transferability through Block Stretch and Shrink21 Nov 2025
- 2025MMT-ARD: Multimodal Multi-Teacher Adversarial Distillation for Robust Vision-Language Models21 Nov 2025
- 2025Boosting Adversarial Transferability via Ensemble Non-Attention12 Nov 2025
- 2025NAT: Learning to Attack Neurons for Enhanced Adversarial Transferability23 Aug 2025
- 2025Adversarial Attacks on VQA-NLE: Exposing and Alleviating Inconsistencies in Visual Question Answering Explanations17 Aug 2025
- 2025Towards Effective Prompt Stealing Attack against Text-to-Image Diffusion Models9 Aug 2025
- 2025Disrupting Semantic and Abstract Features for Better Adversarial Transferability21 Jul 2025
- 2025Boosting Generative Adversarial Transferability with Self-supervised Vision Transformer Features26 Jun 2025
- 2025Improving Black-Box Generative Attacks via Generator Semantic Consistency23 Jun 2025
- 2025TESSER: Transfer-Enhancing Adversarial Attacks from Vision Transformers via Spectral and Semantic Regularization26 May 2025
- 2025Temporal Consistency Constrained Transferable Adversarial Attacks with Background Mixup for Action Recognition23 May 2025
- 2025Seeking Flat Minima over Diverse Surrogates for Improved Adversarial Transferability: A Theoretical Framework and Algorithmic Instantiation23 Apr 2025
- 2025Intermediate Layer Classifiers for OOD generalization7 Apr 2025
- 2025Boosting the Local Invariance for Better Adversarial Transferability8 Mar 2025
- 2025Scale-Invariant Adversarial Attack against Arbitrary-scale Super-resolution6 Mar 2025
- 2025Prompt-driven Transferable Adversarial Attack on Person Re-Identification with Attribute-aware Textual Inversion27 Feb 2025
- 2025FSPGD: Rethinking Black-box Attacks on Semantic Segmentation3 Feb 2025
- 2025Modality Unified Attack for Omni-Modality Person Re-Identification22 Jan 2025
- 2025Cross-Modal Transferable Image-to-Video Attack on Video Quality Metrics14 Jan 2025
- 2024Two Heads Are Better Than One: Averaging along Fine-Tuning to Improve Targeted Transferability30 Dec 2024
- 2024FaceShield: Defending Facial Image against Deepfake Threats13 Dec 2024
- 2024Chain of Attack: On the Robustness of Vision-Language Models Against Transfer-Based Adversarial Attacks24 Nov 2024
- 2024Improving Transferable Targeted Attacks with Feature Tuning Mixup23 Nov 2024
- 2024Rethinking the Intermediate Features in Adversarial Attacks: Misleading Robotic Models via Adversarial Distillation21 Nov 2024
- 2024Trustworthy Federated Learning: Privacy, Security, and Beyond3 Nov 2024
- 2024Adversarial Attacks of Vision Tasks in the Past 10 Years: A Survey31 Oct 2024
- 2024Transferable Adversarial Attacks on SAM and Its Downstream Models26 Oct 2024
- 2024Deciphering the Chaos: Enhancing Jailbreak Attacks via Adversarial Prompt Translation15 Oct 2024
- 2024BlackDAN: A Black-Box Multi-Objective Approach for Effective and Contextual Jailbreaking of Large Language Models13 Oct 2024
- 2024On the Adversarial Transferability of Generalized "Skip Connections"11 Oct 2024
- 2024Learning to Learn Transferable Generative Attack for Person Re-Identification6 Sep 2024
- 2024Adversarial Attacks and Defenses in Multivariate Time-Series Forecasting for Smart and Connected Infrastructures27 Aug 2024
- 2024DMS: Addressing Information Loss with More Steps for Pragmatic Adversarial Attacks9 Jun 2024
- 2024Advancing Generalized Transfer Attack with Initialization Derived Bilevel Optimization and Dynamic Sequence Truncation4 Jun 2024
- 2024Improved Generation of Adversarial Examples Against Safety-aligned LLMs28 May 2024
- 2024Boosting Adversarial Transferability with Low-Cost Optimization via Maximin Expected Flatness25 May 2024
- 2024Improving Transferable Targeted Adversarial Attack via Normalized Logit Calibration and Truncated Feature Mixing10 May 2024
50 newest of 139 All 139 (JSON)
- 2024Chain of Attack: On the Robustness of Vision-Language Models Against Transfer-Based Adversarial Attackscited by 37
- 2024Adversarial Attacks of Vision Tasks in the Past 10 Years: A Surveycited by 22
- 2025MMT-ARD: Multimodal Multi-Teacher Adversarial Distillation for Robust Vision-Language Modelscited by 11
- 2026LAMP: Learning Universal Adversarial Perturbations for Multi-Image Tasks via Pre-trained Modelscited by 0
- 2026Text-Anchored Semantic Perturbations for Transferable Jailbreak Attacks on Multimodal Large Language Modelscited by 0
- 2026Text-Anchored Semantic Perturbations for Transferable Jailbreak Attacks on Multimodal Large Language Models23 Aug 2026
- 2026LAMP: Learning Universal Adversarial Perturbations for Multi-Image Tasks via Pre-trained Models29 Jan 2026
- 2025MMT-ARD: Multimodal Multi-Teacher Adversarial Distillation for Robust Vision-Language Models21 Nov 2025
- 2024Chain of Attack: On the Robustness of Vision-Language Models Against Transfer-Based Adversarial Attacks24 Nov 2024
- 2024Adversarial Attacks of Vision Tasks in the Past 10 Years: A Survey31 Oct 2024
- 2024Improved Generation of Adversarial Examples Against Safety-aligned LLMscited by 17
- 2021What Do Deep Nets Learn? Class-wise Patterns Revealed in the Input Spacecited by 8
- 2024Deciphering the Chaos: Enhancing Jailbreak Attacks via Adversarial Prompt Translationcited by 6
- 2024BlackDAN: A Black-Box Multi-Objective Approach for Effective and Contextual Jailbreaking of Large Language Modelscited by 5
- 2025One Leak Away: How Pretrained Model Exposure Amplifies Jailbreak Risks in Finetuned LLMscited by 1
- 2025One Leak Away: How Pretrained Model Exposure Amplifies Jailbreak Risks in Finetuned LLMs14 Dec 2025
- 2024Deciphering the Chaos: Enhancing Jailbreak Attacks via Adversarial Prompt Translation15 Oct 2024
- 2024BlackDAN: A Black-Box Multi-Objective Approach for Effective and Contextual Jailbreaking of Large Language Models13 Oct 2024
- 2024Improved Generation of Adversarial Examples Against Safety-aligned LLMs28 May 2024
- 2021What Do Deep Nets Learn? Class-wise Patterns Revealed in the Input Space18 Jan 2021
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2021Feature Importance-aware Transferable Adversarial Attackscited by 125
- 2022Improving Adversarial Transferability via Neuron Attribution-Based Attackscited by 92
- 2021On Improving Adversarial Transferability of Vision Transformerscited by 70
- 2022Boosting the Transferability of Adversarial Attacks with Reverse Adversarial Perturbationcited by 67
- 2023VLATTACK: Multimodal Adversarial Attacks on Vision-Language Tasks via Pre-trained Modelscited by 66
- 2021On Generating Transferable Targeted Perturbationscited by 65
- 2021Adversarial Attacks On Multi-Agent Communicationcited by 48
- 2023A Survey on Transferability of Adversarial Examples across Deep Neural Networkscited by 43
- 2021TRS: Transferability Reduced Ensemble via Encouraging Gradient Diversity and Model Smoothnesscited by 37
- 2022Towards Understanding and Boosting Adversarial Transferability from a Distribution Perspectivecited by 36
- 2022Transferable Adversarial Attack based on Integrated Gradientscited by 35
12 most cited of 126 All 126 (JSON)
- 2026Anchoring Adversarial Trajectories to Data Manifolds: A Bilevel Transfer Optimization Framework30 Sep 2026
- 2026One Attack to Fool Them All: Highly Transferable Black-Box Adversarial Attacks on Frontier MLLMs27 Sep 2026
- 2026Perspective-Invariant Attack with Enhanced Transferability of Adversarial Examples15 Aug 2026
- 2026Towards Universal Physical Adversarial Attacks via a Joint Multi-Objective and Multi-Model Optimization Framework18 May 2026
- 2026Intermediate Representations are Strong AI-Generated Image Detectors5 May 2026
- 2026Contract And Conquer: How to Provably Compute Adversarial Examples for a Black-Box Model?11 Mar 2026
- 2026Devling into Adversarial Transferability on Image Classification: Review, Benchmark, and Evaluation26 Feb 2026
- 2026Feature-Space Smoothing: Certified Robustness of Deep Representations22 Jan 2026
- 2025Rethinking the Use of Vision Transformers for AI-Generated Image Detection4 Dec 2025
- 2025Enhancing Adversarial Transferability through Block Stretch and Shrink21 Nov 2025
- 2025Boosting Adversarial Transferability via Ensemble Non-Attention12 Nov 2025
- 2025NAT: Learning to Attack Neurons for Enhanced Adversarial Transferability23 Aug 2025
12 newest of 126 All 126 (JSON)