LAFEAT: Piercing Through Adversarial Defenses with Latent Features
Not on the map. Why?
Abstract (arXiv)
Deep convolutional neural networks are susceptible to adversarial attacks. They can be easily deceived to give an incorrect output by adding a tiny perturbation to the input. This presents a great challenge in making CNNs robust against such attacks. An influx of new defense techniques have been proposed to this end. In this paper, we show that latent features in certain "robust" models are surprisingly susceptible to adversarial attacks. On top of this, we introduce a unified ℓ_∞-norm white-box attack algorithm which harnesses latent features in its gradient descent steps, namely LAFEAT. We show that not only is it computationally much more efficient for successful attacks, but it is also a stronger adversary than the current state-of-the-art across a wide range of defense mechanisms. This suggests that model robustness could be contingent on the effective use of the defender's hidden components, and it should no longer be viewed from a holistic perspective.
Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). Builds on 41 of its 63 references that are in the map. First posted on arXiv 19 Apr 2021.
Builds on
41 of 63 references.
References · 41
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2013Intriguing properties of neural networkscited by 5,114
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,976
- 2016Adversarial examples in the physical worldcited by 1,762
- 2019Theoretically Principled Trade-off between Robustness and Accuracycited by 1,510
- 2020Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attackscited by 1,442
- 2015DeepFool: a simple and accurate method to fool deep neural networkscited by 1,315
- 2016Adversarial Machine Learning at Scalecited by 934
- 2020Fast is better than free: Revisiting adversarial trainingcited by 723
- 2019Square Attack: a query-efficient black-box adversarial attack via random searchcited by 682
29 more
- 2019Adversarial Training for Free!cited by 638
- 2017One pixel attack for fooling deep neural networkscited by 579
- 2020Overfitting in adversarially robust deep learningcited by 504
- 2019On Evaluating Adversarial Robustnesscited by 442
- 2019Unlabeled Data Improves Adversarial Robustnesscited by 415
- 2019Using Pre-Training Can Improve Model Robustness and Uncertaintycited by 373
- 2019Minimally distorted Adversarial Examples with a Fast Adaptive Boundary Attackcited by 333
- 2020Uncovering the Limits of Adversarial Training against Norm-Bounded Adversarial Examplescited by 275
- 2018Generating Adversarial Examples with Adversarial Networkscited by 256
- 2020Bag of Tricks for Adversarial Trainingcited by 199
- 2019You Only Propagate Once: Accelerating Adversarial Training via Maximal Principlecited by 181
- 2018MMA Training: Direct Input Space Margin Maximization through Adversarial Trainingcited by 171
- 2019Stereo R-CNN based 3D Object Detection for Autonomous Drivingcited by 163
- 2019Are Labels Required for Improving Adversarial Robustness?cited by 162
- 2020Adversarial Robustness: From Self-Supervised Pre-Training to Fine-Tuningcited by 152
- 2019End-to-End Model-Free Reinforcement Learning for Urban Driving using Implicit Affordancescited by 147
- 2019Adversarial Robustness through Local Linearizationcited by 146
- 2020Self-Adaptive Training: beyond Empirical Risk Minimizationcited by 126
- 2017Interactive Medical Image Segmentation using Deep Learning with Image-specific Fine-tuningcited by 110
- 2019Adversarial Robustness vs Model Compression, or Both?cited by 98
- 2020Boosting Adversarial Training with Hypersphere Embeddingcited by 97
- 2019Defense Against Adversarial Attacks Using Feature Scattering-based Adversarial Trainingcited by 95
- 2019Controlling Neural Level Setscited by 76
- 2019Adversarial Defense by Restricting the Hidden Space of Deep Neural Networkscited by 56
- 2017Art of singular vectors and universal adversarial perturbationscited by 49
- 2019An Alternative Surrogate Loss for PGD-based Adversarial Testingcited by 45
- 2019Harnessing the Vulnerability of Latent Layers in Adversarially Trained Modelscited by 26
- 2019AdvGAN++ : Harnessing latent layers for adversary generationcited by 20
- 2020Stylized Adversarial Defensecited by 5
Built on by
Citing papers per year: 2021: 4; 2022: 6; 2023: 4; 2024: 2; 2025: 7; 2026: 1.
24 papers.
Sort:
By area:
- 2023Certifying LLM Safety against Adversarial Promptingcited by 248
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2025Adaptive Attacks Break Defenses Against Indirect Prompt Injection Attacks on LLM Agentscited by 112
- 2022Practical Evaluation of Adversarial Robustness via Adaptive Auto Attackcited by 44
- 2023Learning the Unlearnable: Adversarial Augmentations Suppress Unlearnable Example Attackscited by 28
- 2025MTL-UE: Learning to Learn Nothing for Multi-Task Learningcited by 11
- 2022Enhancing Adversarial Robustness for Deep Metric Learningcited by 10
- 2021Adversarial Attack and Defense in Deep Rankingcited by 8
- 2022MORA: Improving Ensemble Robustness Evaluation with Model-Reweighing Attackcited by 7
- 2024Exploring Privacy and Fairness Risks in Sharing Diffusion Models: An Adversarial Perspectivecited by 6
- 2023Adversarial Attacks and Defenses in Machine Learning-Powered Networks: A Contemporary Surveycited by 5
- 2025Beyond Vulnerabilities: A Survey of Adversarial Attacks as Both Threats and Defenses in Computer Vision Systemscited by 4
12 more
- 2021Adversarial Attacks on ML Defense Models Competitioncited by 3
- 2024Towards Million-Scale Adversarial Robustness Evaluation With Stronger Individual Attackscited by 3
- 2022Adversarial Attack and Defense for Non-Parametric Two-Sample Testscited by 2
- 2022Alternating Objectives Generates Stronger PGD-Based Adversarial Attackscited by 2
- 2025An h-space Based Adversarial Attack for Protection Against Few-shot Personalizationcited by 2
- 2025Towards Scalable Topological Regularizerscited by 1
- 2025Theoretical Analysis of Relative Errors in Gradient Computations for Adversarial Attacks with CE Losscited by 1
- 2025RCR-AF: Enhancing Model Generalization via Rademacher Complexity Reduction Activation Functioncited by 1
- 2021Adversarial Robustness of Deep Reinforcement Learning based Dynamic Recommender Systemscited by 0
- 2022Towards Effective Multi-Label Recognition Attacks via Knowledge Graph Consistencycited by 0
- 2023On the Adversarial Robustness of Generative Autoencoders in the Latent Spacecited by 0
- 2026Dummy-Aware Weighted Attack (DAWA): Breaking the Safe Sink in Dummy Class Defensescited by 0
- 2026Dummy-Aware Weighted Attack (DAWA): Breaking the Safe Sink in Dummy Class Defenses31 Mar 2026
- 2025Beyond Vulnerabilities: A Survey of Adversarial Attacks as Both Threats and Defenses in Computer Vision Systems3 Aug 2025
- 2025RCR-AF: Enhancing Model Generalization via Rademacher Complexity Reduction Activation Function30 Jul 2025
- 2025Theoretical Analysis of Relative Errors in Gradient Computations for Adversarial Attacks with CE Loss30 Jul 2025
- 2025An h-space Based Adversarial Attack for Protection Against Few-shot Personalization23 Jul 2025
- 2025MTL-UE: Learning to Learn Nothing for Multi-Task Learning8 May 2025
- 2025Adaptive Attacks Break Defenses Against Indirect Prompt Injection Attacks on LLM Agents27 Feb 2025
- 2025Towards Scalable Topological Regularizers24 Jan 2025
- 2024Towards Million-Scale Adversarial Robustness Evaluation With Stronger Individual Attacks20 Nov 2024
- 2024Exploring Privacy and Fairness Risks in Sharing Diffusion Models: An Adversarial Perspective28 Feb 2024
- 2023Certifying LLM Safety against Adversarial Prompting6 Sep 2023
- 2023On the Adversarial Robustness of Generative Autoencoders in the Latent Space5 Jul 2023
12 more
- 2023Learning the Unlearnable: Adversarial Augmentations Suppress Unlearnable Example Attacks27 Mar 2023
- 2023Adversarial Attacks and Defenses in Machine Learning-Powered Networks: A Contemporary Survey11 Mar 2023
- 2022Alternating Objectives Generates Stronger PGD-Based Adversarial Attacks15 Dec 2022
- 2022MORA: Improving Ensemble Robustness Evaluation with Model-Reweighing Attack15 Nov 2022
- 2022Towards Effective Multi-Label Recognition Attacks via Knowledge Graph Consistency11 Jul 2022
- 2022Practical Evaluation of Adversarial Robustness via Adaptive Auto Attack10 Mar 2022
- 2022Enhancing Adversarial Robustness for Deep Metric Learning2 Mar 2022
- 2022Adversarial Attack and Defense for Non-Parametric Two-Sample Tests7 Feb 2022
- 2021Adversarial Robustness of Deep Reinforcement Learning based Dynamic Recommender Systems2 Dec 2021
- 2021Adversarial Attacks on ML Defense Models Competition15 Oct 2021
- 2021Advances in adversarial attacks and defenses in computer vision: A survey1 Aug 2021
- 2021Adversarial Attack and Defense in Deep Ranking7 Jun 2021
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2022Practical Evaluation of Adversarial Robustness via Adaptive Auto Attackcited by 44
- 2025MTL-UE: Learning to Learn Nothing for Multi-Task Learningcited by 11
- 2022Enhancing Adversarial Robustness for Deep Metric Learningcited by 10
- 2021Adversarial Attack and Defense in Deep Rankingcited by 8
- 2022MORA: Improving Ensemble Robustness Evaluation with Model-Reweighing Attackcited by 7
- 2023Adversarial Attacks and Defenses in Machine Learning-Powered Networks: A Contemporary Surveycited by 5
- 2025Beyond Vulnerabilities: A Survey of Adversarial Attacks as Both Threats and Defenses in Computer Vision Systemscited by 4
- 2021Adversarial Attacks on ML Defense Models Competitioncited by 3
- 2024Towards Million-Scale Adversarial Robustness Evaluation With Stronger Individual Attackscited by 3
- 2022Adversarial Attack and Defense for Non-Parametric Two-Sample Testscited by 2
- 2022Alternating Objectives Generates Stronger PGD-Based Adversarial Attackscited by 2
12 most cited of 19 All 19 (JSON)
- 2026Dummy-Aware Weighted Attack (DAWA): Breaking the Safe Sink in Dummy Class Defenses31 Mar 2026
- 2025Beyond Vulnerabilities: A Survey of Adversarial Attacks as Both Threats and Defenses in Computer Vision Systems3 Aug 2025
- 2025RCR-AF: Enhancing Model Generalization via Rademacher Complexity Reduction Activation Function30 Jul 2025
- 2025Theoretical Analysis of Relative Errors in Gradient Computations for Adversarial Attacks with CE Loss30 Jul 2025
- 2025MTL-UE: Learning to Learn Nothing for Multi-Task Learning8 May 2025
- 2025Towards Scalable Topological Regularizers24 Jan 2025
- 2024Towards Million-Scale Adversarial Robustness Evaluation With Stronger Individual Attacks20 Nov 2024
- 2023On the Adversarial Robustness of Generative Autoencoders in the Latent Space5 Jul 2023
- 2023Adversarial Attacks and Defenses in Machine Learning-Powered Networks: A Contemporary Survey11 Mar 2023
- 2022Alternating Objectives Generates Stronger PGD-Based Adversarial Attacks15 Dec 2022
- 2022MORA: Improving Ensemble Robustness Evaluation with Model-Reweighing Attack15 Nov 2022
- 2022Towards Effective Multi-Label Recognition Attacks via Knowledge Graph Consistency11 Jul 2022
12 newest of 19 All 19 (JSON)