Combating Adversaries with Anti-Adversaries
Not on the map. Why?
Abstract (arXiv)
Deep neural networks are vulnerable to small input perturbations known as adversarial attacks. Inspired by the fact that these adversaries are constructed by iteratively minimizing the confidence of a network for the true class label, we propose the anti-adversary layer, aimed at countering this effect. In particular, our layer generates an input perturbation in the opposite direction of the adversarial one and feeds the classifier a perturbed version of the input. Our approach is training-free and theoretically supported. We verify the effectiveness of our approach by combining our layer with both nominally and robustly trained models and conduct large-scale experiments from black-box to adaptive attacks on CIFAR10, CIFAR100, and ImageNet. Our layer significantly enhances model robustness while coming at no cost on clean accuracy.
Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). Builds on 35 of its 52 references that are in the map. First posted on arXiv 26 Mar 2021.
Builds on
35 of 52 references.
References · 35
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2013Intriguing properties of neural networkscited by 5,114
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,976
- 2019Theoretically Principled Trade-off between Robustness and Accuracycited by 1,510
- 2020Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attackscited by 1,442
- 2015DeepFool: a simple and accurate method to fool deep neural networkscited by 1,315
- 2018Obfuscated Gradients Give a False Sense of Security: Circumventing Defenses to Adversarial Examplescited by 1,259
- 2016Practical Black-Box Attacks against Machine Learningcited by 893
23 more
- 2018Robustness May Be at Odds with Accuracycited by 873
- 2019Square Attack: a query-efficient black-box adversarial attack via random searchcited by 682
- 2015Distillation as a Defense to Adversarial Perturbations against Deep Neural Networkscited by 675
- 2017OptNet: Differentiable Optimization as a Layer in Neural Networkscited by 588
- 2020On Adaptive Attacks to Adversarial Example Defensescited by 547
- 2018Black-box Adversarial Attacks with Limited Queries and Informationcited by 499
- 2017Decision-Based Adversarial Attacks: Reliable Attacks Against Black-Box Machine Learning Modelscited by 459
- 2019On Evaluating Adversarial Robustnesscited by 442
- 2019Unlabeled Data Improves Adversarial Robustnesscited by 415
- 2017Mitigating Adversarial Effects Through Randomizationcited by 382
- 2019Using Pre-Training Can Improve Model Robustness and Uncertaintycited by 373
- 2019Minimally distorted Adversarial Examples with a Fast Adaptive Boundary Attackcited by 333
- 2018Feature Denoising for Improving Adversarial Robustnesscited by 312
- 2017Parseval Networks: Improving Robustness to Adversarial Examplescited by 288
- 2019Simple Black-box Adversarial Attackscited by 249
- 2018Adversarial Risk and the Dangers of Evaluating Against Weak Attackscited by 221
- 2017Towards Robust Neural Networks via Random Self-ensemblecited by 158
- 2018Prior Convictions: Black-Box Adversarial Attacks with Bandits and Priorscited by 145
- 2018Query-Efficient Hard-label Black-box Attack:An Optimization-based Approachcited by 130
- 2018Parametric Noise Injection: Trainable Randomness to Improve Deep Neural Network Robustness against Adversarial Attackcited by 123
- 2019Defense Against Adversarial Attacks Using Feature Scattering-based Adversarial Trainingcited by 95
- 2018DARTS: Deceiving Autonomous Cars with Toxic Signscited by 53
- 2019Stochastic Three Points Method for Unconstrained Smooth Minimizationcited by 24
Built on by
Citing papers per year: 2022: 6; 2023: 5; 2024: 4; 2025: 7; 2026: 5.
27 papers.
Sort:
By area:
- 2023A Comprehensive Survey on Test-Time Adaptation under Distribution Shiftscited by 353
- 2022Evaluating the Adversarial Robustness of Adaptive Test-time Defensescited by 64
- 2022Visual Prompting for Adversarial Robustnesscited by 33
- 2022DISCO: Adversarial Defense with Local Implicit Functionscited by 33
- 2025CLIP is Strong Enough to Fight Back: Test-time Counterattacks towards Zero-shot Adversarial Robustness of CLIPcited by 23
- 2023Defenses in Adversarial Machine Learning: A Surveycited by 14
- 2025AutoAdvExBench: Benchmarking autonomous exploitation of adversarial example defensescited by 14
- 2025Enhancing CLIP Robustness via Cross-Modality Alignmentcited by 14
- 2023Evaluation of Test-Time Adaptation Under Computational Time Constraintscited by 13
- 2024Adaptive Randomized Smoothing: Certified Adversarial Robustness for Multi-Step Defencescited by 9
- 2023Robust Feature Inference: A Test-time Defense Strategy using Spectral Projectionscited by 3
- 2024Interpretability-Guided Test-Time Adversarial Defensecited by 3
15 more
- 2025Self-Calibrated Consistency can Fight Back for Adversarial Robustness in Vision-Language Modelscited by 3
- 2022Attacking Adversarial Defences by Smoothing the Loss Landscapecited by 2
- 2023Improving Adversarial Robustness of DEQs with Explicit Regulations Along the Neural Dynamicscited by 2
- 2026Contrastive Spectral Rectification: Test-Time Defense towards Zero-shot Adversarial Robustness of CLIPcited by 2
- 2022Unifying Gradients to Improve Real-world Robustness for Deep Networkscited by 1
- 2022Test-time adversarial detection and robustness for localizing humans using ultra wide band channel impulse responsescited by 1
- 2024Test-time Adversarial Defense with Opposite Adversarial Path and High Attack Time Costcited by 1
- 2025Adversarial Examples in Environment Perception for Automated Driving (Review)cited by 1
- 2025ADVMEM: Adversarial Memory Initialization for Realistic Test-Time Adaptation via Tracklet-Based Benchmarkingcited by 1
- 2026A Provable Energy-Guided Test-Time Defense Boosting Adversarial Robustness of Large Vision-Language Modelscited by 1
- 2026Certified vs. Empirical Adversarial Robust-ness via Hybrid Convolutions with Attention Stochasticitycited by 1
- 2026When CLIP Sees More, It Fights Back Harder: Multi-View Guided Adaptive Counterattacks for Test-Time Adversarial Robustnesscited by 1
- 2024DataCook: Crafting Anti-Adversarial Examples for Healthcare Data Copyright Protectioncited by 0
- 2025Diffusion or Non-Diffusion Adversarial Defenses: Rethinking the Relation between Classifier and Adversarial Purifiercited by 0
- 2026Closed-Loop Bidirectional Prompting for Adversarial Robustness of Vision Language Modelscited by 0
- 2026When CLIP Sees More, It Fights Back Harder: Multi-View Guided Adaptive Counterattacks for Test-Time Adversarial Robustness5 Jun 2026
- 2026Closed-Loop Bidirectional Prompting for Adversarial Robustness of Vision Language Models25 May 2026
- 2026Certified vs. Empirical Adversarial Robust-ness via Hybrid Convolutions with Attention Stochasticity2 May 2026
- 2026A Provable Energy-Guided Test-Time Defense Boosting Adversarial Robustness of Large Vision-Language Models27 Mar 2026
- 2026Contrastive Spectral Rectification: Test-Time Defense towards Zero-shot Adversarial Robustness of CLIP27 Jan 2026
- 2025Enhancing CLIP Robustness via Cross-Modality Alignment28 Oct 2025
- 2025Self-Calibrated Consistency can Fight Back for Adversarial Robustness in Vision-Language Models26 Oct 2025
- 2025ADVMEM: Adversarial Memory Initialization for Realistic Test-Time Adaptation via Tracklet-Based Benchmarking2 Sep 2025
- 2025Adversarial Examples in Environment Perception for Automated Driving (Review)11 Apr 2025
- 2025CLIP is Strong Enough to Fight Back: Test-time Counterattacks towards Zero-shot Adversarial Robustness of CLIP5 Mar 2025
- 2025AutoAdvExBench: Benchmarking autonomous exploitation of adversarial example defenses3 Mar 2025
- 2025Diffusion or Non-Diffusion Adversarial Defenses: Rethinking the Relation between Classifier and Adversarial Purifier28 Jan 2025
15 more
- 2024Test-time Adversarial Defense with Opposite Adversarial Path and High Attack Time Cost22 Oct 2024
- 2024Interpretability-Guided Test-Time Adversarial Defense23 Sep 2024
- 2024Adaptive Randomized Smoothing: Certified Adversarial Robustness for Multi-Step Defences14 Jun 2024
- 2024DataCook: Crafting Anti-Adversarial Examples for Healthcare Data Copyright Protection26 Mar 2024
- 2023Defenses in Adversarial Machine Learning: A Survey13 Dec 2023
- 2023Robust Feature Inference: A Test-time Defense Strategy using Spectral Projections21 Jul 2023
- 2023Improving Adversarial Robustness of DEQs with Explicit Regulations Along the Neural Dynamics2 Jun 2023
- 2023Evaluation of Test-Time Adaptation Under Computational Time Constraints10 Apr 2023
- 2023A Comprehensive Survey on Test-Time Adaptation under Distribution Shifts27 Mar 2023
- 2022DISCO: Adversarial Defense with Local Implicit Functions11 Dec 2022
- 2022Test-time adversarial detection and robustness for localizing humans using ultra wide band channel impulse responses10 Nov 2022
- 2022Visual Prompting for Adversarial Robustness12 Oct 2022
- 2022Unifying Gradients to Improve Real-world Robustness for Deep Networks12 Aug 2022
- 2022Attacking Adversarial Defences by Smoothing the Loss Landscape1 Aug 2022
- 2022Evaluating the Adversarial Robustness of Adaptive Test-time Defenses28 Feb 2022
- 2025Enhancing CLIP Robustness via Cross-Modality Alignmentcited by 14
- 2025Self-Calibrated Consistency can Fight Back for Adversarial Robustness in Vision-Language Modelscited by 3
- 2026Contrastive Spectral Rectification: Test-Time Defense towards Zero-shot Adversarial Robustness of CLIPcited by 2
- 2026A Provable Energy-Guided Test-Time Defense Boosting Adversarial Robustness of Large Vision-Language Modelscited by 1
- 2026When CLIP Sees More, It Fights Back Harder: Multi-View Guided Adaptive Counterattacks for Test-Time Adversarial Robustnesscited by 1
- 2026Closed-Loop Bidirectional Prompting for Adversarial Robustness of Vision Language Modelscited by 0
- 2026When CLIP Sees More, It Fights Back Harder: Multi-View Guided Adaptive Counterattacks for Test-Time Adversarial Robustness5 Jun 2026
- 2026Closed-Loop Bidirectional Prompting for Adversarial Robustness of Vision Language Models25 May 2026
- 2026A Provable Energy-Guided Test-Time Defense Boosting Adversarial Robustness of Large Vision-Language Models27 Mar 2026
- 2026Contrastive Spectral Rectification: Test-Time Defense towards Zero-shot Adversarial Robustness of CLIP27 Jan 2026
- 2025Enhancing CLIP Robustness via Cross-Modality Alignment28 Oct 2025
- 2025Self-Calibrated Consistency can Fight Back for Adversarial Robustness in Vision-Language Models26 Oct 2025
- 2023A Comprehensive Survey on Test-Time Adaptation under Distribution Shiftscited by 353
- 2022Evaluating the Adversarial Robustness of Adaptive Test-time Defensescited by 64
- 2022Visual Prompting for Adversarial Robustnesscited by 33
- 2022DISCO: Adversarial Defense with Local Implicit Functionscited by 33
- 2025CLIP is Strong Enough to Fight Back: Test-time Counterattacks towards Zero-shot Adversarial Robustness of CLIPcited by 23
- 2023Defenses in Adversarial Machine Learning: A Surveycited by 14
- 2025AutoAdvExBench: Benchmarking autonomous exploitation of adversarial example defensescited by 14
- 2023Evaluation of Test-Time Adaptation Under Computational Time Constraintscited by 13
- 2024Adaptive Randomized Smoothing: Certified Adversarial Robustness for Multi-Step Defencescited by 9
- 2023Robust Feature Inference: A Test-time Defense Strategy using Spectral Projectionscited by 3
- 2024Interpretability-Guided Test-Time Adversarial Defensecited by 3
- 2022Attacking Adversarial Defences by Smoothing the Loss Landscapecited by 2
12 most cited of 20 All 20 (JSON)
- 2026Certified vs. Empirical Adversarial Robust-ness via Hybrid Convolutions with Attention Stochasticity2 May 2026
- 2025ADVMEM: Adversarial Memory Initialization for Realistic Test-Time Adaptation via Tracklet-Based Benchmarking2 Sep 2025
- 2025Adversarial Examples in Environment Perception for Automated Driving (Review)11 Apr 2025
- 2025CLIP is Strong Enough to Fight Back: Test-time Counterattacks towards Zero-shot Adversarial Robustness of CLIP5 Mar 2025
- 2025AutoAdvExBench: Benchmarking autonomous exploitation of adversarial example defenses3 Mar 2025
- 2024Test-time Adversarial Defense with Opposite Adversarial Path and High Attack Time Cost22 Oct 2024
- 2024Interpretability-Guided Test-Time Adversarial Defense23 Sep 2024
- 2024Adaptive Randomized Smoothing: Certified Adversarial Robustness for Multi-Step Defences14 Jun 2024
- 2024DataCook: Crafting Anti-Adversarial Examples for Healthcare Data Copyright Protection26 Mar 2024
- 2023Defenses in Adversarial Machine Learning: A Survey13 Dec 2023
- 2023Robust Feature Inference: A Test-time Defense Strategy using Spectral Projections21 Jul 2023
- 2023Improving Adversarial Robustness of DEQs with Explicit Regulations Along the Neural Dynamics2 Jun 2023
12 newest of 20 All 20 (JSON)