Adversarial Examples Improve Image Recognition
Not on the map. Why?
Abstract (arXiv)
Adversarial examples are commonly viewed as a threat to ConvNets. Here we present an opposite perspective: adversarial examples can be used to improve image recognition models if harnessed in the right manner. We propose AdvProp, an enhanced adversarial training scheme which treats adversarial examples as additional examples, to prevent overfitting. Key to our method is the usage of a separate auxiliary batch norm for adversarial examples, as they have different underlying distributions to normal examples. We show that AdvProp improves a wide range of models on various image recognition tasks and performs better when the models are bigger. For instance, by applying AdvProp to the latest EfficientNet-B7 [28] on ImageNet, we achieve significant improvements on ImageNet (+0.7%), ImageNet-C (+6.5%), ImageNet-A (+7.0%), Stylized-ImageNet (+4.8%). With an enhanced EfficientNet-B8, our method achieves the state-of-the-art 85.5% ImageNet top-1 accuracy without extra data. This result even surpasses the best model in [20] which is trained with 3.5B Instagram images (~3000X more than ImageNet) and ~9.4X more parameters. Models are available at https://github.com/tensorflow/tpu/tree/master/models/official/efficientnet.
Key facts. Cited by 286 papers in the map (data through 14 Oct 2026). First posted on arXiv 21 Nov 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 82; 2022: 71; 2023: 73; 2024: 38; 2025: 17; 2026: 5.
286 papers.
Sort:
By area:
- 2021Going deeper with Image Transformerscited by 764
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 382
- 2021Graph Contrastive Learning Automatedcited by 287
- 2021When Vision Transformers Outperform ResNets without Pre-training or Strong Data Augmentationscited by 260
- 2022Omnivore: A Single Model for Many Visual Modalitiescited by 215
- 2021VOLO: Vision Outlooker for Visual Recognitioncited by 165
- 2021Adversarial Reciprocal Points Learning for Open Set Recognitioncited by 153
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2022Revisiting Weakly Supervised Pre-Training of Visual Perception Modelscited by 116
- 2022Robustness and Accuracy Could Be Reconcilable by (Proper) Definitioncited by 111
- 2022Improving Generalization in Federated Learning by Seeking Flat Minimacited by 98
- 2021AugMax: Adversarial Composition of Random Augmentations for Robust Trainingcited by 90
38 more
- 2023A Comprehensive Study on Robustness of Image Classification Models: Benchmarking and Rethinkingcited by 85
- 2022Conv2Former: A Simple Transformer-Style ConvNet for Visual Recognitioncited by 81
- 2021A Simple Baseline for Semi-supervised Semantic Segmentation with Strong Data Augmentationcited by 79
- 2022Improving Vision Transformers by Revisiting High-frequency Componentscited by 76
- 2021Adversarial VQA: A New Benchmark for Evaluating the Robustness of VQA Modelscited by 75
- 2021Exploring Architectural Ingredients of Adversarially Robust Deep Neural Networkscited by 74
- 2023iDisc: Internal Discretization for Monocular Depth Estimationcited by 73
- 2021On the effectiveness of adversarial training against common corruptionscited by 71
- 2021Improved OOD Generalization via Adversarial Training and Pre-trainingcited by 66
- 2023Graph Mixture of Experts: Learning on Large-Scale Graphs with Explicit Diversity Modelingcited by 64
- 2021Better Safe Than Sorry: Preventing Delusive Adversaries with Adversarial Trainingcited by 59
- 2022Harmonizing the object recognition strategies of deep neural networks with humanscited by 59
- 2023X-Adv: Physical Adversarial Object Attacks against X-ray Prohibited Item Detectioncited by 59
- 2021ST3D++: Denoised Self-training for Unsupervised Domain Adaptation on 3D Object Detectioncited by 57
- 2022LMPriors: Pre-Trained Language Models as Task-Specific Priorscited by 56
- 2023StyleAdv: Meta Style Adversarial Training for Cross-Domain Few-Shot Learningcited by 53
- 2021Adversarial Robustness under Long-Tailed Distributioncited by 50
- 2022ViewFool: Evaluating the Robustness of Visual Recognition to Adversarial Viewpointscited by 48
- 2022Aug-NeRF: Training Stronger Neural Radiance Fields with Triple-Level Physically-Grounded Augmentationscited by 46
- 2023AdvDiff: Generating Unrestricted Adversarial Examples using Diffusion Modelscited by 46
- 2021Rethinking "Batch" in BatchNormcited by 45
- 2021Poisoning the Unlabeled Dataset of Semi-Supervised Learningcited by 44
- 2022Efficient and Effective Augmentation Strategy for Adversarial Trainingcited by 43
- 2021Robust and Accurate Object Detection via Adversarial Learningcited by 42
- 2021Bag of Tricks for Node Classification with Graph Neural Networkscited by 40
- 2021Harnessing Perceptual Adversarial Patches for Crowd Countingcited by 39
- 2021Pyramid Adversarial Training Improves ViT Performancecited by 39
- 2022Robust Calibration with Multi-domain Temperature Scalingcited by 39
- 2021CM-NAS: Cross-Modality Neural Architecture Search for Visible-Infrared Person Re-Identificationcited by 38
- 2023GenDet: Towards Good Generalizations for AI-Generated Image Detectioncited by 36
- 2023What Can We Learn From The Selective Prediction And Uncertainty Estimation Performance Of 523 Imagenet Classifierscited by 35
- 2021Analyzing Overfitting under Class Imbalance in Neural Networks for Image Segmentationcited by 34
- 2023COCO-O: A Benchmark for Object Detectors under Natural Distribution Shiftscited by 34
- 2023Making Substitute Models More Bayesian Can Enhance Transferability of Adversarial Examplescited by 32
- 2022One-Pixel Shortcut: on the Learning Preference of Deep Neural Networkscited by 29
- 2021Direct Differentiable Augmentation Searchcited by 28
- 2021JEM++: Improved Techniques for Training JEMcited by 28
- 2022Context-Aware Robust Fine-Tuningcited by 28
50 most cited of 286 All 286 (JSON)
- 2026Security in LLM-Assisted Coding: A Systematic Literature Review11 Oct 2026
- 2026[Re] Boosting the Visual Interpretability of CLIP via Adversarial Fine-Tuning10 Oct 2026
- 2026Does Adversarial Training Improve Generalization in Multi-View VLAs? Revealing and Mitigating View Collapse27 Sep 2026
- 2026Harnessing non-adversarial robustness in large language models28 May 2026
- 2026The Role of Noisy Data in Improving CNN Robustness for Image Classification12 Jan 2026
- 2025C-DIRA: Computationally Efficient Dynamic ROI Routing and Domain-Invariant Adversarial Learning for Lightweight Driver Behavior Recognition9 Dec 2025
- 2025Ensuring Calibration Robustness in Split Conformal Prediction Under Adversarial Attacks23 Nov 2025
- 2025Provable Repair of Deep Neural Network Defects by Preimage Synthesis and Property Refinement11 Nov 2025
- 2025C-LEAD: Contrastive Learning for Enhanced Adversarial Defense31 Oct 2025
- 2025ANNIE: Be Careful of Your Robots3 Sep 2025
- 2025Distribution-Specific Learning for Joint Salient and Camouflaged Object Detection8 Aug 2025
- 2025ETA: Energy-based Test-time Adaptation for Depth Completion8 Aug 2025
38 more
- 2025ScoreAdv: Score-based Targeted Generation of Natural Adversarial Examples via Diffusion Models8 Jul 2025
- 2025Concept-based Adversarial Attack: a Probabilistic Perspective30 Jun 2025
- 2025Boosting Generative Adversarial Transferability with Self-supervised Vision Transformer Features26 Jun 2025
- 2025PRJ: Perception-Retrieval-Judgement for Generated Images4 Jun 2025
- 2025Towards Assessing Deep Learning Test Input Generators3 Apr 2025
- 2025Predicting Movie Production Years through Facial Recognition of Actors with Machine Learning1 Apr 2025
- 2025EasyRobust: A Comprehensive and Easy-to-use Toolkit for Robust and Generalized Vision21 Mar 2025
- 2025Stabilizing Quantization-Aware Training by Implicit-Regularization on Hessian Matrix14 Mar 2025
- 2025Scale-Invariant Adversarial Attack against Arbitrary-scale Super-resolution6 Mar 2025
- 2025LayerMix: Enhanced Data Augmentation through Fractal Integration for Robust Deep Learning8 Jan 2025
- 2024Beyond Knowledge Silos: Task Fingerprinting for Democratization of Medical Imaging AI11 Dec 2024
- 2024A Parametric Approach to Adversarial Augmentation for Cross-Domain Iris Presentation Attack Detection10 Dec 2024
- 2024Adversarial Transferability in Deep Denoising Models: Theoretical Insights and Robustness Enhancement via Out-of-Distribution Typical Set Sampling8 Dec 2024
- 2024TreeFormer: Single-view Plant Skeleton Estimation via Tree-constrained Graph Generation25 Nov 2024
- 2024Enhancing Adversarial Robustness via Uncertainty-Aware Distributional Adversarial Training5 Nov 2024
- 2024Alignment-Based Adversarial Training (ABAT) for Improving the Robustness and Accuracy of EEG-Based BCIs4 Nov 2024
- 2024Learning from Spatio-temporal Correlation for Semi-Supervised LiDAR Semantic Segmentation9 Oct 2024
- 2024Explicitly Modeling Pre-Cortical Vision with a Neuro-Inspired Front-End Improves CNN Robustness25 Sep 2024
- 2024Few-Shot Unsupervised Implicit Neural Shape Representation Learning with Spatial Adversaries27 Aug 2024
- 2024Disentangled Training with Adversarial Examples For Robust Small-footprint Keyword Spotting23 Aug 2024
- 2024Criticality Leveraged Adversarial Training (CLAT) for Boosted Performance via Parameter Efficiency19 Aug 2024
- 2024Towards Adversarial Robustness via Debiased High-Confidence Logit Alignment12 Aug 2024
- 2024ADBM: Adversarial diffusion bridge model for reliable adversarial purification1 Aug 2024
- 2024Gradient Harmonization in Unsupervised Domain Adaptation1 Aug 2024
- 2024Advancing Vietnamese Visual Question Answering with Transformer and Convolutional Integration30 Jul 2024
- 2024ARoFace: Alignment Robustness to Improve Low-Quality Face Recognition20 Jul 2024
- 2024How Aligned are Different Alignment Metrics?10 Jul 2024
- 2024Mitigating Low-Frequency Bias: Feature Recalibration and Frequency Attention Regularization for Adversarial Robustness4 Jul 2024
- 2024A Method to Facilitate Membership Inference Attacks in Deep Learning Models2 Jul 2024
- 2024Federated Adversarial Learning for Robust Autonomous Landing Runway Detection22 Jun 2024
- 2024Benchmarking Out-of-Distribution Generalization Capabilities of DNN-based Encoding Models for the Ventral Visual Cortex16 Jun 2024
- 2024EntProp: High Entropy Propagation for Improving Accuracy and Robustness29 May 2024
- 2024Adaptive Batch Normalization Networks for Adversarial Robustness20 May 2024
- 2024Hierarchical Selective Classification19 May 2024
- 2024PUMA: margin-based data pruning10 May 2024
- 2024ASAM: Boosting Segment Anything Model with Adversarial Tuning1 May 2024
- 2024Are Watermarks Bugs for Deepfake Detectors? Rethinking Proactive Forensics27 Apr 2024
- 2024AED-PADA:Improving Generalizability of Adversarial Example Detection via Principal Adversarial Domain Adaptation19 Apr 2024
50 newest of 286 All 286 (JSON)
- 2023AdvDiff: Generating Unrestricted Adversarial Examples using Diffusion Modelscited by 46
- 2024ADBM: Adversarial diffusion bridge model for reliable adversarial purificationcited by 24
- 2025ScoreAdv: Score-based Targeted Generation of Natural Adversarial Examples via Diffusion Modelscited by 3
- 2023Adversarial defense based on distribution transfercited by 0
- 2025ScoreAdv: Score-based Targeted Generation of Natural Adversarial Examples via Diffusion Models8 Jul 2025
- 2024ADBM: Adversarial diffusion bridge model for reliable adversarial purification1 Aug 2024
- 2023Adversarial defense based on distribution transfer23 Nov 2023
- 2023AdvDiff: Generating Unrestricted Adversarial Examples using Diffusion Models24 Jul 2023
- 2022On the benefits of knowledge distillation for adversarial robustnesscited by 18
- 2021AGKD-BML: Defense Against Adversarial Attack by Attention Guided Knowledge Distillation and Bi-directional Metric Learningcited by 10
- 2021Robust and Accurate Object Detection via Self-Knowledge Distillationcited by 3
- 2022On the benefits of knowledge distillation for adversarial robustness14 Mar 2022
- 2021Robust and Accurate Object Detection via Self-Knowledge Distillation14 Nov 2021
- 2021AGKD-BML: Defense Against Adversarial Attack by Attention Guided Knowledge Distillation and Bi-directional Metric Learning13 Aug 2021
- 2023Sight Beyond Text: Multi-Modal Training Enhances LLMs in Truthfulness and Ethicscited by 14
- 2023Distilling Out-of-Distribution Robustness from Vision-Language Foundation Modelscited by 9
- 2026Does Adversarial Training Improve Generalization in Multi-View VLAs? Revealing and Mitigating View Collapsecited by 0
- 2026Does Adversarial Training Improve Generalization in Multi-View VLAs? Revealing and Mitigating View Collapse27 Sep 2026
- 2023Distilling Out-of-Distribution Robustness from Vision-Language Foundation Models2 Nov 2023
- 2023Sight Beyond Text: Multi-Modal Training Enhances LLMs in Truthfulness and Ethics13 Sep 2023
- 2025ANNIE: Be Careful of Your Robotscited by 3
- 2025ANNIE: Be Careful of Your Robots3 Sep 2025
- 2021Going deeper with Image Transformerscited by 764
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 382
- 2021Graph Contrastive Learning Automatedcited by 287
- 2021When Vision Transformers Outperform ResNets without Pre-training or Strong Data Augmentationscited by 260
- 2022Omnivore: A Single Model for Many Visual Modalitiescited by 215
- 2021VOLO: Vision Outlooker for Visual Recognitioncited by 165
- 2021Adversarial Reciprocal Points Learning for Open Set Recognitioncited by 153
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2022Revisiting Weakly Supervised Pre-Training of Visual Perception Modelscited by 116
- 2022Robustness and Accuracy Could Be Reconcilable by (Proper) Definitioncited by 111
- 2022Improving Generalization in Federated Learning by Seeking Flat Minimacited by 98
- 2021AugMax: Adversarial Composition of Random Augmentations for Robust Trainingcited by 90
12 most cited of 270 All 270 (JSON)
- 2026Security in LLM-Assisted Coding: A Systematic Literature Review11 Oct 2026
- 2026[Re] Boosting the Visual Interpretability of CLIP via Adversarial Fine-Tuning10 Oct 2026
- 2026Harnessing non-adversarial robustness in large language models28 May 2026
- 2026The Role of Noisy Data in Improving CNN Robustness for Image Classification12 Jan 2026
- 2025C-DIRA: Computationally Efficient Dynamic ROI Routing and Domain-Invariant Adversarial Learning for Lightweight Driver Behavior Recognition9 Dec 2025
- 2025Ensuring Calibration Robustness in Split Conformal Prediction Under Adversarial Attacks23 Nov 2025
- 2025C-LEAD: Contrastive Learning for Enhanced Adversarial Defense31 Oct 2025
- 2025Distribution-Specific Learning for Joint Salient and Camouflaged Object Detection8 Aug 2025
- 2025ETA: Energy-based Test-time Adaptation for Depth Completion8 Aug 2025
- 2025Concept-based Adversarial Attack: a Probabilistic Perspective30 Jun 2025
- 2025Boosting Generative Adversarial Transferability with Self-supervised Vision Transformer Features26 Jun 2025
- 2025PRJ: Perception-Retrieval-Judgement for Generated Images4 Jun 2025
12 newest of 270 All 270 (JSON)