Universal Adversarial Training
Not on the map. Why?
Abstract (arXiv)
Standard adversarial attacks change the predicted class label of a selected image by adding specially tailored small perturbations to its pixels. In contrast, a universal perturbation is an update that can be added to any image in a broad class of images, while still changing the predicted class label. We study the efficient generation of universal adversarial perturbations, and also efficient methods for hardening networks to these attacks. We propose a simple optimization-based universal attack that reduces the top-1 accuracy of various network architectures on ImageNet to less than 20%, while learning the universal perturbation 13X faster than the standard method. To defend against these perturbations, we propose universal adversarial training, which models the problem of robust classifier generation as a two-player min-max game, and produces robust models with only 2X the cost of natural training. We also propose a simultaneous stochastic gradient method that is almost free of extra computation, which allows us to do universal adversarial training on ImageNet.
Key facts. Cited by 87 papers in the map (data through 14 Oct 2026). First posted on arXiv 27 Nov 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 22; 2022: 17; 2023: 15; 2024: 17; 2025: 12; 2026: 4.
87 papers.
Sort:
By area:
- 2023Survey of Vulnerabilities in Large Language Models Revealed by Adversarial Attackscited by 194
- 2022Generalized Federated Learning via Sharpness Aware Minimizationcited by 144
- 2023AdvCLIP: Downstream-agnostic Adversarial Examples in Multimodal Contrastive Learningcited by 103
- 2021On the effectiveness of adversarial training against common corruptionscited by 71
- 2021A Survey On Universal Adversarial Attackcited by 59
- 2021Few-shot Backdoor Defense Using Shapley Estimationcited by 41
- 2023On Robustness of Prompt-based Semantic Parsing with Large Pre-trained Language Model: An Empirical Study on Codexcited by 41
- 2022PatchZero: Defending against Adversarial Patch Attacks by Detecting and Zeroing the Patchcited by 30
- 2021Low Curvature Activations Reduce Overfitting in Adversarial Trainingcited by 29
- 2022The Enemy of My Enemy is My Friend: Exploring Inverse Adversaries for Improving Adversarial Trainingcited by 23
- 2023Enhancing Generalization of Universal Adversarial Perturbation through Gradient Aggregationcited by 22
- 2022Watermark Vaccine: Adversarial Attacks to Prevent Watermark Removalcited by 20
38 more
- 2021Meta Adversarial Training against Universal Patchescited by 19
- 2021Universal Adversarial Perturbations Through the Lens of Deep Steganography: Towards A Fourier Perspectivecited by 18
- 2021Stereoscopic Universal Perturbations across Different Architectures and Datasetscited by 17
- 2022A Perturbation-Constrained Adversarial Attack for Evaluating the Robustness of Optical Flowcited by 16
- 2021Universal Spectral Adversarial Attacks for Deformable Shapescited by 14
- 2021Two Coupled Rejection Metrics Can Tell Adversarial Examples Apartcited by 14
- 2021Universal Adversarial Training with Class-Wise Perturbationscited by 13
- 2021The Feasibility and Inevitability of Stealth Attackscited by 12
- 2021SoK: Machine Learning Governancecited by 10
- 2023SoK: Realistic Adversarial Attacks and Defenses for Intelligent Network Intrusion Detectioncited by 10
- 2021A Simple and Strong Baseline for Universal Targeted Attacks on Siamese Visual Trackingcited by 9
- 2024Reliable Model Watermarking: Defending Against Theft without Compromising on Evasioncited by 9
- 2024Texture Re-scalable Universal Adversarial Perturbationcited by 9
- 2022Dispersed Pixel Perturbation-based Imperceptible Backdoor Trigger for Image Classifier Modelscited by 7
- 2026Universal Image Immunization against Diffusion-based Image Editing via Semantic Injectioncited by 7
- 2021Real-time Detection of Practical Universal Adversarial Perturbationscited by 6
- 2023Provable Unrestricted Adversarial Training without Compromise with Generalizabilitycited by 6
- 2023Universal Adversarial Backdoor Attacks to Fool Vertical Federated Learning in Cloud-Edge Collaborationcited by 6
- 2023Data Optimization in Deep Learning: A Surveycited by 6
- 2024Adversarial Training: A Surveycited by 6
- 2025HoneypotNet: Backdoor Attacks Against Model Extractioncited by 6
- 2021Realizable Universal Adversarial Perturbations for Malwarecited by 5
- 2022Dynamic Time Warping based Adversarial Framework for Time-Series Domaincited by 5
- 2022On the Connection between Invariant Learning and Adversarial Training for Out-of-Distribution Generalizationcited by 5
- 2024Unlearnable Examples For Time Seriescited by 5
- 2025Towards Robust Multimodal Large Language Models Against Jailbreak Attackscited by 5
- 2021Jacobian Regularization for Mitigating Universal Adversarial Perturbationscited by 4
- 2022Jacobian Ensembles Improve Robustness Trade-offs to Adversarial Attackscited by 4
- 2022DECK: Model Hardening for Defending Pervasive Backdoorscited by 4
- 2022Interpretation of Neural Networks is Susceptible to Universal Adversarial Perturbationscited by 4
- 2023One-stage Modality Distillation for Incomplete Multimodal Learningcited by 4
- 2024SSCAE -- Semantic, Syntactic, and Context-aware natural language Adversarial Examples generatorcited by 4
- 2024The Uncanny Valley: Exploring Adversarial Robustness from a Flatness Perspectivecited by 4
- 2024Efficient and Effective Universal Adversarial Attack against Vision-Language Pre-training Modelscited by 4
- 2025Improving Generalization of Universal Adversarial Perturbation via Dynamic Maximin Optimizationcited by 4
- 2025ETA: Energy-based Test-time Adaptation for Depth Completioncited by 4
- 2022AdAUC: End-to-end Adversarial AUC Optimization Against Long-tail Problemscited by 3
- 2022Adversarial Vulnerability of Temporal Feature Networks for Object Detectioncited by 3
50 most cited of 87 All 87 (JSON)
- 2026Unifying Adversarially Robust Model Experts in Vision-Language Models30 Jul 2026
- 2026SORA: Free Second-Order Attacks in Fast Adversarial Training30 May 2026
- 2026Universal Image Immunization against Diffusion-based Image Editing via Semantic Injection16 Feb 2026
- 2026Universal Adversarial Purification with DDIM Metric Loss for Stable Diffusion12 Jan 2026
- 2025Ensuring Calibration Robustness in Split Conformal Prediction Under Adversarial Attacks23 Nov 2025
- 2025SecureLearn -- An Attack-agnostic Defense for Multiclass Machine Learning Against Data Poisoning Attacks25 Oct 2025
- 2025Constrained Adversarial Perturbation17 Oct 2025
- 2025When Flatness Does (Not) Guarantee Adversarial Robustness16 Oct 2025
- 2025ETA: Energy-based Test-time Adaptation for Depth Completion8 Aug 2025
- 2025Evading Data Provenance in Deep Neural Networks1 Aug 2025
- 2025Assured Autonomy with Neuro-Symbolic Perception27 May 2025
- 2025Improving Generalization of Universal Adversarial Perturbation via Dynamic Maximin Optimization17 Mar 2025
38 more
- 2025Data-free Universal Adversarial Perturbation with Pseudo-semantic Prior28 Feb 2025
- 2025Democratic Training Against Universal Adversarial Perturbations8 Feb 2025
- 2025Towards Robust Multimodal Large Language Models Against Jailbreak Attacks2 Feb 2025
- 2025HoneypotNet: Backdoor Attacks Against Model Extraction2 Jan 2025
- 2024textrmA^textrm2RNet: Adversarial Attack Resilient Network for Robust Infrared and Visible Image Fusion13 Dec 2024
- 2024Edge-Only Universal Adversarial Attacks in Distributed Learning15 Nov 2024
- 2024Adversarial Training: A Survey19 Oct 2024
- 2024Efficient and Effective Universal Adversarial Attack against Vision-Language Pre-training Models15 Oct 2024
- 2024Backdoor Attack on Vertical Federated Graph Neural Network Learning15 Oct 2024
- 2024MORTAR: A Model-based Runtime Action Repair Framework for AI-enabled Cyber-Physical Systems7 Aug 2024
- 2024Mitigating Low-Frequency Bias: Feature Recalibration and Frequency Attention Regularization for Adversarial Robustness4 Jul 2024
- 2024Texture Re-scalable Universal Adversarial Perturbation10 Jun 2024
- 2024On Minimizing Adversarial Counterfactual Error in Adversarial RL7 Jun 2024
- 2024Model Agnostic Defense against Adversarial Patch Attacks on Object Detection in Unmanned Aerial Vehicles29 May 2024
- 2024The Uncanny Valley: Exploring Adversarial Robustness from a Flatness Perspective27 May 2024
- 2024Cross-Input Certified Training for Universal Perturbations15 May 2024
- 2024Attack on Scene Flow using Point Clouds21 Apr 2024
- 2024Reliable Model Watermarking: Defending Against Theft without Compromising on Evasion21 Apr 2024
- 2024SSCAE -- Semantic, Syntactic, and Context-aware natural language Adversarial Examples generator18 Mar 2024
- 2024Unlearnable Examples For Time Series3 Feb 2024
- 2024Sparse and Transferable Universal Singular Vectors Attack25 Jan 2024
- 2023Universal Pyramid Adversarial Training for Improved ViT Performance26 Dec 2023
- 2023Data Optimization in Deep Learning: A Survey25 Oct 2023
- 2023Survey of Vulnerabilities in Large Language Models Revealed by Adversarial Attacks16 Oct 2023
- 2023One-stage Modality Distillation for Incomplete Multimodal Learning15 Sep 2023
- 2023Adversarial Collaborative Filtering for Free20 Aug 2023
- 2023AdvCLIP: Downstream-agnostic Adversarial Examples in Multimodal Contrastive Learning14 Aug 2023
- 2023SoK: Realistic Adversarial Attacks and Defenses for Intelligent Network Intrusion Detection13 Aug 2023
- 2023Enhancing Generalization of Universal Adversarial Perturbation through Gradient Aggregation11 Aug 2023
- 2023Universal Defensive Underpainting Patch: Making Your Text Invisible to Optical Character Recognition4 Aug 2023
- 2023Enhance Diffusion to Improve Robust Generalization5 Jun 2023
- 2023Universal Adversarial Backdoor Attacks to Fool Vertical Federated Learning in Cloud-Edge Collaboration22 Apr 2023
- 2023AdaptGuard: Defending Against Universal Attacks for Model Adaptation19 Mar 2023
- 2023Regret-Based Defense in Adversarial Reinforcement Learning14 Feb 2023
- 2023On Robustness of Prompt-based Semantic Parsing with Large Pre-trained Language Model: An Empirical Study on Codex30 Jan 2023
- 2023Provable Unrestricted Adversarial Training without Compromise with Generalizability22 Jan 2023
- 2022On the Connection between Invariant Learning and Adversarial Training for Out-of-Distribution Generalization18 Dec 2022
- 2022Interpretation of Neural Networks is Susceptible to Universal Adversarial Perturbations30 Nov 2022
50 newest of 87 All 87 (JSON)
- 2023Survey of Vulnerabilities in Large Language Models Revealed by Adversarial Attackscited by 194
- 2024Reliable Model Watermarking: Defending Against Theft without Compromising on Evasioncited by 9
- 2025Towards Robust Multimodal Large Language Models Against Jailbreak Attackscited by 5
- 2025SecureLearn -- An Attack-agnostic Defense for Multiclass Machine Learning Against Data Poisoning Attackscited by 0
- 2025SecureLearn -- An Attack-agnostic Defense for Multiclass Machine Learning Against Data Poisoning Attacks25 Oct 2025
- 2025Towards Robust Multimodal Large Language Models Against Jailbreak Attacks2 Feb 2025
- 2024Reliable Model Watermarking: Defending Against Theft without Compromising on Evasion21 Apr 2024
- 2023Survey of Vulnerabilities in Large Language Models Revealed by Adversarial Attacks16 Oct 2023
- 2022Generalized Federated Learning via Sharpness Aware Minimizationcited by 144
- 2023AdvCLIP: Downstream-agnostic Adversarial Examples in Multimodal Contrastive Learningcited by 103
- 2021On the effectiveness of adversarial training against common corruptionscited by 71
- 2021A Survey On Universal Adversarial Attackcited by 59
- 2021Few-shot Backdoor Defense Using Shapley Estimationcited by 41
- 2023On Robustness of Prompt-based Semantic Parsing with Large Pre-trained Language Model: An Empirical Study on Codexcited by 41
- 2022PatchZero: Defending against Adversarial Patch Attacks by Detecting and Zeroing the Patchcited by 30
- 2021Low Curvature Activations Reduce Overfitting in Adversarial Trainingcited by 29
- 2022The Enemy of My Enemy is My Friend: Exploring Inverse Adversaries for Improving Adversarial Trainingcited by 23
- 2023Enhancing Generalization of Universal Adversarial Perturbation through Gradient Aggregationcited by 22
- 2022Watermark Vaccine: Adversarial Attacks to Prevent Watermark Removalcited by 20
- 2021Meta Adversarial Training against Universal Patchescited by 19
12 most cited of 78 All 78 (JSON)
- 2026SORA: Free Second-Order Attacks in Fast Adversarial Training30 May 2026
- 2025Ensuring Calibration Robustness in Split Conformal Prediction Under Adversarial Attacks23 Nov 2025
- 2025Constrained Adversarial Perturbation17 Oct 2025
- 2025When Flatness Does (Not) Guarantee Adversarial Robustness16 Oct 2025
- 2025ETA: Energy-based Test-time Adaptation for Depth Completion8 Aug 2025
- 2025Evading Data Provenance in Deep Neural Networks1 Aug 2025
- 2025Assured Autonomy with Neuro-Symbolic Perception27 May 2025
- 2025Improving Generalization of Universal Adversarial Perturbation via Dynamic Maximin Optimization17 Mar 2025
- 2025Data-free Universal Adversarial Perturbation with Pseudo-semantic Prior28 Feb 2025
- 2025Democratic Training Against Universal Adversarial Perturbations8 Feb 2025
- 2025HoneypotNet: Backdoor Attacks Against Model Extraction2 Jan 2025
- 2024textrmA^textrm2RNet: Adversarial Attack Resilient Network for Robust Infrared and Visible Image Fusion13 Dec 2024
12 newest of 78 All 78 (JSON)