Curriculum Adversarial Training
Not on the map. Why?
Abstract (arXiv)
Recently, deep learning has been applied to many security-sensitive applications, such as facial authentication. The existence of adversarial examples hinders such applications. The state-of-the-art result on defense shows that adversarial training can be applied to train a robust model on MNIST against adversarial examples; but it fails to achieve a high empirical worst-case accuracy on a more complex task, such as CIFAR-10 and SVHN. In our work, we propose curriculum adversarial training (CAT) to resolve this issue. The basic idea is to develop a curriculum of adversarial examples generated by attacks with a wide range of strengths. With two techniques to mitigate the forgetting and the generalization issues, we demonstrate that CAT can improve the prior art's empirical worst-case accuracy by a large margin of 25% on CIFAR-10 and 35% on SVHN. At the same, the model's performance on non-adversarial inputs is comparable to the state-of-the-art models.
Key facts. Cited by 89 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 May 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 25; 2022: 22; 2023: 16; 2024: 12; 2025: 11; 2026: 3.
89 papers.
Sort:
By area:
- 2021Recent Advances in Adversarial Training for Adversarial Robustnesscited by 276
- 2023Cross-Entropy Loss Functions: Theoretical Analysis and Applicationscited by 206
- 2024Defensive Unlearning with Adversarial Training for Robust Concept Erasure in Diffusion Modelscited by 164
- 2021On the Convergence and Robustness of Adversarial Trainingcited by 127
- 2022LAS-AT: Adversarial Training with Learnable Attack Strategycited by 94
- 2022SegPGD: An Effective and Efficient Adversarial Attack for Evaluating and Boosting Segmentation Robustnesscited by 74
- 2021Better Safe Than Sorry: Preventing Delusive Adversaries with Adversarial Trainingcited by 58
- 2021Reliable Adversarial Distillation with Unreliable Teacherscited by 55
- 2023CFA: Class-wise Calibrated Fair Adversarial Trainingcited by 53
- 2022Understanding Robust Overfitting of Adversarial Training and Beyondcited by 50
- 2021Accelerating Deep Learning with Dynamic Data Pruningcited by 43
- 2022Efficient and Effective Augmentation Strategy for Adversarial Trainingcited by 43
38 more
- 2023An Adaptive Model Ensemble Adversarial Attack for Boosting Adversarial Transferabilitycited by 42
- 2021Detecting Adversarial Examples from Sensitivity Inconsistency of Spatial-Transform Domaincited by 29
- 2021Robust Physical-World Attacks on Face Recognitioncited by 26
- 2021Black-box Adversarial Attacks on Commercial Speech Platforms with Minimal Informationcited by 25
- 2021Knowledge Enhanced Machine Learning Pipeline against Diverse Adversarial Attackscited by 24
- 2021CIFS: Improving Adversarial Robustness of CNNs via Channel-wise Importance-based Feature Selectioncited by 21
- 2024MeanSparse: Post-Training Robustness Enhancement Through Mean-Centered Feature Sparsificationcited by 20
- 2021Understanding the Interaction of Adversarial Training with Noisy Labelscited by 19
- 2023Balance, Imbalance, and Rebalance: Understanding Robust Overfitting from a Minimax Game Perspectivecited by 18
- 2023Feature Separation and Recalibration for Adversarial Robustnesscited by 16
- 2022Robust Deep Reinforcement Learning through Bootstrapped Opportunistic Curriculumcited by 15
- 2021Two Coupled Rejection Metrics Can Tell Adversarial Examples Apartcited by 14
- 2021Towards Robust General Medical Image Segmentationcited by 14
- 2023Revisiting and Exploring Efficient Fast Adversarial Training via LAW: Lipschitz Regularization and Auto Weight Averagingcited by 14
- 2023Defenses in Adversarial Machine Learning: A Surveycited by 14
- 2021Neural Architecture Dilation for Adversarial Robustnesscited by 13
- 2023Less is More: Data Pruning for Faster Adversarial Trainingcited by 13
- 2021Learning Diverse-Structured Networks for Adversarial Robustnesscited by 12
- 2022Improving Robustness by Enhancing Weak Subnetscited by 12
- 2022RoCourseNet: Distributionally Robust Training of a Prediction Aware Recourse Modelcited by 11
- 2022Analysis and Extensions of Adversarial Training for Video Classificationcited by 11
- 2022Enhancing Adversarial Robustness for Deep Metric Learningcited by 10
- 2021Guided Interpolation for Adversarial Trainingcited by 8
- 2021NoiLIn: Improving Adversarial Training and Correcting Stereotype of Noisy Labelscited by 8
- 2021Detecting Localized Adversarial Examples: A Generic Approach using Critical Region Analysiscited by 7
- 2021Domain Invariant Adversarial Learningcited by 7
- 2021Style Curriculum Learning for Robust Medical Image Segmentationcited by 6
- 2021Push Stricter to Decide Better: A Class-Conditional Feature Adaptive Framework for Improving Adversarial Robustnesscited by 6
- 2023Adversarial Finetuning with Latent Representation Constraint to Mitigate Accuracy-Robustness Tradeoffcited by 6
- 2024Improving Accuracy-robustness Trade-off via Pixel Reweighted Adversarial Trainingcited by 6
- 2024Adversarial Training: A Surveycited by 6
- 2025INTACT: Inducing Noise Tolerance through Adversarial Curriculum Training for LiDAR-based Safety-Critical Perception and Autonomycited by 5
- 2021Get Fooled for the Right Reason: Improving Adversarial Robustness through a Teacher-guided Curriculum Learning Approachcited by 4
- 2022Adaptive Adversarial Training to Improve Adversarial Robustness of DNNs for Medical Image Segmentation and Detectioncited by 4
- 2022Improving Out-of-Distribution Detection via Epistemic Uncertainty Adversarial Trainingcited by 4
- 2022Adversarial Training with Complementary Labels: On the Benefit of Gradually Informative Attackscited by 4
- 2023Splitting the Difference on Adversarial Trainingcited by 4
- 2024The Uncanny Valley: Exploring Adversarial Robustness from a Flatness Perspectivecited by 4
50 most cited of 89 All 89 (JSON)
- 2026Towards One-for-All Robustness Across a Continuum of Threat Levels2 Sep 2026
- 2026Towards Domain-Generalized Open-Vocabulary Object Detection: A Progressive Domain-invariant Cross-modal Alignment Method29 Mar 2026
- 2026Higher-Order Adversarial Patches for Real-Time Object Detectors8 Jan 2026
- 2025When Flatness Does (Not) Guarantee Adversarial Robustness16 Oct 2025
- 2025Test-Time Defense Against Adversarial Attacks via Stochastic Resonance of Latent Ensembles3 Oct 2025
- 2025Robust Fine-Tuning from Non-Robust Pretrained Models: Mitigating Suboptimal Transfer With Epsilon-Scheduling27 Sep 2025
- 2025SOLAR: Switchable Output Layer for Accuracy and Robustness in Once-for-All Training20 Sep 2025
- 2025A Single-Point Measurement Framework for Robust Cyber-Attack Diagnosis in Smart Microgrids Using Dual Fractional-Order Feature Analysis9 Jul 2025
- 2025Learning to Fuse: Modality-Aware Adaptive Scheduling for Robust Multimodal Foundation Models15 Jun 2025
- 2025Ignition Phase : Standard Training for Fast Adversarial Robustness25 May 2025
- 2025How to Enhance Downstream Adversarial Robustness (almost) without Touching the Pre-Trained Foundation Model?15 Apr 2025
- 2025Dynamic Obstacle Avoidance with Bounded Rationality Adversarial Reinforcement Learning14 Mar 2025
38 more
- 2025Deep Learning Agents Trained For Avoidance Behave Like Hawks And Doves14 Mar 2025
- 2025INTACT: Inducing Noise Tolerance through Adversarial Curriculum Training for LiDAR-based Safety-Critical Perception and Autonomy4 Feb 2025
- 2024Adversarial Training in Low-Label Regimes with Margin-Based Interpolation27 Nov 2024
- 2024Conflict-Aware Adversarial Training21 Oct 2024
- 2024Adversarial Training: A Survey19 Oct 2024
- 2024MeanSparse: Post-Training Robustness Enhancement Through Mean-Centered Feature Sparsification9 Jun 2024
- 2024Improving Accuracy-robustness Trade-off via Pixel Reweighted Adversarial Training2 Jun 2024
- 2024The Uncanny Valley: Exploring Adversarial Robustness from a Flatness Perspective27 May 2024
- 2024Defensive Unlearning with Adversarial Training for Robust Concept Erasure in Diffusion Models24 May 2024
- 2024Efficient Mitigation of Bus Bunching through Setter-Based Curriculum Learning23 May 2024
- 2024Robustness bounds on the successful adversarial examples in probabilistic models: Implications from Gaussian processes4 Mar 2024
- 2024Distilling Adversarial Robustness Using Heterogeneous Teachers23 Feb 2024
- 2024Better Representations via Adversarial Training in Pre-Training: A Theoretical Perspective26 Jan 2024
- 2024Adversarial Augmentation Training Makes Action Recognition Models More Robust to Realistic Video Distribution Shifts21 Jan 2024
- 2023Defenses in Adversarial Machine Learning: A Survey13 Dec 2023
- 2023Balance, Imbalance, and Rebalance: Understanding Robust Overfitting from a Minimax Game Perspective30 Oct 2023
- 2023Splitting the Difference on Adversarial Training3 Oct 2023
- 2023Understanding Robust Overfitting from the Feature Generalization Perspective1 Oct 2023
- 2023Reducing Adversarial Training Cost with Gradient Approximation18 Sep 2023
- 2023Adversarial Finetuning with Latent Representation Constraint to Mitigate Accuracy-Robustness Tradeoff31 Aug 2023
- 2023Advancing Adversarial Robustness Through Adversarial Logit Update29 Aug 2023
- 2023Revisiting and Exploring Efficient Fast Adversarial Training via LAW: Lipschitz Regularization and Auto Weight Averaging22 Aug 2023
- 2023An Adaptive Model Ensemble Adversarial Attack for Boosting Adversarial Transferability5 Aug 2023
- 2023Adversarial Training with Generated Data in High-Dimensional Regression: An Asymptotic Study21 Jun 2023
- 2023Enhance Diffusion to Improve Robust Generalization5 Jun 2023
- 2023Cross-Entropy Loss Functions: Theoretical Analysis and Applications14 Apr 2023
- 2023CFA: Class-wise Calibrated Fair Adversarial Training25 Mar 2023
- 2023Feature Separation and Recalibration for Adversarial Robustness24 Mar 2023
- 2023Less is More: Data Pruning for Faster Adversarial Training23 Feb 2023
- 2023Beckman Defense4 Jan 2023
- 2022Certifying Safety in Reinforcement Learning under Adversarial Perturbation Attacks28 Dec 2022
- 2022Adversarial Training with Complementary Labels: On the Benefit of Gradually Informative Attacks1 Nov 2022
- 2022Efficient and Effective Augmentation Strategy for Adversarial Training27 Oct 2022
- 2022Strength-Adaptive Adversarial Training4 Oct 2022
- 2022Improving Out-of-Distribution Detection via Epistemic Uncertainty Adversarial Training5 Sep 2022
- 2022Perception-Aware Attack: Creating Adversarial Music via Reverse-Engineering Human Perception26 Jul 2022
- 2022SegPGD: An Effective and Efficient Adversarial Attack for Evaluating and Boosting Segmentation Robustness25 Jul 2022
- 2022AdAUC: End-to-end Adversarial AUC Optimization Against Long-tail Problems24 Jun 2022
50 newest of 89 All 89 (JSON)
- 2021Recent Advances in Adversarial Training for Adversarial Robustnesscited by 276
- 2023Cross-Entropy Loss Functions: Theoretical Analysis and Applicationscited by 206
- 2021On the Convergence and Robustness of Adversarial Trainingcited by 127
- 2022LAS-AT: Adversarial Training with Learnable Attack Strategycited by 94
- 2022SegPGD: An Effective and Efficient Adversarial Attack for Evaluating and Boosting Segmentation Robustnesscited by 74
- 2021Better Safe Than Sorry: Preventing Delusive Adversaries with Adversarial Trainingcited by 58
- 2021Reliable Adversarial Distillation with Unreliable Teacherscited by 55
- 2023CFA: Class-wise Calibrated Fair Adversarial Trainingcited by 53
- 2022Understanding Robust Overfitting of Adversarial Training and Beyondcited by 50
- 2021Accelerating Deep Learning with Dynamic Data Pruningcited by 43
- 2022Efficient and Effective Augmentation Strategy for Adversarial Trainingcited by 43
- 2023An Adaptive Model Ensemble Adversarial Attack for Boosting Adversarial Transferabilitycited by 42
12 most cited of 88 All 88 (JSON)
- 2026Towards One-for-All Robustness Across a Continuum of Threat Levels2 Sep 2026
- 2026Towards Domain-Generalized Open-Vocabulary Object Detection: A Progressive Domain-invariant Cross-modal Alignment Method29 Mar 2026
- 2026Higher-Order Adversarial Patches for Real-Time Object Detectors8 Jan 2026
- 2025When Flatness Does (Not) Guarantee Adversarial Robustness16 Oct 2025
- 2025Test-Time Defense Against Adversarial Attacks via Stochastic Resonance of Latent Ensembles3 Oct 2025
- 2025Robust Fine-Tuning from Non-Robust Pretrained Models: Mitigating Suboptimal Transfer With Epsilon-Scheduling27 Sep 2025
- 2025SOLAR: Switchable Output Layer for Accuracy and Robustness in Once-for-All Training20 Sep 2025
- 2025A Single-Point Measurement Framework for Robust Cyber-Attack Diagnosis in Smart Microgrids Using Dual Fractional-Order Feature Analysis9 Jul 2025
- 2025Learning to Fuse: Modality-Aware Adaptive Scheduling for Robust Multimodal Foundation Models15 Jun 2025
- 2025Ignition Phase : Standard Training for Fast Adversarial Robustness25 May 2025
- 2025How to Enhance Downstream Adversarial Robustness (almost) without Touching the Pre-Trained Foundation Model?15 Apr 2025
- 2025Dynamic Obstacle Avoidance with Bounded Rationality Adversarial Reinforcement Learning14 Mar 2025
12 newest of 88 All 88 (JSON)