Boosting Adversarial Training with Hypersphere Embedding
Not on the map. Why?
Abstract (arXiv)
Adversarial training (AT) is one of the most effective defenses against adversarial attacks for deep learning models. In this work, we advocate incorporating the hypersphere embedding (HE) mechanism into the AT procedure by regularizing the features onto compact manifolds, which constitutes a lightweight yet effective module to blend in the strength of representation learning. Our extensive analyses reveal that AT and HE are well coupled to benefit the robustness of the adversarially trained models from several aspects. We validate the effectiveness and adaptability of HE by embedding it into the popular AT frameworks including PGD-AT, ALP, and TRADES, as well as the FreeAT and FastAT strategies. In the experiments, we evaluate our methods under a wide range of adversarial attacks on the CIFAR-10 and ImageNet datasets, which verifies that integrating HE can consistently enhance the model robustness for each AT framework with little extra computation.
Key facts. Cited by 97 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Feb 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 31; 2022: 24; 2023: 20; 2024: 13; 2025: 8; 2026: 1.
97 papers.
Sort:
By area:
- 2021Recent Advances in Adversarial Training for Adversarial Robustnesscited by 276
- 2021Improving Robustness using Generated Datacited by 233
- 2023Better Diffusion Models Further Improve Adversarial Trainingcited by 207
- 2023Cross-Entropy Loss Functions: Theoretical Analysis and Applicationscited by 206
- 2021Fixing Data Augmentation to Improve Adversarial Robustnesscited by 201
- 2021Data Augmentation Can Improve Robustnesscited by 193
- 2021Investigating Bi-Level Optimization for Learning and Vision from a Unified Perspective: A Survey and Beyondcited by 151
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2022Robustness and Accuracy Could Be Reconcilable by (Proper) Definitioncited by 109
- 2022LAS-AT: Adversarial Training with Learnable Attack Strategycited by 94
- 2021Exploring Architectural Ingredients of Adversarially Robust Deep Neural Networkscited by 73
- 2021Relating Adversarially Robust Generalization to Flat Minimacited by 57
38 more
- 2021Adversarial Robustness under Long-Tailed Distributioncited by 50
- 2022Practical Evaluation of Adversarial Robustness via Adaptive Auto Attackcited by 44
- 2021CausalAdv: Adversarial Robustness through the Lens of Causalitycited by 37
- 2022Prior-Guided Adversarial Initialization for Fast Adversarial Trainingcited by 34
- 2023Improving Fast Adversarial Training with Prior-Guided Knowledgecited by 34
- 2021Exploring Misclassifications of Robust Neural Networks to Enhance Adversarial Attackscited by 33
- 2021Analysis and Applications of Class-wise Robustness in Adversarial Trainingcited by 33
- 2022Enhancing Diffusion-Based Image Synthesis with Robust Classifier Guidancecited by 33
- 2022DISCO: Adversarial Defense with Local Implicit Functionscited by 33
- 2021Attacking Adversarial Attacks as A Defensecited by 31
- 2023Towards Trustworthy and Aligned Machine Learning: A Data-centric Survey with Causality Perspectivescited by 30
- 2021Low Curvature Activations Reduce Overfitting in Adversarial Trainingcited by 29
- 2021A Review of Adversarial Attack and Defense for Classification Methodscited by 29
- 2022Robust Models are less Over-Confidentcited by 25
- 2021LAFEAT: Piercing Through Adversarial Defenses with Latent Featurescited by 24
- 2023Language-Driven Anchors for Zero-Shot Adversarial Robustnesscited by 23
- 2021Adaptive Image Transformations for Transfer-based Adversarial Attackcited by 22
- 2022CNN Filter DB: An Empirical Investigation of Trained Convolutional Filterscited by 20
- 2022Revisiting adapters with adversarial trainingcited by 18
- 2022Recognizing Object by Components with Human Prior Knowledge Enhances Adversarial Robustness of Deep Neural Networkscited by 18
- 2022Do Perceptually Aligned Gradients Imply Adversarial Robustness?cited by 15
- 2021Two Coupled Rejection Metrics Can Tell Adversarial Examples Apartcited by 14
- 2025PreGenie: An Agentic Framework for High-quality Visual Presentation Generationcited by 14
- 2021LTD: Low Temperature Distillation for Gradient Masking-free Adversarial Trainingcited by 13
- 2024Revisiting Adversarial Training under Long-Tailed Distributionscited by 13
- 2022Improving Robustness by Enhancing Weak Subnetscited by 12
- 2022Rethinking Bayesian Learning for Data Analysis: The Art of Prior and Inference in Sparsity-Aware Modelingcited by 12
- 2021Stochastic Local Winner-Takes-All Networks Enable Profound Adversarial Robustnesscited by 11
- 2022Diversified Adversarial Attacks based on Conjugate Gradient Methodcited by 11
- 2021Accumulative Poisoning Attacks on Real-time Datacited by 10
- 2021MixACM: Mixup-Based Robustness Transfer via Distillation of Activated Channel Mapscited by 9
- 2022Adversarial Robustness through the Lens of Convolutional Filterscited by 9
- 2022How many perturbations break this model? Evaluating robustness beyond adversarial accuracycited by 9
- 2023It Is All About Data: A Survey on the Effects of Data on Adversarial Robustnesscited by 9
- 2023Improving Adversarial Robust Fairness via Anti-Bias Soft Label Distillationcited by 8
- 2021Domain Invariant Adversarial Learningcited by 7
- 2023HateProof: Are Hateful Meme Detection Systems really Robust?cited by 7
- 2021Adaptive Perturbation for Adversarial Attackcited by 6
50 most cited of 97 All 97 (JSON)
- 2026Dummy-Aware Weighted Attack (DAWA): Breaking the Safe Sink in Dummy Class Defenses31 Mar 2026
- 2025Sharpness-Aware Geometric Defense for Robust Out-Of-Distribution Detection24 Aug 2025
- 2025RCR-AF: Enhancing Model Generalization via Rademacher Complexity Reduction Activation Function30 Jul 2025
- 2025Theoretical Analysis of Relative Errors in Gradient Computations for Adversarial Attacks with CE Loss30 Jul 2025
- 2025Towards Class-wise Fair Adversarial Training via Anti-Bias Soft Label Distillation10 Jun 2025
- 2025PreGenie: An Agentic Framework for High-quality Visual Presentation Generation27 May 2025
- 2025Deep Positive-Negative Prototypes for Adversarially Robust Discriminative Prototypical Learning3 Apr 2025
- 2025TAET: Two-Stage Adversarial Equalization Training on Long-Tailed Distributions2 Mar 2025
- 2025Information-Geometric Inverse Distillation for Enhancing Adversarial Transferability24 Feb 2025
- 2024Standard-Deviation-Inspired Regularization for Improving Adversarial Robustness27 Dec 2024
- 2024Towards Class-wise Robustness Analysis29 Nov 2024
- 2024Learning Fair Robustness via Domain Mixup21 Nov 2024
38 more
- 2024FAIR-TAT: Improving Model Fairness Using Targeted Adversarial Training30 Oct 2024
- 2024Adversarial Training: A Survey19 Oct 2024
- 2024Improving Fast Adversarial Training via Self-Knowledge Guidance26 Sep 2024
- 2024Learning Multi-Manifold Embedding for Out-Of-Distribution Detection19 Sep 2024
- 2024Disentangled Training with Adversarial Examples For Robust Small-footprint Keyword Spotting23 Aug 2024
- 2024Toward Improving Synthetic Audio Spoofing Detection Robustness via Meta-Learning and Disentangled Training With Adversarial Examples23 Aug 2024
- 2024Batch-in-Batch: a new adversarial training framework for initial perturbation and sample selection6 Jun 2024
- 2024On adversarial training and the 1 Nearest Neighbor classifier9 Apr 2024
- 2024Revisiting Adversarial Training under Long-Tailed Distributions15 Mar 2024
- 2024Improving Adversarial Training using Vulnerability-Aware Perturbation Budget6 Mar 2024
- 2023Collapse-Aware Triplet Decoupling for Adversarially Robust Image Retrieval12 Dec 2023
- 2023Improving Adversarial Robust Fairness via Anti-Bias Soft Label Distillation9 Dec 2023
- 2023Fast Certification of Vision-Language Models Using Incremental Randomized Smoothing15 Nov 2023
- 2023OODRobustBench: a Benchmark and Large-Scale Analysis of Adversarial Robustness under Distribution Shift19 Oct 2023
- 2023IRAD: Implicit Representation-driven Image Resampling against Adversarial Attacks18 Oct 2023
- 2023Hard Adversarial Example Mining for Improving Robust Fairness3 Aug 2023
- 2023Towards Trustworthy and Aligned Machine Learning: A Data-centric Survey with Causality Perspectives31 Jul 2023
- 2023Vulnerability-Aware Instance Reweighting For Adversarial Training14 Jul 2023
- 2023Cooperation or Competition: Avoiding Player Domination for Multi-Target Robustness via Adaptive Budgets27 Jun 2023
- 2023Revisiting and Advancing Adversarial Training Through A Simple Baseline13 Jun 2023
- 2023Wavelets Beat Monkeys at Adversarial Robustness19 Apr 2023
- 2023Cross-Entropy Loss Functions: Theoretical Analysis and Applications14 Apr 2023
- 2023Improving Fast Adversarial Training with Prior-Guided Knowledge1 Apr 2023
- 2023CAT:Collaborative Adversarial Training27 Mar 2023
- 2023It Is All About Data: A Survey on the Effects of Data on Adversarial Robustness17 Mar 2023
- 2023Improving Adversarial Robustness with Hypersphere Embedding and Angular-based Regularizations15 Mar 2023
- 2023HateProof: Are Hateful Meme Detection Systems really Robust?11 Feb 2023
- 2023Better Diffusion Models Further Improve Adversarial Training9 Feb 2023
- 2023Language-Driven Anchors for Zero-Shot Adversarial Robustness30 Jan 2023
- 2023DODEM: DOuble DEfense Mechanism Against Adversarial Attacks Towards Secure Industrial Internet of Things Analytics23 Jan 2023
- 2022DISCO: Adversarial Defense with Local Implicit Functions11 Dec 2022
- 2022Recognizing Object by Components with Human Prior Knowledge Enhances Adversarial Robustness of Deep Neural Networks4 Dec 2022
- 2022Reliable Robustness Evaluation via Automatically Constructed Attack Ensembles23 Nov 2022
- 2022Improving Adversarial Robustness with Self-Paced Hard-Class Pair Reweighting26 Oct 2022
- 2022Robust Models are less Over-Confident12 Oct 2022
- 2022Boosting Adversarial Robustness From The Perspective of Effective Margin Regularization11 Oct 2022
- 2022Revisiting adapters with adversarial training10 Oct 2022
- 2022Learning Robust Kernel Ensembles with Kernel Average Pooling30 Sep 2022
50 newest of 97 All 97 (JSON)
- 2021Recent Advances in Adversarial Training for Adversarial Robustnesscited by 276
- 2021Improving Robustness using Generated Datacited by 233
- 2023Cross-Entropy Loss Functions: Theoretical Analysis and Applicationscited by 206
- 2021Fixing Data Augmentation to Improve Adversarial Robustnesscited by 201
- 2021Data Augmentation Can Improve Robustnesscited by 193
- 2021Investigating Bi-Level Optimization for Learning and Vision from a Unified Perspective: A Survey and Beyondcited by 151
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2022Robustness and Accuracy Could Be Reconcilable by (Proper) Definitioncited by 109
- 2022LAS-AT: Adversarial Training with Learnable Attack Strategycited by 94
- 2021Exploring Architectural Ingredients of Adversarially Robust Deep Neural Networkscited by 73
- 2021Relating Adversarially Robust Generalization to Flat Minimacited by 57
- 2021Adversarial Robustness under Long-Tailed Distributioncited by 50
12 most cited of 92 All 92 (JSON)
- 2026Dummy-Aware Weighted Attack (DAWA): Breaking the Safe Sink in Dummy Class Defenses31 Mar 2026
- 2025Sharpness-Aware Geometric Defense for Robust Out-Of-Distribution Detection24 Aug 2025
- 2025RCR-AF: Enhancing Model Generalization via Rademacher Complexity Reduction Activation Function30 Jul 2025
- 2025Theoretical Analysis of Relative Errors in Gradient Computations for Adversarial Attacks with CE Loss30 Jul 2025
- 2025Towards Class-wise Fair Adversarial Training via Anti-Bias Soft Label Distillation10 Jun 2025
- 2025Deep Positive-Negative Prototypes for Adversarially Robust Discriminative Prototypical Learning3 Apr 2025
- 2025TAET: Two-Stage Adversarial Equalization Training on Long-Tailed Distributions2 Mar 2025
- 2025Information-Geometric Inverse Distillation for Enhancing Adversarial Transferability24 Feb 2025
- 2024Standard-Deviation-Inspired Regularization for Improving Adversarial Robustness27 Dec 2024
- 2024Towards Class-wise Robustness Analysis29 Nov 2024
- 2024Learning Fair Robustness via Domain Mixup21 Nov 2024
- 2024FAIR-TAT: Improving Model Fairness Using Targeted Adversarial Training30 Oct 2024
12 newest of 92 All 92 (JSON)