CFA: Class-wise Calibrated Fair Adversarial Training
Not on the map. Why?
Abstract (arXiv)
Adversarial training has been widely acknowledged as the most effective method to improve the adversarial robustness against adversarial examples for Deep Neural Networks (DNNs). So far, most existing works focus on enhancing the overall model robustness, treating each class equally in both the training and testing phases. Although revealing the disparity in robustness among classes, few works try to make adversarial training fair at the class level without sacrificing overall robustness. In this paper, we are the first to theoretically and empirically investigate the preference of different classes for adversarial configurations, including perturbation margin, regularization, and weight averaging. Motivated by this, we further propose a Class-wise calibrated Fair Adversarial training framework, named CFA, which customizes specific training configurations for each class automatically. Experiments on benchmark datasets demonstrate that our proposed CFA can improve both overall robustness and fairness notably over other state-of-the-art methods. Code is available at urlhttps://github.com/PKU-ML/CFA.
Key facts. Cited by 53 papers in the map (data through 14 Oct 2026). Builds on 28 of its 32 references that are in the map. First posted on arXiv 25 Mar 2023.
Builds on
28 of 32 references.
References · 28
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2013Intriguing properties of neural networkscited by 5,155
- 2016Identity Mappings in Deep Residual Networkscited by 1,965
- 2019Theoretically Principled Trade-off between Robustness and Accuracycited by 1,517
- 2020Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attackscited by 1,451
- 2018Obfuscated Gradients Give a False Sense of Security: Circumventing Defenses to Adversarial Examplescited by 1,268
- 2018Averaging Weights Leads to Wider Optima and Better Generalizationcited by 1,209
- 2018Robustness May Be at Odds with Accuracycited by 880
- 2015Distillation as a Defense to Adversarial Perturbations against Deep Neural Networkscited by 678
- 2020Overfitting in adversarially robust deep learningcited by 506
- 2018Feature Denoising for Improving Adversarial Robustnesscited by 314
16 more
- 2020Attacks Which Do Not Kill Training Make Adversarial Learning Strongercited by 243
- 2015DeepDriving: Learning Affordance for Direct Perception in Autonomous Drivingcited by 231
- 2020Geometry-aware Instance-reweighted Adversarial Trainingcited by 198
- 2018MMA Training: Direct Input Space Margin Maximization through Adversarial Trainingcited by 172
- 2019Understanding Adversarial Attacks on Deep Learning Based Medical Image Analysis Systemscited by 153
- 2020To be Robust or to be Fair: Towards Fairness in Adversarial Trainingcited by 137
- 2021On the Convergence and Robustness of Adversarial Trainingcited by 130
- 2018Curriculum Adversarial Trainingcited by 89
- 2017Keeping the Bad Guys Out: Protecting and Vaccinating Deep Learning with JPEG Compressioncited by 87
- 2022When Adversarial Training Meets Vision Transformers: Recipes from Training to Architecturecited by 64
- 2020CAT: Customized Adversarial Training for Improved Robustnesscited by 61
- 2019Instance adaptive adversarial training: Improved accuracy tradeoffs in neural netscited by 55
- 2020Robustness May Be at Odds with Fairness: An Empirical Study on Class-wise Accuracycited by 45
- 2022Self-Ensemble Adversarial Training for Improved Robustnesscited by 38
- 2021Analysis and Applications of Class-wise Robustness in Adversarial Trainingcited by 33
- 2023Generalist: Decoupling Natural and Robust Generalizationcited by 14
Built on by
Citing papers per year: 2023: 9; 2024: 23; 2025: 15; 2026: 6.
53 papers.
Sort:
By area:
- 2023Robust Classification via a Single Diffusion Modelcited by 79
- 2024Fight Back Against Jailbreaking via Prompt Adversarial Tuningcited by 67
- 2024On the Duality Between Sharpness-Aware Minimization and Adversarial Trainingcited by 24
- 2023Balance, Imbalance, and Rebalance: Understanding Robust Overfitting from a Minimax Game Perspectivecited by 18
- 2023Adversarial Examples Are Not Real Featurescited by 16
- 2023Sharpness-Aware Minimization Alone can Improve Adversarial Robustnesscited by 14
- 2024Exploring the Robustness of In-Context Learning with Noisy Labelscited by 14
- 2024Revisiting Adversarial Training under Long-Tailed Distributionscited by 13
- 2024Adversarial Representation Engineering: A General Model Editing Framework for Large Language Modelscited by 12
- 2024DAFA: Distance-Aware Fair Adversarial Trainingcited by 11
- 2024Towards Fairness-Aware Adversarial Learningcited by 11
- 2024Robustly Optimized Deep Feature Decoupling Network for Fatty Liver Diseases Detectioncited by 11
38 more
- 2025Enhancing Robust Fairness via Confusional Spectral Regularizationcited by 11
- 2025Fast Adversarial Training with Weak-to-Strong Spatial-Temporal Consistency in the Frequency Domain on Videoscited by 9
- 2023Improving Adversarial Robust Fairness via Anti-Bias Soft Label Distillationcited by 8
- 2023Indirect Gradient Matching for Adversarial Robust Distillationcited by 6
- 2024Robust Overfitting Does Matter: Test-Time Adversarial Purification With FGSMcited by 6
- 2023Diffused Redundancy in Pre-trained Representationscited by 5
- 2024Towards Adversarial Robustness via Debiased High-Confidence Logit Alignmentcited by 5
- 2024FAIR-TAT: Improving Model Fairness Using Targeted Adversarial Trainingcited by 5
- 2025Long-tailed Adversarial Training with Self-Distillationcited by 5
- 2023Generating Less Certain Adversarial Examples Improves Robust Generalizationcited by 3
- 2024Exploring Frequencies via Feature Mixing and Meta-Learning for Improving Adversarial Transferabilitycited by 3
- 2024Mitigating Low-Frequency Bias: Feature Recalibration and Frequency Attention Regularization for Adversarial Robustnesscited by 3
- 2024Interpretability-Guided Test-Time Adversarial Defensecited by 3
- 2024Towards Class-wise Robustness Analysiscited by 3
- 2026FragileFlow: Spectral Control of Correct-but-Fragile Predictions for Foundation Model Robustnesscited by 3
- 2024Improving Fast Adversarial Training via Self-Knowledge Guidancecited by 2
- 2024New Paradigm of Adversarial Training: Releasing Accuracy-Robustness Trade-Off via Dummy Classcited by 2
- 2024Combining Machine Learning Defenses without Conflictscited by 2
- 2025Towards Fair Class-wise Robustness: Class Optimal Distribution Adversarial Trainingcited by 2
- 2025An Investigation of Visual Foundation Models Robustnesscited by 2
- 2023Enhancing Adversarial Attacks: The Similar Target Methodcited by 1
- 2024Improving Adversarial Training using Vulnerability-Aware Perturbation Budgetcited by 1
- 2024On the Adversarial Transferability of Generalized "Skip Connections"cited by 1
- 2025Parameter Interpolation Adversarial Training for Robust Image Classificationcited by 1
- 2026Taming the Long Tail: Rebalancing Adversarial Training via Adaptive Perturbationcited by 1
- 2024Towards Trustworthy Unsupervised Domain Adaptation: A Representation Learning Perspective for Enhancing Robustness, Discrimination, and Generalizationcited by 0
- 2024Improving Fast Adversarial Training Paradigm: An Example Taxonomy Perspectivecited by 0
- 2024Unrevealed Threats: A Comprehensive Study of the Adversarial Robustness of Underwater Image Enhancement Modelscited by 0
- 2025Improving Adversarial Robustness via Phase and Amplitude-aware Promptingcited by 0
- 2025Principal Eigenvalue Regularization for Improved Worst-Class Certified Robustness of Smoothed Classifierscited by 0
- 2025Identifying and Understanding Cross-Class Features in Adversarial Trainingcited by 0
- 2025Towards Class-wise Fair Adversarial Training via Anti-Bias Soft Label Distillationcited by 0
- 2025TRIX- Trading Adversarial Fairness via Mixed Adversarial Trainingcited by 0
- 2025Sy-FAR: Symmetry-based Fair Adversarial Robustnesscited by 0
- 2025Revisiting Adversarial Training under Hyperspectral Imagecited by 0
- 2025Stabilizing Multi-Attack Adversarial Training via Bandit Optimizationcited by 0
- 2025Sample-wise Adaptive Weighting for Transfer Consistency in Adversarial Distillationcited by 0
- 2026Adaptive Causal Alignment for High-Confidence Adversarial Trainingcited by 0
50 most cited of 53 All 53 (JSON)
- 2026RL-FAT: Reinforcement Learning for Fair Adversarial Training29 Aug 2026
- 2026Confusion-Geometry Rebalancing for Long-Tailed Adversarial Training10 Aug 2026
- 2026Improving Adversarial Robustness via Activation Amplification and Attenuation26 Jun 2026
- 2026Adaptive Causal Alignment for High-Confidence Adversarial Training2 Jun 2026
- 2026Taming the Long Tail: Rebalancing Adversarial Training via Adaptive Perturbation13 May 2026
- 2026FragileFlow: Spectral Control of Correct-but-Fragile Predictions for Foundation Model Robustness9 May 2026
- 2025Sample-wise Adaptive Weighting for Transfer Consistency in Adversarial Distillation11 Dec 2025
- 2025Stabilizing Multi-Attack Adversarial Training via Bandit Optimization15 Nov 2025
- 2025Parameter Interpolation Adversarial Training for Robust Image Classification2 Nov 2025
- 2025Revisiting Adversarial Training under Hyperspectral Image1 Oct 2025
- 2025Sy-FAR: Symmetry-based Fair Adversarial Robustness16 Sep 2025
- 2025An Investigation of Visual Foundation Models Robustness22 Aug 2025
38 more
- 2025TRIX- Trading Adversarial Fairness via Mixed Adversarial Training10 Jul 2025
- 2025Towards Class-wise Fair Adversarial Training via Anti-Bias Soft Label Distillation10 Jun 2025
- 2025Identifying and Understanding Cross-Class Features in Adversarial Training5 Jun 2025
- 2025Fast Adversarial Training with Weak-to-Strong Spatial-Temporal Consistency in the Frequency Domain on Videos21 Apr 2025
- 2025Principal Eigenvalue Regularization for Improved Worst-Class Certified Robustness of Smoothed Classifiers21 Mar 2025
- 2025Long-tailed Adversarial Training with Self-Distillation9 Mar 2025
- 2025Improving Adversarial Robustness via Phase and Amplitude-aware Prompting6 Feb 2025
- 2025Enhancing Robust Fairness via Confusional Spectral Regularization22 Jan 2025
- 2025Towards Fair Class-wise Robustness: Class Optimal Distribution Adversarial Training8 Jan 2025
- 2024Towards Class-wise Robustness Analysis29 Nov 2024
- 2024Combining Machine Learning Defenses without Conflicts14 Nov 2024
- 2024FAIR-TAT: Improving Model Fairness Using Targeted Adversarial Training30 Oct 2024
- 2024New Paradigm of Adversarial Training: Releasing Accuracy-Robustness Trade-Off via Dummy Class16 Oct 2024
- 2024On the Adversarial Transferability of Generalized "Skip Connections"11 Oct 2024
- 2024Improving Fast Adversarial Training via Self-Knowledge Guidance26 Sep 2024
- 2024Interpretability-Guided Test-Time Adversarial Defense23 Sep 2024
- 2024Unrevealed Threats: A Comprehensive Study of the Adversarial Robustness of Underwater Image Enhancement Models10 Sep 2024
- 2024Towards Adversarial Robustness via Debiased High-Confidence Logit Alignment12 Aug 2024
- 2024Improving Fast Adversarial Training Paradigm: An Example Taxonomy Perspective22 Jul 2024
- 2024Mitigating Low-Frequency Bias: Feature Recalibration and Frequency Attention Regularization for Adversarial Robustness4 Jul 2024
- 2024Robustly Optimized Deep Feature Decoupling Network for Fatty Liver Diseases Detection25 Jun 2024
- 2024Towards Trustworthy Unsupervised Domain Adaptation: A Representation Learning Perspective for Enhancing Robustness, Discrimination, and Generalization19 Jun 2024
- 2024Exploring Frequencies via Feature Mixing and Meta-Learning for Improving Adversarial Transferability6 May 2024
- 2024Exploring the Robustness of In-Context Learning with Noisy Labels28 Apr 2024
- 2024Adversarial Representation Engineering: A General Model Editing Framework for Large Language Models21 Apr 2024
- 2024Robust Overfitting Does Matter: Test-Time Adversarial Purification With FGSM18 Mar 2024
- 2024Revisiting Adversarial Training under Long-Tailed Distributions15 Mar 2024
- 2024Improving Adversarial Training using Vulnerability-Aware Perturbation Budget6 Mar 2024
- 2024Towards Fairness-Aware Adversarial Learning27 Feb 2024
- 2024On the Duality Between Sharpness-Aware Minimization and Adversarial Training23 Feb 2024
- 2024Fight Back Against Jailbreaking via Prompt Adversarial Tuning9 Feb 2024
- 2024DAFA: Distance-Aware Fair Adversarial Training23 Jan 2024
- 2023Improving Adversarial Robust Fairness via Anti-Bias Soft Label Distillation9 Dec 2023
- 2023Indirect Gradient Matching for Adversarial Robust Distillation6 Dec 2023
- 2023Balance, Imbalance, and Rebalance: Understanding Robust Overfitting from a Minimax Game Perspective30 Oct 2023
- 2023Adversarial Examples Are Not Real Features29 Oct 2023
- 2023Generating Less Certain Adversarial Examples Improves Robust Generalization6 Oct 2023
- 2023Enhancing Adversarial Attacks: The Similar Target Method21 Aug 2023
50 newest of 53 All 53 (JSON)
- 2026RL-FAT: Reinforcement Learning for Fair Adversarial Training29 Aug 2026
- 2023Robust Classification via a Single Diffusion Modelcited by 79
- 2023Robust Classification via a Single Diffusion Model24 May 2023
- 2025Long-tailed Adversarial Training with Self-Distillationcited by 5
- 2025Long-tailed Adversarial Training with Self-Distillation9 Mar 2025
- 2024On the Duality Between Sharpness-Aware Minimization and Adversarial Trainingcited by 24
- 2023Balance, Imbalance, and Rebalance: Understanding Robust Overfitting from a Minimax Game Perspectivecited by 18
- 2023Adversarial Examples Are Not Real Featurescited by 16
- 2023Sharpness-Aware Minimization Alone can Improve Adversarial Robustnesscited by 14
- 2024Exploring the Robustness of In-Context Learning with Noisy Labelscited by 14
- 2024Revisiting Adversarial Training under Long-Tailed Distributionscited by 13
- 2024DAFA: Distance-Aware Fair Adversarial Trainingcited by 11
- 2024Towards Fairness-Aware Adversarial Learningcited by 11
- 2024Robustly Optimized Deep Feature Decoupling Network for Fatty Liver Diseases Detectioncited by 11
- 2025Enhancing Robust Fairness via Confusional Spectral Regularizationcited by 11
- 2025Fast Adversarial Training with Weak-to-Strong Spatial-Temporal Consistency in the Frequency Domain on Videoscited by 9
- 2023Improving Adversarial Robust Fairness via Anti-Bias Soft Label Distillationcited by 8
12 most cited of 47 All 47 (JSON)
- 2026Confusion-Geometry Rebalancing for Long-Tailed Adversarial Training10 Aug 2026
- 2026Improving Adversarial Robustness via Activation Amplification and Attenuation26 Jun 2026
- 2026Adaptive Causal Alignment for High-Confidence Adversarial Training2 Jun 2026
- 2026Taming the Long Tail: Rebalancing Adversarial Training via Adaptive Perturbation13 May 2026
- 2026FragileFlow: Spectral Control of Correct-but-Fragile Predictions for Foundation Model Robustness9 May 2026
- 2025Sample-wise Adaptive Weighting for Transfer Consistency in Adversarial Distillation11 Dec 2025
- 2025Stabilizing Multi-Attack Adversarial Training via Bandit Optimization15 Nov 2025
- 2025Parameter Interpolation Adversarial Training for Robust Image Classification2 Nov 2025
- 2025Revisiting Adversarial Training under Hyperspectral Image1 Oct 2025
- 2025Sy-FAR: Symmetry-based Fair Adversarial Robustness16 Sep 2025
- 2025An Investigation of Visual Foundation Models Robustness22 Aug 2025
- 2025TRIX- Trading Adversarial Fairness via Mixed Adversarial Training10 Jul 2025
12 newest of 47 All 47 (JSON)