Adversarial Learning with Cost-Sensitive Classes
Not on the map. Why?
Abstract (arXiv)
It is necessary to improve the performance of some special classes or to particularly protect them from attacks in adversarial learning. This paper proposes a framework combining cost-sensitive classification and adversarial learning together to train a model that can distinguish between protected and unprotected classes, such that the protected classes are less vulnerable to adversarial examples. We find in this framework an interesting phenomenon during the training of deep neural networks, called Min-Max property, that is, the absolute values of most parameters in the convolutional layer approach zero while the absolute values of a few parameters are significantly larger becoming bigger. Based on this Min-Max property which is formulated and analyzed in a view of random distribution, we further build a new defense model against adversarial examples for adversarial robustness improvement. An advantage of the built model is that it performs better than the standard one and can combine with adversarial training to achieve an improved performance. It is experimentally confirmed that, regarding the average accuracy of all classes, our model is almost as same as the existing models when an attack does not occur and is better than the existing models when an attack occurs. Specifically, regarding the accuracy of protected classes, the proposed model is much better than the existing models when an attack occurs.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 35 of its 64 references that are in the map. First posted on arXiv 29 Jan 2021.
Builds on
35 of 64 references.
References · 35
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2013Intriguing properties of neural networkscited by 5,114
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,976
- 2019Theoretically Principled Trade-off between Robustness and Accuracycited by 1,510
- 2015DeepFool: a simple and accurate method to fool deep neural networkscited by 1,315
- 2018Obfuscated Gradients Give a False Sense of Security: Circumventing Defenses to Adversarial Examplescited by 1,259
- 2016Adversarial Machine Learning at Scalecited by 934
- 2017Ensemble Adversarial Training: Attacks and Defensescited by 833
- 2015The Limitations of Deep Learning in Adversarial Settingscited by 784
- 2017Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networkscited by 739
- 2020Fast is better than free: Revisiting adversarial trainingcited by 723
23 more
- 2015Distillation as a Defense to Adversarial Perturbations against Deep Neural Networkscited by 675
- 2019Adversarial Training for Free!cited by 638
- 2017Provable defenses against adversarial examples via the convex outer adversarial polytopecited by 564
- 2016Delving into Transferable Adversarial Examples and Black-box Attackscited by 530
- 2016Transferability in Machine Learning: from Phenomena to Black-Box Attacks using Adversarial Samplescited by 439
- 2018Certified Defenses against Adversarial Examplescited by 305
- 2017Generating Natural Adversarial Examplescited by 182
- 2019You Only Propagate Once: Accelerating Adversarial Training via Maximal Principlecited by 181
- 2018Understanding Measures of Uncertainty for Adversarial Example Detectioncited by 177
- 2019Adversarial Robustness through Local Linearizationcited by 146
- 2019Learning Graph Embedding with Adversarial Training Methodscited by 84
- 2017SafetyNet: Detecting and Rejecting Adversarial Examples Robustlycited by 76
- 2019advertorch v0.1: An Adversarial Robustness Toolbox based on PyTorchcited by 69
- 2015Learning with a Strong Adversarycited by 68
- 2020CAT: Customized Adversarial Training for Improved Robustnesscited by 61
- 2017Robustness to Adversarial Examples through an Ensemble of Specialistscited by 21
- 2019Improving Adversarial Robustness via Guided Complement Entropycited by 15
- 2019ROSA: Robust Salient Object Detection against Adversarial Attackscited by 10
- 2018Cost-Sensitive Robustness against Adversarial Examplescited by 9
- 2020Using Single-Step Adversarial Training to Defend Iterative Adversarial Examplescited by 9
- 2019Daedalus: Breaking Non-Maximum Suppression in Object Detection via Adversarial Examplescited by 8
- 2019Directional Adversarial Training for Cost Sensitive Deep Learning Classification Applicationscited by 3
- 2020A Study on the Uncertainty of Convolutional Layers in Deep Neural Networkscited by 2
Built on by
Citing papers per year: 2022: 1; 2023: 4; 2024: 1.
6 papers.
- 2024DD-RobustBench: An Adversarial Robustness Benchmark for Dataset Distillationcited by 8
- 2023Adversarial Attacks and Defenses in Machine Learning-Powered Networks: A Contemporary Surveycited by 5
- 2023Exploring Robust Features for Improving Adversarial Robustnesscited by 4
- 2023Transferable Adversarial Robustness for Categorical Data via Universal Robust Embeddingscited by 1
- 2023Topology-preserving Adversarial Training for Alleviating Natural Accuracy Degradationcited by 1
- 2022Rethinking Cost-sensitive Classification in Deep Learning via Adversarial Data Augmentationcited by 0
- 2024DD-RobustBench: An Adversarial Robustness Benchmark for Dataset Distillation20 Mar 2024
- 2023Topology-preserving Adversarial Training for Alleviating Natural Accuracy Degradation29 Nov 2023
- 2023Exploring Robust Features for Improving Adversarial Robustness9 Sep 2023
- 2023Transferable Adversarial Robustness for Categorical Data via Universal Robust Embeddings6 Jun 2023
- 2023Adversarial Attacks and Defenses in Machine Learning-Powered Networks: A Contemporary Survey11 Mar 2023
- 2022Rethinking Cost-sensitive Classification in Deep Learning via Adversarial Data Augmentation24 Aug 2022