MixBoost: Improving the Robustness of Deep Neural Networks by Boosting Data Augmentation
Not on the map. Why?
Abstract (arXiv)
As more and more artificial intelligence (AI) technologies move from the laboratory to real-world applications, the open-set and robustness challenges brought by data from the real world have received increasing attention. Data augmentation is a widely used method to improve model performance, and some recent works have also confirmed its positive effect on the robustness of AI models. However, most of the existing data augmentation methods are heuristic, lacking the exploration of their internal mechanisms. We apply the explainable artificial intelligence (XAI) method, explore the internal mechanisms of popular data augmentation methods, analyze the relationship between game interactions and some widely used robustness metrics, and propose a new proxy for model robustness in the open-set environment. Based on the analysis of the internal mechanisms, we develop a mask-based boosting method for data augmentation that comprehensively improves several robustness measures of AI models and beats state-of-the-art data augmentation approaches. Experiments show that our method can be widely applied to many popular data augmentation methods. Different from the adversarial training, our boosting method not only significantly improves the robustness of models, but also improves the accuracy of test sets. Our code is available at urlhttps://github.com/Anonymousforsubmission.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 49 of its 57 references that are in the map. First posted on arXiv 8 Dec 2022.
Builds on
49 of 57 references.
References · 49
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
- 2016Wide Residual Networkscited by 3,070
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,884
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,877
37 more
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
- 2013Describing Textures in the Wildcited by 2,125
- 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,850
- 2016Adversarial examples in the physical worldcited by 1,769
- 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,628
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,485
- 2020Sharpness-Aware Minimization for Efficiently Improving Generalizationcited by 1,417
- 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,396
- 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,355
- 2019AugMix: A Simple Data Processing Method to Improve Robustness and Uncertaintycited by 901
- 2018Robustness May Be at Odds with Accuracycited by 880
- 2019Big Transfer (BiT): General Visual Representation Learningcited by 769
- 2017One pixel attack for fooling deep neural networkscited by 582
- 2021CoAtNet: Marrying Convolution and Attention for All Data Sizescited by 569
- 2017Feature Squeezing: Detecting Adversarial Examples in Deep Neural Networkscited by 486
- 2020Generalized ODIN: Detecting Out-of-distribution Image without Learning from Out-of-distribution Datacited by 408
- 2019Using Pre-Training Can Improve Model Robustness and Uncertaintycited by 373
- 2021On the Importance of Gradients for Detecting Distributional Shifts in the Wildcited by 339
- 2019A Fourier Perspective on Model Robustness in Computer Visioncited by 288
- 2021TrivialAugment: Tuning-free Yet State-of-the-Art Data Augmentationcited by 227
- 2022Understanding The Robustness in Vision Transformerscited by 144
- 2021Towards Robust Vision Transformercited by 137
- 2021PixMix: Dreamlike Pictures Comprehensively Improve Safety Measurescited by 131
- 2018A Kernel Theory of Modern Data Augmentationcited by 106
- 2019Improving Robustness Without Sacrificing Accuracy with Patch Gaussian Augmentationcited by 105
- 2021On Interaction Between Augmentations and Corruptions in Natural Corruption Robustnesscited by 97
- 2018Data Augmentation by Pairing Samples for Images Classificationcited by 96
- 2015Posterior calibration and exploratory analysis for natural language processing modelscited by 76
- 2022Improving Vision Transformers by Revisiting High-frequency Componentscited by 76
- 2017Between-class Learning for Image Classificationcited by 50
- 2021Discovering and Explaining the Representation Bottleneck of DNNscited by 42
- 2021Pyramid Adversarial Training Improves ViT Performancecited by 39
- 2020Interpreting and Boosting Dropout from a Game-Theoretic Viewcited by 34
- 2020An Empirical Evaluation on Robustness and Uncertainty of Regularization Methodscited by 28
- 2022Sample Efficiency of Data Augmentation Consistency Regularizationcited by 28
- 2021A Geometric Perspective towards Neural Calibration via Sensitivity Decompositioncited by 19
- 2021A Unified Game-Theoretic Interpretation of Adversarial Robustnesscited by 17
Built on by
Not cited yet.