mlsanityData to 14 Oct 2026

MixBoost: Improving the Robustness of Deep Neural Networks by Boosting Data Augmentation

arXiv 2212.04059 ↗First posted 8 Dec 2022cs.LG cs.AI cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

As more and more artificial intelligence (AI) technologies move from the laboratory to real-world applications, the open-set and robustness challenges brought by data from the real world have received increasing attention. Data augmentation is a widely used method to improve model performance, and some recent works have also confirmed its positive effect on the robustness of AI models. However, most of the existing data augmentation methods are heuristic, lacking the exploration of their internal mechanisms. We apply the explainable artificial intelligence (XAI) method, explore the internal mechanisms of popular data augmentation methods, analyze the relationship between game interactions and some widely used robustness metrics, and propose a new proxy for model robustness in the open-set environment. Based on the analysis of the internal mechanisms, we develop a mask-based boosting method for data augmentation that comprehensively improves several robustness measures of AI models and beats state-of-the-art data augmentation approaches. Experiments show that our method can be widely applied to many popular data augmentation methods. Different from the adversarial training, our boosting method not only significantly improves the robustness of models, but also improves the accuracy of test sets. Our code is available at urlhttps://github.com/Anonymousforsubmission.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 49 of its 57 references that are in the map. First posted on arXiv 8 Dec 2022.

Builds on

49 of 57 references.

References · 49

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  3. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  4. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  5. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
  6. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
  7. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
  8. 2017On Calibration of Modern Neural Networkscited by 4,960
  9. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
  10. 2016Wide Residual Networkscited by 3,070
  11. 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,884
  12. 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,877
37 more
  1. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
  2. 2013Describing Textures in the Wildcited by 2,125
  3. 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,850
  4. 2016Adversarial examples in the physical worldcited by 1,769
  5. 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,628
  6. 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,485
  7. 2020Sharpness-Aware Minimization for Efficiently Improving Generalizationcited by 1,417
  8. 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,396
  9. 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,355
  10. 2019AugMix: A Simple Data Processing Method to Improve Robustness and Uncertaintycited by 901
  11. 2018Robustness May Be at Odds with Accuracycited by 880
  12. 2019Big Transfer (BiT): General Visual Representation Learningcited by 769
  13. 2017One pixel attack for fooling deep neural networkscited by 582
  14. 2021CoAtNet: Marrying Convolution and Attention for All Data Sizescited by 569
  15. 2017Feature Squeezing: Detecting Adversarial Examples in Deep Neural Networkscited by 486
  16. 2020Generalized ODIN: Detecting Out-of-distribution Image without Learning from Out-of-distribution Datacited by 408
  17. 2019Using Pre-Training Can Improve Model Robustness and Uncertaintycited by 373
  18. 2021On the Importance of Gradients for Detecting Distributional Shifts in the Wildcited by 339
  19. 2019A Fourier Perspective on Model Robustness in Computer Visioncited by 288
  20. 2021TrivialAugment: Tuning-free Yet State-of-the-Art Data Augmentationcited by 227
  21. 2022Understanding The Robustness in Vision Transformerscited by 144
  22. 2021Towards Robust Vision Transformercited by 137
  23. 2021PixMix: Dreamlike Pictures Comprehensively Improve Safety Measurescited by 131
  24. 2018A Kernel Theory of Modern Data Augmentationcited by 106
  25. 2019Improving Robustness Without Sacrificing Accuracy with Patch Gaussian Augmentationcited by 105
  26. 2021On Interaction Between Augmentations and Corruptions in Natural Corruption Robustnesscited by 97
  27. 2018Data Augmentation by Pairing Samples for Images Classificationcited by 96
  28. 2015Posterior calibration and exploratory analysis for natural language processing modelscited by 76
  29. 2022Improving Vision Transformers by Revisiting High-frequency Componentscited by 76
  30. 2017Between-class Learning for Image Classificationcited by 50
  31. 2021Discovering and Explaining the Representation Bottleneck of DNNscited by 42
  32. 2021Pyramid Adversarial Training Improves ViT Performancecited by 39
  33. 2020Interpreting and Boosting Dropout from a Game-Theoretic Viewcited by 34
  34. 2020An Empirical Evaluation on Robustness and Uncertainty of Regularization Methodscited by 28
  35. 2022Sample Efficiency of Data Augmentation Consistency Regularizationcited by 28
  36. 2021A Geometric Perspective towards Neural Calibration via Sensitivity Decompositioncited by 19
  37. 2021A Unified Game-Theoretic Interpretation of Adversarial Robustnesscited by 17

Built on by

Not cited yet.