A Survey of Neural Network Robustness Assessment in Image Recognition
Not on the map. Why?
Abstract (arXiv)
In recent years, there has been significant attention given to the robustness assessment of neural networks. Robustness plays a critical role in ensuring reliable operation of artificial intelligence (AI) systems in complex and uncertain environments. Deep learning's robustness problem is particularly significant, highlighted by the discovery of adversarial attacks on image classification models. Researchers have dedicated efforts to evaluate robustness in diverse perturbation conditions for image recognition tasks. Robustness assessment encompasses two main techniques: robustness verification/ certification for deliberate adversarial attacks and robustness testing for random data corruptions. In this survey, we present a detailed examination of both adversarial robustness (AR) and corruption robustness (CR) in neural network assessment. Analyzing current research papers and standards, we provide an extensive overview of robustness assessment in image recognition. Three essential aspects are analyzed: concepts, metrics, and assessment methods. We investigate the perturbation metrics and range representations used to measure the degree of perturbations on images, as well as the robustness metrics specifically for the robustness conditions of classification models. The strengths and limitations of the existing methods are also discussed, and some potential directions for future research are provided.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 109 of its 186 references that are in the map. First posted on arXiv 12 Apr 2024.
Builds on
109 of 186 references.
References · 109
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2013Intriguing properties of neural networkscited by 5,114
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,976
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,857
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
- 2016Adversarial examples in the physical worldcited by 1,762
- 2019Theoretically Principled Trade-off between Robustness and Accuracycited by 1,510
- 2020Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attackscited by 1,442
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,325
- 2019Certified Adversarial Robustness via Randomized Smoothingcited by 1,324
38 more
- 2015DeepFool: a simple and accurate method to fool deep neural networkscited by 1,315
- 2017Ensemble Adversarial Training: Attacks and Defensescited by 833
- 2015The Limitations of Deep Learning in Adversarial Settingscited by 784
- 2017Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networkscited by 739
- 2015Distillation as a Defense to Adversarial Perturbations against Deep Neural Networkscited by 675
- 2020RobustBench: a standardized adversarial robustness benchmarkcited by 659
- 2017One pixel attack for fooling deep neural networkscited by 579
- 2017Provable defenses against adversarial examples via the convex outer adversarial polytopecited by 564
- 2017Adversarial Patchcited by 514
- 2018Certified Robustness to Adversarial Examples with Differential Privacycited by 462
- 2019On Evaluating Adversarial Robustnesscited by 442
- 2018Efficient Neural Network Robustness Certification with General Activation Functionscited by 439
- 2017Mitigating Adversarial Effects Through Randomizationcited by 382
- 2014On the Number of Linear Regions of Deep Neural Networkscited by 378
- 2017Defense against Adversarial Attacks Using High-Level Representation Guided Denoisercited by 329
- 2017DeepXplore: Automated Whitebox Testing of Deep Learning Systemscited by 307
- 2018Certified Defenses against Adversarial Examplescited by 305
- 2017MagNet: a Two-Pronged Defense against Adversarial Examplescited by 268
- 2016Safety Verification of Deep Neural Networkscited by 262
- 2018Towards Fast Computation of Certified Robustness for ReLU Networkscited by 254
- 2017DeepTest: Automated Testing of Deep-Neural-Network-driven Autonomous Carscited by 249
- 2017Formal Verification of Piece-Wise Linear Feed-Forward Neural Networkscited by 241
- 2019Machine Learning Testing: Survey, Landscapes and Horizonscited by 213
- 2024JailBreakV: A Benchmark for Assessing the Robustness of MultiModal Large Language Models against Jailbreak Attackscited by 208
- 2019Towards Stable and Efficient Training of Verifiably Robust Neural Networkscited by 204
- 2018Spatially Transformed Adversarial Examplescited by 195
- 2018Formal Security Analysis of Neural Networks using Symbolic Intervalscited by 185
- 2018Evaluating the Robustness of Neural Networks: An Extreme Value Theory Approachcited by 181
- 2018Certified Adversarial Robustness with Additive Noisecited by 178
- 2018Semidefinite relaxations for certifying robustness to adversarial examplescited by 178
- 2018Stochastic Activation Pruning for Robust Adversarial Defensecited by 171
- 2018Efficient Formal Safety Analysis of Neural Networkscited by 165
- 2021A Universal Law of Robustness via Isoperimetrycited by 150
- 2018DeepGauge: Multi-Granularity Testing Criteria for Deep Learning Systemscited by 144
- 2018Strike (with) a Pose: Neural Networks Are Easily Fooled by Strange Poses of Familiar Objectscited by 143
- 2018Scaling provable adversarial defensescited by 141
- 2017An approach to reachability analysis for feed-forward ReLU neural networkscited by 126
- 2018A Dual Approach to Scalable Verification of Deep Networkscited by 125
50 most cited of 109 All 109 (JSON)
Built on by
Citing papers per year: 2025: 2.
2 papers.