Learning-Based Testing for Deep Learning: Enhancing Model Robustness with Adversarial Input Prioritization
Not on the map. Why?
Abstract (arXiv)
Context: Deep Neural Networks (DNNs) are increasingly deployed in critical applications, where resilience against adversarial inputs is paramount. However, whether coverage-based or confidence-based, existing test prioritization methods often fail to efficiently identify the most fault-revealing inputs, limiting their practical effectiveness. Aims: This project aims to enhance fault detection and model robustness in DNNs by integrating Learning-Based Testing (LBT) with hypothesis and mutation testing to efficiently prioritize adversarial test cases. Methods: Our method selects a subset of adversarial inputs with a high likelihood of exposing model faults, without relying on architecture-specific characteristics or formal verification, making it adaptable across diverse DNNs. Results: Our results demonstrate that the proposed LBT method consistently surpasses baseline approaches in prioritizing fault-revealing inputs and accelerating fault detection. By efficiently organizing test permutations, it uncovers all potential faults significantly faster across various datasets, model architectures, and adversarial attack techniques. Conclusion: Beyond improving fault detection, our method preserves input diversity and provides effective guidance for model retraining, further enhancing robustness. These advantages establish our approach as a powerful and practical solution for adversarial test prioritization in real-world DNN applications.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 55 references that are in the map. First posted on arXiv 28 Sep 2025.
Builds on
23 of 55 references.
References · 23
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
- 2016End to End Learning for Self-Driving Carscited by 1,009
- 2015The Limitations of Deep Learning in Adversarial Settingscited by 790
- 2017Adversarial Examples Are Not Easily Detected: Bypassing Ten Detection Methodscited by 546
- 2017DeepXplore: Automated Whitebox Testing of Deep Learning Systemscited by 311
- 2017DeepTest: Automated Testing of Deep-Neural-Network-driven Autonomous Carscited by 251
- 2017Detecting Adversarial Samples from Artifactscited by 245
- 2018Adversarial Robustness Toolbox v1.0.0cited by 215
- 2018DeepGauge: Multi-Granularity Testing Criteria for Deep Learning Systemscited by 147
11 more
- 2018Guiding Deep Learning System Testing using Surprise Adequacycited by 124
- 2022A Comparative Survey of Deep Active Learningcited by 89
- 2017Generative Adversarial Active Learningcited by 70
- 2018DeepMutation: Mutation Testing of Deep Learning Systemscited by 67
- 2019Test Selection for Deep Learning Systemscited by 27
- 2022Simple Techniques Work Surprisingly Well for Neural Network Test Prioritization and Active Learning (Replicability Study)cited by 27
- 2020Towards Characterizing Adversarial Defects of Deep Learning Software from the Lens of Uncertaintycited by 26
- 2019Boosting Operational DNN Testing Efficiency through Conditioningcited by 22
- 2023DeepGD: A Multi-Objective Black-Box Test Selection Approach for Deep Neural Networkscited by 11
- 2023SMARLA: A Safety Monitoring Approach for Deep Reinforcement Learning Agentscited by 10
- 2016Uncertainty-Driven Black-Box Test Data Generationcited by 4
Built on by
Not cited yet.