# Counterexample-Guided Data Augmentation

arXiv: https://arxiv.org/abs/1805.06962 · HTML: https://mlsanity.com/paper/1805.06962/

## Key facts

- Cited by 15 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 17 May 2018.

## Built on by (most cited first, 15 of 15)

- [A Survey of Data Augmentation Approaches for NLP](https://mlsanity.com/paper/2105.03075/) (2021)
- [Towards Guaranteed Safe AI: A Framework for Ensuring Robust and Reliable AI Systems](https://mlsanity.com/paper/2405.06624/) (2024)
- [Global and Local Texture Randomization for Synthetic-to-Real Semantic Segmentation](https://mlsanity.com/paper/2108.02376/) (2021)
- [Taxonomy of Machine Learning Safety: A Survey and Primer](https://mlsanity.com/paper/2106.04823/) (2021)
- [Sound and Complete Neural Network Repair with Minimality and Locality Guarantees](https://mlsanity.com/paper/2110.07682/) (2021)
- [Correct-by-Construction Runtime Enforcement in AI -- A Survey](https://mlsanity.com/paper/2208.14426/) (2022)
- [AIREPAIR: A Repair Platform for Neural Networks](https://mlsanity.com/paper/2211.15387/) (2022)
- [Hierarchical Testing with Rabbit Optimization for Industrial Cyber-Physical Systems](https://mlsanity.com/paper/2507.04100/) (2025)
- [Local Repair of Neural Networks Using Optimization](https://mlsanity.com/paper/2109.14041/) (2021)
- [Mitigating Data Scarcity for Large Language Models](https://mlsanity.com/paper/2302.01806/) (2023)
- [Generalizing Neural Networks by Reflecting Deviating Data in Production](https://mlsanity.com/paper/2110.02718/) (2021)
- [Confidence-Guided Data Augmentation for Improved Semi-Supervised Training](https://mlsanity.com/paper/2209.08174/) (2022)
- [A Machine Learning Approach to Classifying Construction Cost Documents into the International Construction Measurement Standard](https://mlsanity.com/paper/2211.07705/) (2022)
- [Generational Computation Reduction in Informal Counterexample-Driven Genetic Programming](https://mlsanity.com/paper/2408.12604/) (2024)
- [A Customer Journey in the Land of Oz: Leveraging the Wizard of Oz Technique to Model Emotions in Customer Service Interactions](https://mlsanity.com/paper/2511.21909/) (2025)

## Abstract (arXiv)

We present a novel framework for augmenting data sets for machine learning based on counterexamples. Counterexamples are misclassified examples that have important properties for retraining and improving the model. Key components of our framework include a counterexample generator, which produces data items that are misclassified by the model and error tables, a novel data structure that stores information pertaining to misclassifications. Error tables can be used to explain the model's vulnerabilities and are used to efficiently generate counterexamples for augmentation. We show the efficacy of the proposed framework by comparing it to classical augmentation techniques on a case study of object detection in autonomous driving based on deep neural networks.