# Deep Active Learning with Augmentation-based Consistency Estimation

arXiv: https://arxiv.org/abs/2011.02666 · HTML: https://mlsanity.com/paper/2011.02666/

## Key facts

- Cited by 8 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 5 Nov 2020.

## Built on by (most cited first, 8 of 8)

- [Active Learning on a Budget: Opposite Strategies Suit High and Low Budgets](https://mlsanity.com/paper/2202.02794/) (2022)
- [Active Learning Through a Covering Lens](https://mlsanity.com/paper/2205.11320/) (2022)
- [LiDAR dataset distillation within bayesian active learning framework: Understanding the effect of data augmentation](https://mlsanity.com/paper/2202.02661/) (2022)
- [Training Ensembles with Inliers and Outliers for Semi-supervised Active Learning](https://mlsanity.com/paper/2307.03741/) (2023)
- [SiameseDuo++: Active Learning from Data Streams with Dual Augmented Siamese Networks](https://mlsanity.com/paper/2504.04613/) (2025)
- [Test-Time Mixup Augmentation for Data and Class-Specific Uncertainty Estimation in Deep Learning Image Classification](https://mlsanity.com/paper/2212.00214/) (2022)
- [Evaluating the effect of data augmentation and BALD heuristics on distillation of Semantic-KITTI dataset](https://mlsanity.com/paper/2302.10679/) (2023)
- [A Novel Active Learning Approach to Label One Million Unknown Malware Variants](https://mlsanity.com/paper/2507.02959/) (2025)

## Abstract (arXiv)

In active learning, the focus is mainly on the selection strategy of unlabeled data for enhancing the generalization capability of the next learning cycle. For this, various uncertainty measurement methods have been proposed. On the other hand, with the advent of data augmentation metrics as the regularizer on general deep learning, we notice that there can be a mutual influence between the method of unlabeled data selection and the data augmentation-based regularization techniques in active learning scenarios. Through various experiments, we confirmed that consistency-based regularization from analytical learning theory could affect the generalization capability of the classifier in combination with the existing uncertainty measurement method. By this fact, we propose a methodology to improve generalization ability, by applying data augmentation-based techniques to an active learning scenario. For the data augmentation-based regularization loss, we redefined cutout (co) and cutmix (cm) strategies as quantitative metrics and applied at both model training and unlabeled data selection steps. We have shown that the augmentation-based regularizer can lead to improved performance on the training step of active learning, while that same approach can be effectively combined with the uncertainty measurement metrics proposed so far. We used datasets such as FashionMNIST, CIFAR10, CIFAR100, and STL10 to verify the performance of the proposed active learning technique for multiple image classification tasks. Our experiments show consistent performance gains for each dataset and budget scenario.