# Addressing practical challenges in Active Learning via a hybrid query strategy

arXiv: https://arxiv.org/abs/2110.03785 · HTML: https://mlsanity.com/paper/2110.03785/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- Builds on 4 of its 34 references that are in the map.
- First posted on arXiv 7 Oct 2021.

## Builds on (most cited first, 4 of 4)

- [modAL: A modular active learning framework for Python](https://mlsanity.com/paper/1805.00979/) (2018)
- [Learning to Sample: an Active Learning Framework](https://mlsanity.com/paper/1909.03585/) (2019)
- [A Variance Maximization Criterion for Active Learning](https://mlsanity.com/paper/1706.07642/) (2017)
- [Icebreaker: Element-wise Active Information Acquisition with Bayesian Deep Latent Gaussian Model](https://mlsanity.com/paper/1908.04537/) (2019)

## Built on by (most cited first, 2 of 2)

- [DEUCE: Dual-diversity Enhancement and Uncertainty-awareness for Cold-start Active Learning](https://mlsanity.com/paper/2502.00305/) (2025)
- [Active Foundational Models for Fault Diagnosis of Electrical Motors](https://mlsanity.com/paper/2311.15516/) (2023)

## Abstract (arXiv)

Active Learning (AL) is a powerful tool to address modern machine learning problems with significantly fewer labeled training instances. However, implementation of traditional AL methodologies in practical scenarios is accompanied by multiple challenges due to the inherent assumptions. There are several hindrances, such as unavailability of labels for the AL algorithm at the beginning; unreliable external source of labels during the querying process; or incompatible mechanisms to evaluate the performance of Active Learner. Inspired by these practical challenges, we present a hybrid query strategy-based AL framework that addresses three practical challenges simultaneously: cold-start, oracle uncertainty and performance evaluation of Active Learner in the absence of ground truth. While a pre-clustering approach is employed to address the cold-start problem, the uncertainty surrounding the expertise of labeler and confidence in the given labels is incorporated to handle oracle uncertainty. The heuristics obtained during the querying process serve as the fundamental premise for accessing the performance of Active Learner. The robustness of the proposed AL framework is evaluated across three different environments and industrial settings. The results demonstrate the capability of the proposed framework to tackle practical challenges during AL implementation in real-world scenarios.