# A Benchmark and Comparison of Active Learning for Logistic Regression

arXiv: https://arxiv.org/abs/1611.08618 · HTML: https://mlsanity.com/paper/1611.08618/

## Key facts

- Cited by 36 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 25 Nov 2016.

## Built on by (most cited first, 30 of 36)

- [Data-centric Artificial Intelligence: A Survey](https://mlsanity.com/paper/2303.10158/) (2023)
- [Mind Your Outliers! Investigating the Negative Impact of Outliers on Active Learning for Visual Question Answering](https://mlsanity.com/paper/2107.02331/) (2021)
- [Is segmentation uncertainty useful?](https://mlsanity.com/paper/2103.16265/) (2021)
- [Uncertainty Estimation for Language Reward Models](https://mlsanity.com/paper/2203.07472/) (2022)
- [Bayesian Active Learning with Fully Bayesian Gaussian Processes](https://mlsanity.com/paper/2205.10186/) (2022)
- [Active Learning for Neural PDE Solvers](https://mlsanity.com/paper/2408.01536/) (2024)
- [Improved Algorithms for Neural Active Learning](https://mlsanity.com/paper/2210.00423/) (2022)
- [Hitting the Target: Stopping Active Learning at the Cost-Based Optimum](https://mlsanity.com/paper/2110.03802/) (2021)
- [Capturing Individual Human Preferences with Reward Features](https://mlsanity.com/paper/2503.17338/) (2025)
- [Active Preference Learning for Ordering Items In- and Out-of-sample](https://mlsanity.com/paper/2405.03059/) (2024)
- [Active learning for imbalanced data under cold start](https://mlsanity.com/paper/2107.07724/) (2021)
- [ALPBench: A Benchmark for Active Learning Pipelines on Tabular Data](https://mlsanity.com/paper/2406.17322/) (2024)
- [A Survey on Active Deep Learning: From Model-driven to Data-driven](https://mlsanity.com/paper/2101.09933/) (2021)
- [Leveraging Importance Weights in Subset Selection](https://mlsanity.com/paper/2301.12052/) (2023)
- [Fairness-Aware Data Valuation for Supervised Learning](https://mlsanity.com/paper/2303.16963/) (2023)
- [An Expanded Benchmark that Rediscovers and Affirms the Edge of Uncertainty Sampling for Active Learning in Tabular Datasets](https://mlsanity.com/paper/2306.08954/) (2023)
- [Margin-based sampling in high dimensions: When being active is less efficient than staying passive](https://mlsanity.com/paper/2212.00772/) (2022)
- [Active Learning to Classify Macromolecular Structures in situ for Less Supervision in Cryo-Electron Tomography](https://mlsanity.com/paper/2102.12040/) (2021)
- [PyRelationAL: a python library for active learning research and development](https://mlsanity.com/paper/2205.11117/) (2022)
- [Efficient Classification with Counterfactual Reasoning and Active Learning](https://mlsanity.com/paper/2207.12086/) (2022)
- [Efficient Biological Data Acquisition through Inference Set Design](https://mlsanity.com/paper/2410.19631/) (2024)
- [Feedback Coding for Active Learning](https://mlsanity.com/paper/2103.00654/) (2021)
- [Time-Constrained Learning](https://mlsanity.com/paper/2202.01913/) (2022)
- [Active Learning for Computationally Efficient Distribution of Binary Evolution Simulations](https://mlsanity.com/paper/2203.16683/) (2022)
- [Does Deep Active Learning Work in the Wild?](https://mlsanity.com/paper/2302.00098/) (2023)
- [OpenAL: Evaluation and Interpretation of Active Learning Strategies](https://mlsanity.com/paper/2304.05246/) (2023)
- [On the Convergence of Loss and Uncertainty-based Active Learning Algorithms](https://mlsanity.com/paper/2312.13927/) (2023)
- [Active Evaluation of General Agents: Problem Definition and Comparison of Baseline Algorithms](https://mlsanity.com/paper/2601.07651/) (2026)
- [Active Learning for Argument Mining: A Practical Approach](https://mlsanity.com/paper/2109.13611/) (2021)
- [A War Beyond Deepfake: Benchmarking Facial Counterfeits and Countermeasures](https://mlsanity.com/paper/2111.12912/) (2021)

## Abstract (arXiv)

Logistic regression is by far the most widely used classifier in real-world applications. In this paper, we benchmark the state-of-the-art active learning methods for logistic regression and discuss and illustrate their underlying characteristics. Experiments are carried out on three synthetic datasets and 44 real-world datasets, providing insight into the behaviors of these active learning methods with respect to the area of the learning curve (which plots classification accuracy as a function of the number of queried examples) and their computational costs. Surprisingly, one of the earliest and simplest suggested active learning methods, i.e., uncertainty sampling, performs exceptionally well overall. Another remarkable finding is that random sampling, which is the rudimentary baseline to improve upon, is not overwhelmed by individual active learning techniques in many cases.