# Active Learning for Convolutional Neural Networks: A Core-Set Approach

arXiv: https://arxiv.org/abs/1708.00489 · HTML: https://mlsanity.com/paper/1708.00489/

## Key facts

- Cited by 36 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 1 Aug 2017.

## Built on by (most cited first, 30 of 36)

- [DatasetGAN: Efficient Labeled Data Factory with Minimal Human Effort](https://mlsanity.com/paper/2104.06490/) (2021)
- [A Survey on Human-aware Robot Navigation](https://mlsanity.com/paper/2106.11650/) (2021)
- [Skywork-Math: Data Scaling Laws for Mathematical Reasoning in Large Language Models -- The Story Goes On](https://mlsanity.com/paper/2407.08348/) (2024)
- [Active Learning and Bayesian Optimization: a Unified Perspective to Learn with a Goal](https://mlsanity.com/paper/2303.01560/) (2023)
- [Multiple-criteria Based Active Learning with Fixed-size Determinantal Point Processes](https://mlsanity.com/paper/2107.01622/) (2021)
- [Attend Who is Weak: Enhancing Graph Condensation via Cross-Free Adversarial Training](https://mlsanity.com/paper/2311.15772/) (2023)
- [An Informative Path Planning Framework for Active Learning in UAV-based Semantic Mapping](https://mlsanity.com/paper/2302.03347/) (2023)
- [Distill Gold from Massive Ores: Bi-level Data Pruning towards Efficient Dataset Distillation](https://mlsanity.com/paper/2305.18381/) (2023)
- [Batch Active Learning of Reward Functions from Human Preferences](https://mlsanity.com/paper/2402.15757/) (2024)
- [Reviving The Classics: Active Reward Modeling in Large Language Model Alignment](https://mlsanity.com/paper/2502.04354/) (2025)
- [Deep Active Ensemble Sampling For Image Classification](https://mlsanity.com/paper/2210.05770/) (2022)
- [On the Opportunities of Green Computing: A Survey](https://mlsanity.com/paper/2311.00447/) (2023)
- [Advancing Deep Active Learning & Data Subset Selection: Unifying Principles with Information-Theory Intuitions](https://mlsanity.com/paper/2401.04305/) (2024)
- [Efficacy of Bayesian Neural Networks in Active Learning](https://mlsanity.com/paper/2104.00896/) (2021)
- [DREAM+: Efficient Dataset Distillation by Bidirectional Representative Matching](https://mlsanity.com/paper/2310.15052/) (2023)
- [Tree-of-Debate: Multi-Persona Debate Trees Elicit Critical Thinking for Scientific Comparative Analysis](https://mlsanity.com/paper/2502.14767/) (2025)
- [A Survey of Dataset Refinement for Problems in Computer Vision Datasets](https://mlsanity.com/paper/2210.11717/) (2022)
- [Provably Neural Active Learning Succeeds via Prioritizing Perplexing Samples](https://mlsanity.com/paper/2406.03944/) (2024)
- [Tuning-Free Bilevel Optimization: New Algorithms and Convergence Analysis](https://mlsanity.com/paper/2410.05140/) (2024)
- [Data Lineage Inference: Uncovering Privacy Vulnerabilities of Dataset Pruning](https://mlsanity.com/paper/2411.15796/) (2024)
- [A Survey on Active Deep Learning: From Model-driven to Data-driven](https://mlsanity.com/paper/2101.09933/) (2021)
- [A Survey of LLM × DATA](https://mlsanity.com/paper/2505.18458/) (2025)
- [User-Side Realization](https://mlsanity.com/paper/2403.15757/) (2024)
- [Video Set Distillation: Information Diversification and Temporal Densification](https://mlsanity.com/paper/2412.00111/) (2024)
- [RK-core: An Established Methodology for Exploring the Hierarchical Structure within Datasets](https://mlsanity.com/paper/2310.12168/) (2023)
- [Synthetic Data Generation for Training Diversified Commonsense Reasoning Models](https://mlsanity.com/paper/2603.18361/) (2026)
- [Towards Lifelong Aerial Autonomy: Geometric Memory Management for Continual Visual Place Recognition in Dynamic Environments](https://mlsanity.com/paper/2604.09038/) (2026)
- [Smart Picks in the Dark: Towards Efficient RLVR for Reasoning via Tracing Metacognitive Pivots](https://mlsanity.com/paper/2606.04503/) (2026)
- [Autonomous Curiosity for Real-Time Training Onboard Robotic Agents](https://mlsanity.com/paper/2109.00927/) (2021)
- [Prioritizing Informative Features and Examples for Deep Learning from Noisy Data](https://mlsanity.com/paper/2403.00013/) (2024)

## Abstract (arXiv)

Convolutional neural networks (CNNs) have been successfully applied to many recognition and learning tasks using a universal recipe; training a deep model on a very large dataset of supervised examples. However, this approach is rather restrictive in practice since collecting a large set of labeled images is very expensive. One way to ease this problem is coming up with smart ways for choosing images to be labelled from a very large collection (ie. active learning). Our empirical study suggests that many of the active learning heuristics in the literature are not effective when applied to CNNs in batch setting. Inspired by these limitations, we define the problem of active learning as core-set selection, ie. choosing set of points such that a model learned over the selected subset is competitive for the remaining data points. We further present a theoretical result characterizing the performance of any selected subset using the geometry of the datapoints. As an active learning algorithm, we choose the subset which is expected to yield best result according to our characterization. Our experiments show that the proposed method significantly outperforms existing approaches in image classification experiments by a large margin.