Diverse mini-batch Active Learning
Not on the map. Why?
Abstract (arXiv)
We study the problem of reducing the amount of labeled training data required to train supervised classification models. We approach it by leveraging Active Learning, through sequential selection of examples which benefit the model most. Selecting examples one by one is not practical for the amount of training examples required by the modern Deep Learning models. We consider the mini-batch Active Learning setting, where several examples are selected at once. We present an approach which takes into account both informativeness of the examples for the model, as well as the diversity of the examples in a mini-batch. By using the well studied K-means clustering algorithm, this approach scales better than the previously proposed approaches, and achieves comparable or better performance.
Key facts. Cited by 89 papers in the map (data through 14 Oct 2026). First posted on arXiv 17 Jan 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 16; 2022: 25; 2023: 24; 2024: 17; 2025: 3; 2026: 4.
89 papers.
Sort:
By area:
- 2021Active Learning by Acquiring Contrastive Examplescited by 156
- 2022Active Learning on a Budget: Opposite Strategies Suit High and Low Budgetscited by 133
- 2021Batch Active Learning at Scalecited by 127
- 2022A Comparative Survey of Deep Active Learningcited by 89
- 2022Active Learning Through a Covering Lenscited by 66
- 2022Data Curation Alone Can Stabilize In-context Learningcited by 59
- 2024Automatic Data Curation for Self-Supervised Learning: A Clustering-Based Approachcited by 50
- 2022A Framework and Benchmark for Deep Batch Active Learning for Regressioncited by 49
- 2022A Survey of Active Learning for Natural Language Processingcited by 40
- 2021Deep Active Learning by Leveraging Training Dynamicscited by 32
- 2022Plug and Play Active Learning for Object Detectioncited by 28
- 2021Data Shapley Valuation for Efficient Batch Active Learningcited by 27
38 more
- 2021Cartography Active Learningcited by 26
- 2023The Efficiency Spectrum of Large Language Models: An Algorithmic Surveycited by 26
- 2022A Lagrangian Duality Approach to Active Learningcited by 24
- 2021Neural Active Learning with Performance Guaranteescited by 22
- 2021Diversity Enhanced Active Learning with Strictly Proper Scoring Rulescited by 22
- 2022MEAL: Stable and Active Learning for Few-Shot Promptingcited by 20
- 2021Discrepancy-Based Active Learning for Domain Adaptationcited by 17
- 2022Active Learning Strategies for Weakly-supervised Object Detectioncited by 17
- 2021On Data Efficiency of Meta-learningcited by 16
- 2022Fast Rates in Pool-Based Batch Active Learningcited by 15
- 2024Uncertainty Herding: One Active Learning Method for All Label Budgetscited by 15
- 2023D-CALM: A Dynamic Clustering-based Active Learning Approach for Mitigating Biascited by 12
- 2021Multi-class Text Classification using BERT-based Active Learningcited by 11
- 2022Data efficient surrogate modeling for engineering design: Ensemble-free batch mode deep active learning for regressioncited by 11
- 2022SALAD: Source-free Active Label-Agnostic Domain Adaptation for Classification, Segmentation and Detectioncited by 10
- 2023Best Practices in Active Learning for Semantic Segmentationcited by 10
- 2024Neural Active Learning Beyond Banditscited by 10
- 2021Deep Indexed Active Learning for Matching Heterogeneous Entity Representationscited by 9
- 2023On the Limitations of Simulating Active Learningcited by 9
- 2023An Informative Path Planning Framework for Active Learning in UAV-based Semantic Mappingcited by 8
- 2022Deep Active Learning for Computer Vision: Past and Futurecited by 7
- 2024AHA: Human-Assisted Out-of-Distribution Generalization and Detectioncited by 7
- 2021Multi-Domain Active Learning: Literature Review and Comparative Studycited by 6
- 2022Teaching Robots to Span the Space of Functional Expressive Motioncited by 6
- 2022An Empirical Study on the Efficacy of Deep Active Learning for Image Classificationcited by 6
- 2023Investigating Multi-source Active Learning for Natural Language Inferencecited by 6
- 2023Bayesian Estimate of Mean Proper Scores for Diversity-Enhanced Active Learningcited by 6
- 2024SCAR: Data Selection via Style Consistency-Aware Response Ranking for Efficient Instruction-Tuning of Large Language Modelscited by 6
- 2024Out-of-Distribution Learning with Human Feedbackcited by 6
- 2022TrustAL: Trustworthy Active Learning using Knowledge Distillationcited by 5
- 2024Provably Neural Active Learning Succeeds via Prioritizing Perplexing Samplescited by 5
- 2021Sample Noise Impact on Active Learningcited by 4
- 2022Nonmyopic Multiclass Active Search with Diminishing Returns for Diverse Discoverycited by 4
- 2022Improved Adaptive Algorithm for Scalable Active Learning with Weak Labelercited by 4
- 2023Query Complexity of Active Learning for Function Family With Nearly Orthogonal Basiscited by 4
- 2023Active Learning for Object Detection with Non-Redundant Informative Samplingcited by 4
- 2023Novel Batch Active Learning Approach and Its Application to Synthetic Aperture Radar Datasetscited by 4
- 2023Active Transfer Learning for Efficient Video-Specific Human Pose Estimationcited by 4
50 most cited of 89 All 89 (JSON)
- 2026Measure Less, Know More: Self-Supervised Test-Time Feature Acquisition2 Oct 2026
- 2026Cost-efficient Active Learning for Referring Image Segmentation and Grounding31 Aug 2026
- 2026Goal-Oriented Influence-Maximizing Data Acquisition for Learning and Optimization23 Feb 2026
- 2026Human-in-the-loop Adaptation in Group Activity Feature Learning for Team Sports Video Retrieval3 Feb 2026
- 2025SCR2-ST: Combine Single Cell with Spatial Transcriptomics for Efficient Active Sampling via Reinforcement Learning15 Dec 2025
- 2025PrivaDE: Privacy-preserving Data Evaluation for Blockchain-based Data Marketplaces20 Oct 2025
- 2025PromptAL: Sample-Aware Dynamic Soft Prompts for Few-Shot Active Learning22 Jul 2025
- 2024Efficient Human-in-the-Loop Active Learning: A Novel Framework for Data Labeling in AI Systems31 Dec 2024
- 2024Uncertainty Herding: One Active Learning Method for All Label Budgets30 Dec 2024
- 2024Transfer Learning with Active Sampling for Rapid Training and Calibration in BCI-P300 Across Health States and Multi-centre Data14 Dec 2024
- 2024Label Distribution Learning using the Squared Neural Family on the Probability Simplex10 Dec 2024
- 2024Maximally Separated Active Learning26 Nov 2024
38 more
- 2024FisherMask: Enhancing Neural Network Labeling Efficiency in Image Classification Using Fisher Information8 Nov 2024
- 2024ALVIN: Active Learning Via INterpolation11 Oct 2024
- 2024AHA: Human-Assisted Out-of-Distribution Generalization and Detection10 Oct 2024
- 2024Out-of-Distribution Learning with Human Feedback14 Aug 2024
- 2024SCAR: Data Selection via Style Consistency-Aware Response Ranking for Efficient Instruction-Tuning of Large Language Models16 Jun 2024
- 2024Provably Neural Active Learning Succeeds via Prioritizing Perplexing Samples6 Jun 2024
- 2024GIST: Greedy Independent Set Thresholding for Max-Min Diversification with Submodular Utility29 May 2024
- 2024Automatic Data Curation for Self-Supervised Learning: A Clustering-Based Approach24 May 2024
- 2024Grad Queue : A probabilistic framework to reinforce sparse gradients25 Apr 2024
- 2024Test-Time Training on Graphs with Large Language Models (LLMs)21 Apr 2024
- 2024Neural Active Learning Beyond Bandits18 Apr 2024
- 2024Active Learning for NLP with Large Language Models14 Jan 2024
- 2023Bayesian Estimate of Mean Proper Scores for Diversity-Enhanced Active Learning15 Dec 2023
- 2023Benchmarking of Query Strategies: Towards Future Deep Active Learning10 Dec 2023
- 2023Few Clicks Suffice: Active Test-Time Adaptation for Semantic Segmentation4 Dec 2023
- 2023The Efficiency Spectrum of Large Language Models: An Algorithmic Survey1 Dec 2023
- 2023Active Transfer Learning for Efficient Video-Specific Human Pose Estimation8 Nov 2023
- 2023Active Learning for Fine-Grained Sketch-Based Image Retrieval15 Sep 2023
- 2023Semantic Parsing in Limited Resource Conditions14 Sep 2023
- 2023How To Overcome Confirmation Bias in Semi-Supervised Image Classification By Active Learning16 Aug 2023
- 2023Novel Batch Active Learning Approach and Its Application to Synthetic Aperture Radar Datasets19 Jul 2023
- 2023Active Learning for Object Detection with Non-Redundant Informative Sampling17 Jul 2023
- 2023Are Good Explainers Secretly Human-in-the-Loop Active Learners?24 Jun 2023
- 2023A Dataset for Deep Learning-based Bone Structure Analyses in Total Hip Arthroplasty7 Jun 2023
- 2023Query Complexity of Active Learning for Function Family With Nearly Orthogonal Basis6 Jun 2023
- 2023D-CALM: A Dynamic Clustering-based Active Learning Approach for Mitigating Bias26 May 2023
- 2023The Best of Both Worlds: Combining Human and Machine Translations for Multilingual Semantic Parsing with Active Learning22 May 2023
- 2023On the Limitations of Simulating Active Learning21 May 2023
- 2023On Dataset Transferability in Active Learning for Transformers16 May 2023
- 2023Cluster Entropy: Active Domain Adaptation in Pathological Image Segmentation26 Apr 2023
- 2023OpenAL: Evaluation and Interpretation of Active Learning Strategies11 Apr 2023
- 2023Deep active learning for nonlinear system identification24 Feb 2023
- 2023Investigating Multi-source Active Learning for Natural Language Inference14 Feb 2023
- 2023Best Practices in Active Learning for Semantic Segmentation8 Feb 2023
- 2023An Informative Path Planning Framework for Active Learning in UAV-based Semantic Mapping7 Feb 2023
- 2023Few-Shot Image-to-Semantics Translation for Policy Transfer in Reinforcement Learning31 Jan 2023
- 2022Data Curation Alone Can Stabilize In-context Learning20 Dec 2022
- 2022Evaluating Zero-cost Active Learning for Object Detection8 Dec 2022
50 newest of 89 All 89 (JSON)
- 2024Out-of-Distribution Learning with Human Feedbackcited by 6
- 2024Out-of-Distribution Learning with Human Feedback14 Aug 2024
- 2021Active Learning by Acquiring Contrastive Examplescited by 156
- 2022Active Learning on a Budget: Opposite Strategies Suit High and Low Budgetscited by 133
- 2021Batch Active Learning at Scalecited by 127
- 2022A Comparative Survey of Deep Active Learningcited by 89
- 2022Active Learning Through a Covering Lenscited by 66
- 2022Data Curation Alone Can Stabilize In-context Learningcited by 59
- 2024Automatic Data Curation for Self-Supervised Learning: A Clustering-Based Approachcited by 50
- 2022A Framework and Benchmark for Deep Batch Active Learning for Regressioncited by 49
- 2022A Survey of Active Learning for Natural Language Processingcited by 40
- 2021Deep Active Learning by Leveraging Training Dynamicscited by 32
- 2022Plug and Play Active Learning for Object Detectioncited by 28
- 2021Data Shapley Valuation for Efficient Batch Active Learningcited by 27
12 most cited of 87 All 87 (JSON)
- 2026Measure Less, Know More: Self-Supervised Test-Time Feature Acquisition2 Oct 2026
- 2026Cost-efficient Active Learning for Referring Image Segmentation and Grounding31 Aug 2026
- 2026Goal-Oriented Influence-Maximizing Data Acquisition for Learning and Optimization23 Feb 2026
- 2026Human-in-the-loop Adaptation in Group Activity Feature Learning for Team Sports Video Retrieval3 Feb 2026
- 2025SCR2-ST: Combine Single Cell with Spatial Transcriptomics for Efficient Active Sampling via Reinforcement Learning15 Dec 2025
- 2025PrivaDE: Privacy-preserving Data Evaluation for Blockchain-based Data Marketplaces20 Oct 2025
- 2025PromptAL: Sample-Aware Dynamic Soft Prompts for Few-Shot Active Learning22 Jul 2025
- 2024Efficient Human-in-the-Loop Active Learning: A Novel Framework for Data Labeling in AI Systems31 Dec 2024
- 2024Uncertainty Herding: One Active Learning Method for All Label Budgets30 Dec 2024
- 2024Transfer Learning with Active Sampling for Rapid Training and Calibration in BCI-P300 Across Health States and Multi-centre Data14 Dec 2024
- 2024Label Distribution Learning using the Squared Neural Family on the Probability Simplex10 Dec 2024
- 2024Maximally Separated Active Learning26 Nov 2024
12 newest of 87 All 87 (JSON)