Discriminative Active Learning
Not on the map. Why?
Abstract (arXiv)
We propose a new batch mode active learning algorithm designed for neural networks and large query batch sizes. The method, Discriminative Active Learning (DAL), poses active learning as a binary classification task, attempting to choose examples to label in such a way as to make the labeled set and the unlabeled pool indistinguishable. Experimenting on image classification tasks, we empirically show our method to be on par with state of the art methods in medium and large query batch sizes, while being simple to implement and also extend to other domains besides classification tasks. Our experiments also show that none of the state of the art methods of today are clearly better than uncertainty sampling when the batch size is relatively large, negating some of the reported results in the recent literature.
Key facts. Cited by 97 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Jul 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 0; 2021: 17; 2022: 27; 2023: 25; 2024: 19; 2025: 4; 2026: 4.
97 papers.
Sort:
By area:
- 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
- 2021Active Learning by Acquiring Contrastive Examplescited by 154
- 2022Active Learning on a Budget: Opposite Strategies Suit High and Low Budgetscited by 131
- 2021Gone Fishing: Neural Active Learning with Fisher Embeddingscited by 88
- 2022A Comparative Survey of Deep Active Learningcited by 88
- 2022Efficient Methods for Natural Language Processing: A Surveycited by 78
- 2022Active Learning Through a Covering Lenscited by 62
- 2021Active Learning for Domain Adaptation: An Energy-Based Approachcited by 53
- 2022A Survey of Active Learning for Natural Language Processingcited by 40
- 2022Uncertainty Estimation for Language Reward Modelscited by 35
- 2023A comprehensive survey on deep active learning in medical image analysiscited by 32
- 2022GALAXY: Graph-based Active Learning at the Extremecited by 29
38 more
- 2021Cartography Active Learningcited by 26
- 2023The Efficiency Spectrum of Large Language Models: An Algorithmic Surveycited by 25
- 2022A Lagrangian Duality Approach to Active Learningcited by 24
- 2022ALLSH: Active Learning Guided by Local Sensitivity and Hardnesscited by 23
- 2023Multi-Resolution Active Learning of Fourier Neural Operatorscited by 22
- 2022Batch Multi-Fidelity Active Learning with Budget Constraintscited by 20
- 2023Streaming Active Learning with Deep Neural Networkscited by 20
- 2021Small-Text: Active Learning for Text Classification in Pythoncited by 18
- 2023Algorithm Selection for Deep Active Learning with Imbalanced Datasetscited by 18
- 2022Active Learning Strategies for Weakly-supervised Object Detectioncited by 17
- 2023ACTOR: Active Learning with Annotator-specific Classification Heads to Embrace Human Label Variationcited by 17
- 2021Discrepancy-Based Active Learning for Domain Adaptationcited by 16
- 2023How to Select Which Active Learning Strategy is Best Suited for Your Specific Problem and Budgetcited by 16
- 2021Multi-class Text Classification using BERT-based Active Learningcited by 11
- 2021Goldilocks: Just-Right Tuning of BERT for Technology-Assisted Reviewcited by 11
- 2022Active Learning Over Multiple Domains in Natural Language Taskscited by 11
- 2022TiDAL: Learning Training Dynamics for Active Learningcited by 11
- 2023Gaussian Switch Sampling: A Second Order Approach to Active Learningcited by 10
- 2021Hitting the Target: Stopping Active Learning at the Cost-Based Optimumcited by 9
- 2022Patient Aware Active Learning for Fine-Grained OCT Classificationcited by 9
- 2023On the Limitations of Simulating Active Learningcited by 9
- 2023Forgetful Active Learning with Switch Events: Efficient Sampling for Out-of-Distribution Datacited by 8
- 2021A Neural Pre-Conditioning Active Learning Algorithm to Reduce Label Complexitycited by 7
- 2022Deep Active Learning for Computer Vision: Past and Futurecited by 7
- 2023Has It All Been Solved? Open NLP Research Questions Not Solved by Large Language Modelscited by 7
- 2023On the Opportunities of Green Computing: A Surveycited by 7
- 2024Not All Preference Pairs Are Created Equal: A Recipe for Annotation-Efficient Iterative Preference Learningcited by 7
- 2024AHA: Human-Assisted Out-of-Distribution Generalization and Detectioncited by 7
- 2021Multi-Domain Active Learning: Literature Review and Comparative Studycited by 6
- 2022Neural Design for Genetic Perturbation Experimentscited by 6
- 2023Investigating Multi-source Active Learning for Natural Language Inferencecited by 6
- 2021Active learning for object detection in high-resolution satellite imagescited by 5
- 2021Active learning for imbalanced data under cold startcited by 5
- 2022"Diversity and Uncertainty in Moderation" are the Key to Data Selection for Multilingual Few-shot Transfercited by 5
- 2022Neural Active Learning on Heteroskedastic Distributionscited by 5
- 2023Parameter-Efficient Language Model Tuning with Active Learning in Low-Resource Settingscited by 5
- 2023Training-Free Neural Active Learning with Initialization-Robustness Guaranteescited by 5
- 2024STAR: Constraint LoRA with Dynamic Active Learning for Data-Efficient Fine-Tuning of Large Language Modelscited by 5
50 most cited of 97 All 97 (JSON)
- 2026Cumulative Meta-Learning from Active Learning Queries for Robustness to Spurious Correlations20 May 2026
- 2026Are Candidate Models Really Needed for Active Learning?14 May 2026
- 2026Positive-First Most Ambiguous: A Simple Active Learning Criterion for Interactive Retrieval of Rare Categories25 Mar 2026
- 2026TableNet A Large-Scale Table Dataset with LLM-Powered Autonomous27 Feb 2026
- 2025IDEAL-M3D: Instance Diversity-Enriched Active Learning for Monocular 3D Detection24 Nov 2025
- 2025ALScope: A Unified Toolkit for Deep Active Learning6 Aug 2025
- 2025To Label or Not to Label: PALM -- A Predictive Model for Evaluating Sample Efficiency in Active Learning Models21 Jul 2025
- 2025Large Language Models are Demonstration Pre-Selectors for Themselves6 Jun 2025
- 2024Image Classification with Deep Reinforcement Active Learning27 Dec 2024
- 2024Enhancing Skin Lesion Classification Generalization with Active Domain Adaptation1 Dec 2024
- 2024Targeting Negative Flips in Active Learning using Validation Sets16 Nov 2024
- 2024ALVIN: Active Learning Via INterpolation11 Oct 2024
38 more
- 2024AHA: Human-Assisted Out-of-Distribution Generalization and Detection10 Oct 2024
- 2024STONE: A Submodular Optimization Framework for Active 3D Object Detection4 Oct 2024
- 2024A Scalable Algorithm for Active Learning11 Sep 2024
- 2024FIRAL: An Active Learning Algorithm for Multinomial Logistic Regression11 Sep 2024
- 2024Active Learning for Identifying Disaster-Related Tweets: A Comparison with Keyword Filtering and Generic Fine-Tuning19 Aug 2024
- 2024DCoM: Active Learning for All Learners1 Jul 2024
- 2024Not All Preference Pairs Are Created Equal: A Recipe for Annotation-Efficient Iterative Preference Learning25 Jun 2024
- 2024Provably Neural Active Learning Succeeds via Prioritizing Perplexing Samples6 Jun 2024
- 2024Effective Data Selection for Seismic Interpretation through Disagreement1 Jun 2024
- 2024Test-Time Training on Graphs with Large Language Models (LLMs)21 Apr 2024
- 2024On the Fragility of Active Learners for Text Classification23 Mar 2024
- 2024STAR: Constraint LoRA with Dynamic Active Learning for Data-Efficient Fine-Tuning of Large Language Models2 Mar 2024
- 2024Towards Efficient Active Learning in NLP via Pretrained Representations23 Feb 2024
- 2024Composite Active Learning: Towards Multi-Domain Active Learning with Theoretical Guarantees3 Feb 2024
- 2024Synthetic Information towards Maximum Posterior Ratio for deep learning on Imbalanced Data5 Jan 2024
- 2023The Efficiency Spectrum of Large Language Models: An Algorithmic Survey1 Dec 2023
- 2023On the Opportunities of Green Computing: A Survey1 Nov 2023
- 2023ACTOR: Active Learning with Annotator-specific Classification Heads to Embrace Human Label Variation23 Oct 2023
- 2023A comprehensive survey on deep active learning in medical image analysis22 Oct 2023
- 2023Multi-Resolution Active Learning of Fourier Neural Operators29 Sep 2023
- 2023Learning Objective-Specific Active Learning Strategies with Attentive Neural Processes11 Sep 2023
- 2023Mining of Single-Class by Active Learning for Semantic Segmentation18 Jul 2023
- 2023REAL: A Representative Error-Driven Approach for Active Learning3 Jul 2023
- 2023Taming Small-sample Bias in Low-budget Active Learning19 Jun 2023
- 2023Training-Free Neural Active Learning with Initialization-Robustness Guarantees7 Jun 2023
- 2023How to Select Which Active Learning Strategy is Best Suited for Your Specific Problem and Budget6 Jun 2023
- 2023Query Complexity of Active Learning for Function Family With Nearly Orthogonal Basis6 Jun 2023
- 2023Active Learning for Natural Language Generation24 May 2023
- 2023Parameter-Efficient Language Model Tuning with Active Learning in Low-Resource Settings23 May 2023
- 2023On the Limitations of Simulating Active Learning21 May 2023
- 2023Has It All Been Solved? Open NLP Research Questions Not Solved by Large Language Models21 May 2023
- 2023Actively Discovering New Slots for Task-oriented Conversation6 May 2023
- 2023Transfer and Active Learning for Dissonance Detection: Addressing the Rare-Class Challenge3 May 2023
- 2023Streaming Active Learning with Deep Neural Networks5 Mar 2023
- 2023Gaussian Switch Sampling: A Second Order Approach to Active Learning16 Feb 2023
- 2023Algorithm Selection for Deep Active Learning with Imbalanced Datasets14 Feb 2023
- 2023Investigating Multi-source Active Learning for Natural Language Inference14 Feb 2023
- 2023Forgetful Active Learning with Switch Events: Efficient Sampling for Out-of-Distribution Data12 Jan 2023
50 newest of 97 All 97 (JSON)
- 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
- 2022Uncertainty Estimation for Language Reward Modelscited by 35
- 2022Uncertainty Estimation for Language Reward Models14 Mar 2022
- 2019Fine-Tuning Language Models from Human Preferences18 Sep 2019
- 2021Active Learning by Acquiring Contrastive Examplescited by 154
- 2022Active Learning on a Budget: Opposite Strategies Suit High and Low Budgetscited by 131
- 2021Gone Fishing: Neural Active Learning with Fisher Embeddingscited by 88
- 2022A Comparative Survey of Deep Active Learningcited by 88
- 2022Efficient Methods for Natural Language Processing: A Surveycited by 78
- 2022Active Learning Through a Covering Lenscited by 62
- 2021Active Learning for Domain Adaptation: An Energy-Based Approachcited by 53
- 2022A Survey of Active Learning for Natural Language Processingcited by 40
- 2023A comprehensive survey on deep active learning in medical image analysiscited by 32
- 2022GALAXY: Graph-based Active Learning at the Extremecited by 29
- 2021Cartography Active Learningcited by 26
- 2023The Efficiency Spectrum of Large Language Models: An Algorithmic Surveycited by 25
12 most cited of 94 All 94 (JSON)
- 2026Cumulative Meta-Learning from Active Learning Queries for Robustness to Spurious Correlations20 May 2026
- 2026Are Candidate Models Really Needed for Active Learning?14 May 2026
- 2026Positive-First Most Ambiguous: A Simple Active Learning Criterion for Interactive Retrieval of Rare Categories25 Mar 2026
- 2025IDEAL-M3D: Instance Diversity-Enriched Active Learning for Monocular 3D Detection24 Nov 2025
- 2025ALScope: A Unified Toolkit for Deep Active Learning6 Aug 2025
- 2025To Label or Not to Label: PALM -- A Predictive Model for Evaluating Sample Efficiency in Active Learning Models21 Jul 2025
- 2025Large Language Models are Demonstration Pre-Selectors for Themselves6 Jun 2025
- 2024Image Classification with Deep Reinforcement Active Learning27 Dec 2024
- 2024Enhancing Skin Lesion Classification Generalization with Active Domain Adaptation1 Dec 2024
- 2024Targeting Negative Flips in Active Learning using Validation Sets16 Nov 2024
- 2024ALVIN: Active Learning Via INterpolation11 Oct 2024
- 2024AHA: Human-Assisted Out-of-Distribution Generalization and Detection10 Oct 2024
12 newest of 94 All 94 (JSON)