Active Learning for Cost-Sensitive Classification
Not on the map. Why?
Abstract (arXiv)
We design an active learning algorithm for cost-sensitive multiclass classification: problems where different errors have different costs. Our algorithm, COAL, makes predictions by regressing to each label's cost and predicting the smallest. On a new example, it uses a set of regressors that perform well on past data to estimate possible costs for each label. It queries only the labels that could be the best, ignoring the sure losers. We prove COAL can be efficiently implemented for any regression family that admits squared loss optimization; it also enjoys strong guarantees with respect to predictive performance and labeling effort. We empirically compare COAL to passive learning and several active learning baselines, showing significant improvements in labeling effort and test cost on real-world datasets.
Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Mar 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 10; 2023: 6; 2024: 2; 2025: 8; 2026: 3.
40 papers.
Sort:
By area:
- 2021On Statistical Bias In Active Learning: How and When To Fix Itcited by 72
- 2021Smoothed Analysis with Adaptive Adversariescited by 57
- 2021Efficient First-Order Contextual Bandits: Prediction, Allocation, and Triangular Discriminationcited by 53
- 2022Sample Efficient Learning of Predictors that Complement Humanscited by 46
- 2022Making Decisions under Outcome Performativitycited by 32
- 2022Efficient Active Learning with Abstentioncited by 21
- 2023Streaming Active Learning with Deep Neural Networkscited by 20
- 2022Oracle-Efficient Online Learning for Beyond Worst-Case Adversariescited by 19
- 2021Improved Algorithms for Efficient Active Learning Halfspaces with Massart and Tsybakov noisecited by 18
- 2021A Survey on Cost Types, Interaction Schemes, and Annotator Performance Models in Selection Algorithms for Active Learning in Classificationcited by 17
- 2022Instance-optimal PAC Algorithms for Contextual Banditscited by 16
- 2023Adapting to Continuous Covariate Shift via Online Density Ratio Estimationcited by 15
28 more
- 2021Active Learning in Bayesian Neural Networks with Balanced Entropy Learning Principlecited by 14
- 2022Active Learning with Neural Networks: Insights from Nonparametric Statisticscited by 13
- 2021Bayesian Active Learning by Disagreements: A Geometric Perspectivecited by 9
- 2021Going Beyond Linear RL: Sample Efficient Neural Function Approximationcited by 9
- 2023Pessimistic Nonlinear Least-Squares Value Iteration for Offline Reinforcement Learningcited by 9
- 2022Promises and Pitfalls of Threshold-based Auto-labelingcited by 6
- 2025Test-Time Matching: Unlocking Compositional Reasoning in Multimodal Modelscited by 6
- 2021Towards Costless Model Selection in Contextual Bandits: A Bias-Variance Perspectivecited by 4
- 2023Horizon-Free and Instance-Dependent Regret Bounds for Reinforcement Learning with General Function Approximationcited by 4
- 2024Mitigating Covariate Shift in Misspecified Regression with Applications to Reinforcement Learningcited by 4
- 2025Revisiting Active Learning under (Human) Label Variationcited by 4
- 2026Active Testing of Large Language Models via Approximate Neyman Allocationcited by 4
- 2021Corruption Robust Active Learningcited by 3
- 2024Robust Offline Policy Learning with Observational Data from Multiple Sourcescited by 3
- 2025Enhancing Cost Efficiency in Active Learning with Candidate Set Querycited by 3
- 2025Towards Multimodal Active Learning: Efficient Learning with Limited Paired Datacited by 3
- 2022Efficient and Reliable Probabilistic Interactive Learning with Structured Outputscited by 2
- 2022Pixel is All You Need: Adversarial Trajectory-Ensemble Active Learning for Salient Object Detectioncited by 2
- 2025On The Statistical Complexity of Offline Decision-Makingcited by 2
- 2021Online Sub-Sampling for Reinforcement Learning with General Function Approximationcited by 1
- 2022Black-box Generalization of Machine Teachingcited by 1
- 2025Towards Fundamental Limits for Active Multi-distribution Learningcited by 1
- 2026Loss-Driven Bayesian Active Learningcited by 1
- 2023Leveraging User-Triggered Supervision in Contextual Banditscited by 0
- 2023Nonparametric active learning for cost-sensitive classificationcited by 0
- 2025Active Learning via Regression Beyond Realizabilitycited by 0
- 2025ConBatch-BAL: Batch Bayesian Active Learning under Budget Constraintscited by 0
- 2026Active Learning with Foundation Model Priors: Efficient Learning under Class Imbalancecited by 0
- 2026Active Learning with Foundation Model Priors: Efficient Learning under Class Imbalance30 May 2026
- 2026Active Testing of Large Language Models via Approximate Neyman Allocation11 May 2026
- 2026Loss-Driven Bayesian Active Learning13 Apr 2026
- 2025Test-Time Matching: Unlocking Compositional Reasoning in Multimodal Models9 Oct 2025
- 2025Towards Multimodal Active Learning: Efficient Learning with Limited Paired Data25 Sep 2025
- 2025ConBatch-BAL: Batch Bayesian Active Learning under Budget Constraints7 Jul 2025
- 2025Revisiting Active Learning under (Human) Label Variation3 Jul 2025
- 2025Towards Fundamental Limits for Active Multi-distribution Learning21 Jun 2025
- 2025Active Learning via Regression Beyond Realizability31 May 2025
- 2025Enhancing Cost Efficiency in Active Learning with Candidate Set Query10 Feb 2025
- 2025On The Statistical Complexity of Offline Decision-Making10 Jan 2025
- 2024Robust Offline Policy Learning with Observational Data from Multiple Sources11 Oct 2024
28 more
- 2024Mitigating Covariate Shift in Misspecified Regression with Applications to Reinforcement Learning22 Jan 2024
- 2023Horizon-Free and Instance-Dependent Regret Bounds for Reinforcement Learning with General Function Approximation7 Dec 2023
- 2023Pessimistic Nonlinear Least-Squares Value Iteration for Offline Reinforcement Learning2 Oct 2023
- 2023Nonparametric active learning for cost-sensitive classification30 Sep 2023
- 2023Streaming Active Learning with Deep Neural Networks5 Mar 2023
- 2023Leveraging User-Triggered Supervision in Contextual Bandits7 Feb 2023
- 2023Adapting to Continuous Covariate Shift via Online Density Ratio Estimation6 Feb 2023
- 2022Pixel is All You Need: Adversarial Trajectory-Ensemble Active Learning for Salient Object Detection13 Dec 2022
- 2022Promises and Pitfalls of Threshold-based Auto-labeling22 Nov 2022
- 2022Active Learning with Neural Networks: Insights from Nonparametric Statistics15 Oct 2022
- 2022Making Decisions under Outcome Performativity4 Oct 2022
- 2022Sample Efficient Learning of Predictors that Complement Humans19 Jul 2022
- 2022Instance-optimal PAC Algorithms for Contextual Bandits5 Jul 2022
- 2022Black-box Generalization of Machine Teaching30 Jun 2022
- 2022Efficient Active Learning with Abstention31 Mar 2022
- 2022Efficient and Reliable Probabilistic Interactive Learning with Structured Outputs17 Feb 2022
- 2022Oracle-Efficient Online Learning for Beyond Worst-Case Adversaries17 Feb 2022
- 2021A Survey on Cost Types, Interaction Schemes, and Annotator Performance Models in Selection Algorithms for Active Learning in Classification23 Sep 2021
- 2021Going Beyond Linear RL: Sample Efficient Neural Function Approximation14 Jul 2021
- 2021Efficient First-Order Contextual Bandits: Prediction, Allocation, and Triangular Discrimination5 Jul 2021
- 2021Corruption Robust Active Learning21 Jun 2021
- 2021Online Sub-Sampling for Reinforcement Learning with General Function Approximation14 Jun 2021
- 2021Towards Costless Model Selection in Contextual Bandits: A Bias-Variance Perspective11 Jun 2021
- 2021Active Learning in Bayesian Neural Networks with Balanced Entropy Learning Principle30 May 2021
- 2021Bayesian Active Learning by Disagreements: A Geometric Perspective6 May 2021
- 2021Smoothed Analysis with Adaptive Adversaries16 Feb 2021
- 2021Improved Algorithms for Efficient Active Learning Halfspaces with Massart and Tsybakov noise10 Feb 2021
- 2021On Statistical Bias In Active Learning: How and When To Fix It27 Jan 2021
- 2021On Statistical Bias In Active Learning: How and When To Fix Itcited by 72
- 2021Smoothed Analysis with Adaptive Adversariescited by 57
- 2021Efficient First-Order Contextual Bandits: Prediction, Allocation, and Triangular Discriminationcited by 53
- 2022Sample Efficient Learning of Predictors that Complement Humanscited by 46
- 2022Making Decisions under Outcome Performativitycited by 32
- 2022Efficient Active Learning with Abstentioncited by 21
- 2023Streaming Active Learning with Deep Neural Networkscited by 20
- 2022Oracle-Efficient Online Learning for Beyond Worst-Case Adversariescited by 19
- 2021Improved Algorithms for Efficient Active Learning Halfspaces with Massart and Tsybakov noisecited by 18
- 2021A Survey on Cost Types, Interaction Schemes, and Annotator Performance Models in Selection Algorithms for Active Learning in Classificationcited by 17
- 2022Instance-optimal PAC Algorithms for Contextual Banditscited by 16
- 2023Adapting to Continuous Covariate Shift via Online Density Ratio Estimationcited by 15
12 most cited of 36 All 36 (JSON)
- 2026Active Learning with Foundation Model Priors: Efficient Learning under Class Imbalance30 May 2026
- 2026Loss-Driven Bayesian Active Learning13 Apr 2026
- 2025Towards Multimodal Active Learning: Efficient Learning with Limited Paired Data25 Sep 2025
- 2025ConBatch-BAL: Batch Bayesian Active Learning under Budget Constraints7 Jul 2025
- 2025Revisiting Active Learning under (Human) Label Variation3 Jul 2025
- 2025Towards Fundamental Limits for Active Multi-distribution Learning21 Jun 2025
- 2025Active Learning via Regression Beyond Realizability31 May 2025
- 2025Enhancing Cost Efficiency in Active Learning with Candidate Set Query10 Feb 2025
- 2025On The Statistical Complexity of Offline Decision-Making10 Jan 2025
- 2024Mitigating Covariate Shift in Misspecified Regression with Applications to Reinforcement Learning22 Jan 2024
- 2023Horizon-Free and Instance-Dependent Regret Bounds for Reinforcement Learning with General Function Approximation7 Dec 2023
- 2023Nonparametric active learning for cost-sensitive classification30 Sep 2023
12 newest of 36 All 36 (JSON)