mlsanityData to 14 Oct 2026

Online Active Model Selection for Pre-trained Classifiers

arXiv 2010.09818 ↗First posted 19 Oct 2020cs.LG stat.MLcited by 20

Not on the map. Why?

Abstract (arXiv)

Given k pre-trained classifiers and a stream of unlabeled data examples, how can we actively decide when to query a label so that we can distinguish the best model from the rest while making a small number of queries? Answering this question has a profound impact on a range of practical scenarios. In this work, we design an online selective sampling approach that actively selects informative examples to label and outputs the best model with high probability at any round. Our algorithm can be used for online prediction tasks for both adversarial and stochastic streams. We establish several theoretical guarantees for our algorithm and extensively demonstrate its effectiveness in our experimental studies.

Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). First posted on arXiv 19 Oct 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 2; 2022: 2; 2023: 2; 2024: 6; 2025: 3; 2026: 5.

20 papers.

Sort:

By area:

  1. 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,184
  2. 2021A Data Quality-Driven View of MLOpscited by 31
  3. 2024Which LLM to Play? Convergence-Aware Online Model Selection with Time-Increasing Banditscited by 27
  4. 2024All models are wrong, some are useful: Model Selection with Limited Labelscited by 8
  5. 2024Personalized Federated Learning with Mixture of Models for Adaptive Prediction and Model Fine-Tuningcited by 8
  6. 2025Never Start from Scratch: Expediting On-Device LLM Personalization via Explainable Model Selectioncited by 8
  7. 2025Consensus-Driven Active Model Selectioncited by 8
  8. 2023Anytime Model Selection in Linear Banditscited by 6
  9. 2024On the Necessity of Collaboration for Online Model Selection with Decentralized Datacited by 6
  10. 2021Active Assessment of Prediction Services as Accuracy Surface Over Attribute Combinationscited by 5
  11. 2022Contextual Active Model Selectioncited by 4
  12. 2022Contextual Decision Treescited by 2
8 more
  1. 2023Bayesian Online Learning for Consensus Predictioncited by 2
  2. 2024Budgeted Online Model Selection and Fine-Tuning via Federated Learningcited by 1
  3. 2026Large Language Model Selection with Limited Annotationscited by 1
  4. 2026Online Learning with LLM Experts from Limited Feedbackcited by 1
  5. 2025Large Language Model Selection with Limited Annotationscited by 0
  6. 2026Candidate Comparability Before Promotion: Conditional Validation in Adaptive Network Intrusion Detectioncited by 0
  7. 2026Which LLM to pick? Online Active Model Selection for Large Language Modelscited by 0
  8. 2026Bayesian Learning to Select Fair Classifierscited by 0