One Knob to Rule Them All: A Unified Optimal Transport View of Cold-Start Active Learning
Not on the map. Why?
Abstract (arXiv)
Cold-Start Active Learning (CSAL) aims to select a valuable subset from an unlabeled pool without any prior knowledge or human assistance. Existing methods take diverse routes based on typicality, coverage, or diversity. Each rests on its own inductive bias and therefore performs well on some tasks yet poorly on others. We argue that the real challenge is not to design yet another selection heuristic, but to make CSAL adapt automatically to the data and task at hand. To this end, we revisit CSAL through the lens of optimal transport. First, we propose a generalized transport selection framework that reveals the shared allocation structure of existing methods and exactly subsumes representative formulations. Second, we introduce a theoretical analysis that characterizes the trade-off controlled by entropic regularization and establishes a task-agnostic minimax bound for cold-start selection. These results provide a principled foundation for adapting the regularization strength to the unlabeled data. Third, we derive a data-adaptive regularization rule and present a novel Sinkhorn-based CSAL algorithm, termed ε-Adaptive Selection (ε-AS). Extensive experiments on six public datasets and multiple annotation budgets show that ε-AS consistently achieves state-of-the-art performance. On ImageNet-1k, it improves the average accuracy over ActiveFT by 1.29% while reducing selection time by 56.2%. Code will be released at https://github.com/Z-yiwei/OT-CSAL
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 54 references that are in the map. First posted on arXiv 4 Aug 2026.
Builds on
18 of 54 references.
References · 18
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
- 2017Deep Bayesian Active Learning with Image Datacited by 812
- 2019Deep Batch Active Learning by Diverse, Uncertain Gradient Lower Boundscited by 602
- 2020A Survey of Deep Active Learningcited by 547
- 2019Selection via Proxy: Efficient Data Selection for Deep Learningcited by 337
- 2019Learning Loss for Active Learningcited by 335
- 2013A survey of the Schr"odinger problem and some of its connections with optimal transportcited by 286
- 2017Near-linear time approximation algorithms for optimal transport via Sinkhorn iterationcited by 219
- 2022Active Learning on a Budget: Opposite Strategies Suit High and Low Budgetscited by 131
- 2020Cold-start Active Learning through Self-supervised Language Modelingcited by 128
- 2021Gone Fishing: Neural Active Learning with Fisher Embeddingscited by 88
- 2019Statistical bounds for entropic optimal transport: sample complexity and the central limit theoremcited by 85
6 more
- 2021Reducing Label Effort: Self-Supervised meets Active Learningcited by 42
- 2019Parting with Illusions about Deep Active Learningcited by 38
- 2023Active Finetuning: Exploiting Annotation Budget in the Pretraining-Finetuning Paradigmcited by 36
- 2024Generalized Coverage for More Robust Low-Budget Active Learningcited by 15
- 2024Uncertainty Herding: One Active Learning Method for All Label Budgetscited by 12
- 2024DCoM: Active Learning for All Learnerscited by 2
Built on by
Not cited yet.