A Complexity Measure for Active Learning in Multi-group Mean Estimation
Not on the map. Why?
Abstract (arXiv)
We study a max-risk objective for active learning in a multi-group mean estimation d-armed bandits: a learner adaptively allocates a budget of T samples across d groups to minimize the worst-case uncertainty index maxk∈[d]σk2/nk, where σk is the standard deviation of the distribution of arm d, and nk is the number of times arm d is sampled. We develop a local minimax framework and prove the first general lower bound for this objective, valid for any finite-variance hypothesis class. The bound separates difficulty into three orthogonal factors: a budget term, a heteroscedasticity index measuring how unevenly the uncertainty is spread across arms, and a model-dependent complexity measure, the Variance Local Curvature (VLC), which captures how much information a local change of variance creates inside the hypothesis class. For smooth classes, the VLC is a reparametrization of a variance--Fisher information, with closed-form values for common families. Benchmarking against the strongest available upper bound shows near-optimality up to logarithmic factors in broad regimes, and pinpoints a systematic gap in highly heterogeneous instances. Our proof introduces two key ingredients: a loss-induced ℓ1 geometry on the decision space, and a representation-based instance generator that reduces hard-instance construction to an explicit random matrix calculation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 9 of its 17 references that are in the map. First posted on arXiv 12 Jun 2026.
Builds on
9 of 17 references.
References · 9
- 2021Geometric Deep Learning on Molecular Representationscited by 113
- 2018An elementary introduction to information geometrycited by 76
- 2014Lipschitz Bandits: Regret Lower Bounds and Optimal Algorithmscited by 59
- 2022Structure-based drug design with geometric deep learningcited by 40
- 2014Unimodal Bandits: Regret Lower Bounds and Optimal Algorithmscited by 36
- 2020Network Geometrycited by 31
- 2015Upper-Confidence-Bound Algorithms for Active Learning in Multi-Armed Banditscited by 29
- 2020On Lower Bounds for Standard and Robust Gaussian Process Bandit Optimizationcited by 29
- 2023A Survey of Geometric Optimization for Deep Learning: From Euclidean Space to Riemannian Manifoldcited by 21
Built on by
Not cited yet.