Volumetric Spanners: an Efficient Exploration Basis for Learning
Not on the map. Why?
Abstract (arXiv)
Numerous machine learning problems require an exploration basis - a mechanism to explore the action space. We define a novel geometric notion of exploration basis with low variance, called volumetric spanners, and give efficient algorithms to construct such a basis. We show how efficient volumetric spanners give rise to the first efficient and optimal regret algorithm for bandit linear optimization over general convex sets. Previously such results were known only for specific convex sets, or under special conditions such as the existence of an efficient self-concordant barrier for the underlying set.
Key facts. Cited by 24 papers in the map (data through 14 Oct 2026). First posted on arXiv 21 Dec 2013.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 4; 2023: 4; 2024: 2; 2025: 5; 2026: 6.
24 papers.
Sort:
- 2021Online Learning via Offline Greedy Algorithms: Applications in Market Design and Optimizationcited by 40
- 2022Contextual Bandits with Large Action Spaces: Made Practicalcited by 33
- 2022Contexts can be Cheap: Solving Stochastic Contextual Bandits with Linear Bandit Algorithmscited by 19
- 2023Bayesian Design Principles for Frequentist Sequential Learningcited by 18
- 2023A Unified Analysis of Nonstochastic Delayed Feedback for Combinatorial Semi-Bandits, Linear Bandits, and MDPscited by 15
- 2023Exploration via linearly perturbed loss minimisationcited by 13
- 2021Online Markov Decision Processes with Aggregate Bandit Feedbackcited by 10
- 2022Fast online inference for nonlinear contextual bandit based on Generative Adversarial Networkcited by 7
- 2024Fast John Ellipsoid Computation with Differential Privacy Optimizationcited by 7
- 2025Contextual Linear Bandits with Delay as Payoffcited by 7
- 2025Efficient Near-Optimal Algorithm for Online Shortest Paths in Directed Acyclic Graphs with Bandit Feedback Against Adaptive Adversariescited by 6
- 2022Contextual Pandora's Boxcited by 5
12 more
- 2023Tight Bounds for Volumetric Spanners and Applicationscited by 4
- 2025From Contextual Combinatorial Semi-Bandits to Bandit List Classification: Improved Sample Complexity with Sparse Rewardscited by 4
- 2026Efficient Uncoupled Learning Dynamics with tildeO!left(T-1/4right) Last-Iterate Convergence in Bilinear Saddle-Point Problems over Convex Sets under Bandit Feedbackcited by 4
- 2026Swap Regret Minimization Through Response-Based Approachabilitycited by 2
- 2025Self-Concordant Perturbations for Linear Banditscited by 1
- 2021Towards the D-Optimal Online Experiment Design for Recommender Selectioncited by 0
- 2024Is Offline Decision Making Possible with Only Few Samples? Reliable Decisions in Data-Starved Bandits via Trust Region Enhancementcited by 0
- 2025Bayesian Optimization for Dynamic Pricing and Learningcited by 0
- 2026Efficient Swap Regret Minimization in Combinatorial Banditscited by 0
- 2026Near-Optimal Regret for Distributed Adversarial Bandits: A Black-Box Approachcited by 0
- 2026A Complete Characterization of Learnability for Adversarial Noisy Banditscited by 0
- 2026Follow the Perturbed Leader for Linear Bandits: √T Regret over General Convex Setscited by 0
- 2026Follow the Perturbed Leader for Linear Bandits: √T Regret over General Convex Sets13 Oct 2026
- 2026A Complete Characterization of Learnability for Adversarial Noisy Bandits9 May 2026
- 2026Efficient Uncoupled Learning Dynamics with tildeO!left(T-1/4right) Last-Iterate Convergence in Bilinear Saddle-Point Problems over Convex Sets under Bandit Feedback24 Feb 2026
- 2026Near-Optimal Regret for Distributed Adversarial Bandits: A Black-Box Approach6 Feb 2026
- 2026Swap Regret Minimization Through Response-Based Approachability5 Feb 2026
- 2026Efficient Swap Regret Minimization in Combinatorial Bandits2 Feb 2026
- 2025Self-Concordant Perturbations for Linear Bandits28 Oct 2025
- 2025Bayesian Optimization for Dynamic Pricing and Learning14 Oct 2025
- 2025Efficient Near-Optimal Algorithm for Online Shortest Paths in Directed Acyclic Graphs with Bandit Feedback Against Adaptive Adversaries1 Apr 2025
- 2025Contextual Linear Bandits with Delay as Payoff18 Feb 2025
- 2025From Contextual Combinatorial Semi-Bandits to Bandit List Classification: Improved Sample Complexity with Sparse Rewards13 Feb 2025
- 2024Fast John Ellipsoid Computation with Differential Privacy Optimization12 Aug 2024
12 more
- 2024Is Offline Decision Making Possible with Only Few Samples? Reliable Decisions in Data-Starved Bandits via Trust Region Enhancement24 Feb 2024
- 2023Exploration via linearly perturbed loss minimisation13 Nov 2023
- 2023Bayesian Design Principles for Frequentist Sequential Learning1 Oct 2023
- 2023Tight Bounds for Volumetric Spanners and Applications29 Sep 2023
- 2023A Unified Analysis of Nonstochastic Delayed Feedback for Combinatorial Semi-Bandits, Linear Bandits, and MDPs15 May 2023
- 2022Contexts can be Cheap: Solving Stochastic Contextual Bandits with Linear Bandit Algorithms8 Nov 2022
- 2022Contextual Bandits with Large Action Spaces: Made Practical12 Jul 2022
- 2022Contextual Pandora's Box26 May 2022
- 2022Fast online inference for nonlinear contextual bandit based on Generative Adversarial Network17 Feb 2022
- 2021Towards the D-Optimal Online Experiment Design for Recommender Selection23 Oct 2021
- 2021Online Learning via Offline Greedy Algorithms: Applications in Market Design and Optimization18 Feb 2021
- 2021Online Markov Decision Processes with Aggregate Bandit Feedback31 Jan 2021
- 2021Online Learning via Offline Greedy Algorithms: Applications in Market Design and Optimizationcited by 40
- 2022Contextual Bandits with Large Action Spaces: Made Practicalcited by 33
- 2022Contexts can be Cheap: Solving Stochastic Contextual Bandits with Linear Bandit Algorithmscited by 19
- 2023Bayesian Design Principles for Frequentist Sequential Learningcited by 18
- 2023A Unified Analysis of Nonstochastic Delayed Feedback for Combinatorial Semi-Bandits, Linear Bandits, and MDPscited by 15
- 2023Exploration via linearly perturbed loss minimisationcited by 13
- 2021Online Markov Decision Processes with Aggregate Bandit Feedbackcited by 10
- 2022Fast online inference for nonlinear contextual bandit based on Generative Adversarial Networkcited by 7
- 2024Fast John Ellipsoid Computation with Differential Privacy Optimizationcited by 7
- 2025Contextual Linear Bandits with Delay as Payoffcited by 7
- 2025Efficient Near-Optimal Algorithm for Online Shortest Paths in Directed Acyclic Graphs with Bandit Feedback Against Adaptive Adversariescited by 6
- 2022Contextual Pandora's Boxcited by 5
12 most cited of 24 All 24 (JSON)
- 2026Follow the Perturbed Leader for Linear Bandits: √T Regret over General Convex Sets13 Oct 2026
- 2026A Complete Characterization of Learnability for Adversarial Noisy Bandits9 May 2026
- 2026Efficient Uncoupled Learning Dynamics with tildeO!left(T-1/4right) Last-Iterate Convergence in Bilinear Saddle-Point Problems over Convex Sets under Bandit Feedback24 Feb 2026
- 2026Near-Optimal Regret for Distributed Adversarial Bandits: A Black-Box Approach6 Feb 2026
- 2026Swap Regret Minimization Through Response-Based Approachability5 Feb 2026
- 2026Efficient Swap Regret Minimization in Combinatorial Bandits2 Feb 2026
- 2025Self-Concordant Perturbations for Linear Bandits28 Oct 2025
- 2025Bayesian Optimization for Dynamic Pricing and Learning14 Oct 2025
- 2025Efficient Near-Optimal Algorithm for Online Shortest Paths in Directed Acyclic Graphs with Bandit Feedback Against Adaptive Adversaries1 Apr 2025
- 2025Contextual Linear Bandits with Delay as Payoff18 Feb 2025
- 2025From Contextual Combinatorial Semi-Bandits to Bandit List Classification: Improved Sample Complexity with Sparse Rewards13 Feb 2025
- 2024Fast John Ellipsoid Computation with Differential Privacy Optimization12 Aug 2024
12 newest of 24 All 24 (JSON)