Are Stochastic Multi-objective Bandits Harder than Single-objective Bandits?
Not on the map. Why?
Abstract (arXiv)
Multi-objective bandits have attracted increasing attention for their broad applicability, with (d)-dimensional reward vectors inducing Pareto regret. There has been a subtle debate over whether this added structure makes the problem fundamentally harder than single-objective bandits. We answer this by showing that, in terms of Pareto regret, it is surprisingly no harder: Pareto regret scales inversely with (g^dagger), the largest objective-wise suboptimality gap, and thus matches the smallest objective-wise classical regret. We formalize this idea via a novel method with upper and lower confidence-bound estimators for every arm-objective pair. It uses top-two races to compare arms within each objective and an uncertainty-greedy rule to allocate exploration toward the largest objective-wise gap (g^dagger), until the corresponding Pareto-optimal arm is committed to. We prove that it achieves Pareto regret of (O(nicefraclog Tg^dagger)), where (T) is the horizon, with no dependence on (d). A matching lower bound of (Omega(nicefraclog Tg^dagger)) implies optimality. We evaluate the method on synthetic and real-world datasets, confirming the theory and achieving order-of-magnitude reductions in Pareto regret over baselines. Real-world results further show that our method commits to a Pareto optimal arm, possibly at the cost of empirical fairness, suggesting a potential hardness absent in single-objective bandits.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 4 of its 20 references that are in the map. First posted on arXiv 8 Apr 2026.
Builds on
4 of 20 references.
References · 4
- 2022KuaiRec: A Fully-observed Dataset and Insights for Evaluating Recommender Systemscited by 96
- 2017Multi-objective Bandits: Optimizing the Generalized Gini Indexcited by 28
- 2018Multi-objective Contextual Bandit Problem with Similarity Informationcited by 21
- 2022Pareto Regret Analyses in Multi-objective Multi-armed Banditcited by 13
Built on by
Not cited yet.