mlsanityData to 7 Oct 2026

Best-of-Both-Worlds Multi-Dueling Bandits: Unified Algorithms for Stochastic and Adversarial Preferences under Condorcet and Borda Objectives

arXiv 2603.18972 ↗First posted 19 Mar 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Multi-dueling bandits, where a learner selects m ≥ 2 arms per round and observes only the winner, arise naturally in many applications including ranking and recommendation systems, yet a fundamental question has remained open: can a single algorithm perform optimally in both stochastic and adversarial environments, without knowing which regime it faces? We answer this affirmatively, providing the first best-of-both-worlds algorithms for multi-dueling bandits under both Condorcet and Borda objectives. For the Condorcet setting, we propose textttMetaDueling, a black-box reduction that converts any dueling bandit algorithm into a multi-dueling bandit algorithm by transforming multi-way winner feedback into an unbiased pairwise signal. Instantiating our reduction with textttVersatile-DB yields the first best-of-both-worlds algorithm for multi-dueling bandits: it achieves O(√KT) pseudo-regret against adversarial preferences and the instance-optimal Oleft(sumi neq a^star fraclog TDeltairight) pseudo-regret under stochastic preferences, both simultaneously and without prior knowledge of the regime. For the Borda setting, we propose textttSA-MiDEX, a stochastic-and-adversarial algorithm that achieves Oleft(K2 log KT + K log2 T + sum_i: DeltaiB > 0 fracKlog KT(DeltaiB)2right) regret in stochastic environments and Oleft(K √T log KT + K1/3 T2/3 (log K)1/3right) regret against adversaries, again without prior knowledge of the regime. We complement our upper bounds with matching lower bounds for the Condorcet setting. For the Borda setting, our upper bounds are near-optimal with respect to the lower bounds (within a factor of K) and match the best-known results in the literature.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 32 references that are in the map. First posted on arXiv 19 Mar 2026.

Builds on

15 of 32 references.

References · 15

  1. 2018Tsallis-INF: An Optimal Algorithm for Stochastic and Adversarial Banditscited by 123
  2. 2015Contextual Dueling Banditscited by 101
  3. 2017Efficient Contextual Bandits in Non-stationary Worldscited by 62
  4. 2019Beating Stochastic and Adversarial Semi-bandits Optimally and Simultaneouslycited by 53
  5. 2015Regret Lower Bound and Optimal Algorithm in Dueling Bandit Problemcited by 51
  6. 2021Achieving Near Instance-Optimality and Minimax-Optimality in Stochastic and Adversarial Linear Bandits Simultaneouslycited by 48
  7. 2016An algorithm with nearly optimal pseudo-regret for both stochastic and adversarial banditscited by 47
  8. 2021The best of both worlds: stochastic and adversarial episodic MDPs with unknown transitioncited by 40
  9. 2015Copeland Dueling Banditscited by 36
  10. 2020Adversarial Dueling Banditscited by 33
  11. 2015Sparse Dueling Banditscited by 29
  12. 2018PAC Battling Bandits in the Plackett-Luce Modelcited by 27
3 more
  1. 2016Copeland Dueling Bandit Problem: Regret Lower Bound, Optimal Algorithm, and Computationally Efficient Algorithmcited by 16
  2. 2016Multi-Dueling Bandits and Their Application to Online Ranker Evaluationcited by 16
  3. 2024Adversarial Multi-dueling Banditscited by 1

Built on by

Not cited yet.