mlsanityData to 14 Oct 2026

Minimax Alternating Regret for the Experts Problem and Online Convex Optimization

arXiv 2608.25182 ↗First posted 25 Aug 2026stat.ML cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

In this paper, we study alternating regret in online convex optimization (OCO), motivated by the success of alternating learning dynamics in two-player games. Although previous works have shown that o(√T) alternating regret is achievable under various assumptions on the loss functions and feasible domains, the minimax regret rate has remained open even for the expert problem. In this paper, we resolve this question by showing matching lower and upper bounds for both the expert problem and general OCO. Somewhat surprisingly, for the d-expert problem, we show that the minimax alternating regret is Theta(log d), independent of the horizon T. This significantly improves upon the best-known O(T1/3log2/3 d) established by Hait et al. [2025]. We further extend our results to general OCO over a d-dimensional compact convex set and prove that the worst-case minimax alternating regret is Thetaleft(dlog left(1+fracTdright)right), also significantly improving upon the best-known O((dlog T)2/3T1/3) upper bound and resolving the open problem posed by Cevher et al. [2023], Hait et al. [2025]. Technically, our upper bound for the expert problem is achieved by a corrected variant of Hedge, in which carefully designed correction terms cancel the unfavorable curvature arising in the alternating-regret analysis. We extend the same corrected-potential argument to continuous action sets to obtain the optimal alternating-regret rate for OCO. For the lower bounds, the expert construction repeatedly eliminates half of the candidate experts, while the OCO lower bound instance construction replaces this discrete elimination by a more involved multiscale construction on the unit disk.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 20 references that are in the map. First posted on arXiv 25 Aug 2026.

Builds on

13 of 20 references.

References · 13

  1. 2019Introduction to Online Convex Optimizationcited by 803
  2. 2013Optimization, Learning, and Games with Predictable Sequencescited by 188
  3. 2015Fast Convergence of Regularized Learning in Gamescited by 150
  4. 2021Near-Optimal No-Regret Learning in General Gamescited by 85
  5. 2014Solving Large Imperfect Information Games Using CFR+cited by 78
  6. 2020Hedging in games: Faster convergence of external and swap regretscited by 57
  7. 2019Finite Regret and Cycles with Fixed Step-Size via Alternating Gradient Descent-Ascentcited by 29
  8. 2022Near-Optimal No-Regret Learning Dynamics for General Convex Gamescited by 25
  9. 2018Revisiting CFR+ and Alternating Updatescited by 19
  10. 2022Alternating Mirror Descent for Constrained Min-Max Gamescited by 13
  11. 2025Alternating Regret for Online Convex Optimizationcited by 4
  12. 2024A Symplectic Analysis of Alternating Mirror Descentcited by 2
1 more
  1. 2025Optimism Without Regularization: Constant Regret in Zero-Sum Gamescited by 2

Built on by

Not cited yet.