mlsanityData to 14 Oct 2026

Computational Lower Bounds for Regret Minimization in Normal-Form Games

arXiv 2411.01721 ↗First posted 4 Nov 2024cs.GT cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

A celebrated connection in the interface of online learning and game theory establishes that players minimizing swap regret converge to correlated equilibria (CE) -- a seminal game-theoretic solution concept. Despite the long history of this problem and the renewed interest it has received in recent years, a basic question remains open: how many iterations are needed to approximate an equilibrium under the usual normal-form representation? In this paper, we provide evidence that existing learning algorithms, such as multiplicative weights update, are close to optimal. In particular, we prove lower bounds for the problem of computing a CE that can be expressed as a uniform mixture of T product distributions -- namely, a uniform T-sparse CE; such lower bounds immediately circumscribe (computationally bounded) regret minimization algorithms in games. Our results are obtained in the algorithmic framework put forward by Kothari and Mehta (STOC 2018) in the context of computing Nash equilibria, which consists of the sum-of-squares (SoS) relaxation in conjunction with oracle access to a verification oracle; the goal in that framework is to lower bound either the degree of the SoS relaxation or the number of queries to the verification oracle. Here, we obtain two such hardness results, precluding computing i) uniform log n-sparse CE when ε =poly(1/log n) and ii) uniform n1 - o(1)-sparse CE when ε = poly(1/n).

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 81 references that are in the map. First posted on arXiv 4 Nov 2024.

Builds on

24 of 81 references.

References · 24

  1. 2013Optimization, Learning, and Games with Predictable Sequencescited by 188
  2. 2015Fast Convergence of Regularized Learning in Gamescited by 150
  3. 2021Near-Optimal No-Regret Learning in General Gamescited by 85
  4. 2023Fast swap regret minimization and applications to approximate correlated equilibriacited by 32
  5. 2016Settling the complexity of computing approximate two-player Nash equilibriacited by 31
  6. 2022Regret Minimization and Convergence to Equilibria in General-sum Markov Gamescited by 24
  7. 2014Dictionary Learning and Tensor Decomposition via the Sum-of-Squares Methodcited by 22
  8. 2016Polynomial-time Tensor Decompositions with Sum-of-Squarescited by 22
  9. 2021Fast Rates for Nonparametric Online Learning: From Realizability to Learning in Gamescited by 16
  10. 2021Polynomial-Time Sum-of-Squares Can Robustly Estimate Mean and Covariance of Gaussians Optimallycited by 14
  11. 2024Near-Optimal Policy Optimization for Correlated Equilibrium in General-Sum Markov Gamescited by 13
  12. 2014Sum-of-squares proofs and the quest toward optimal algorithmscited by 12
12 more
  1. 2015Sum-of-squares lower bounds for planted cliquecited by 12
  2. 2013Rounding Sum-of-Squares Relaxationscited by 11
  3. 2023Hardness of Independent Learning and Sparse Equilibrium Computation in Markov Gamescited by 10
  4. 2015Improved Sum-of-Squares Lower Bounds for Hidden Clique and Hidden Submatrix Problemscited by 9
  5. 2018Near-Optimal Communication Lower Bounds for Approximate Nash Equilibriacited by 6
  6. 2013Query Complexity of Correlated Equilibriumcited by 4
  7. 2013Finding Approximate Nash Equilibria of Bimatrix Games via Payoff Queriescited by 4
  8. 2020Smoothed Complexity of 2-player Nash Equilibriacited by 4
  9. 2024Polynomial-Time Computation of Exact Phi-Equilibria in Polyhedral Gamescited by 4
  10. 2024The complexity of approximate (coarse) correlated equilibrium for incomplete information gamescited by 4
  11. 2021Lower Bounds for the Query Complexity of Equilibria in Lipschitz Gamescited by 2
  12. 2023Towards Characterizing the First-order Query Complexity of Learning (Approximate) Nash Equilibria in Zero-sum Matrix Gamescited by 2

Built on by

Not cited yet.