mlsanityData to 14 Oct 2026

The Oracle Complexity of Simplex-based Matrix Games

arXiv 2412.06990 ↗First posted 9 Dec 2024cs.GT cs.LG math.OCcited by 4

Not on the map. Why?

Abstract (arXiv)

We study the problem of solving matrix games of the form minp∈Deltamaxw∈WptopAw, where A is a matrix and Delta is the probability simplex. This problem encapsulates canonical tasks such as finding a linear separator and computing Nash equilibria in zero-sum games. However, perhaps surprisingly, its inherent complexity (as formalized in the standard framework of oracle complexity) is not well understood. In this work, we first identify different oracle models that are implicitly used by prior algorithms, corresponding to multiplying the matrix A by a vector from either one or both sides. We then prove complexity lower bounds for algorithms under both access models, which in particular imply a separation between them. As our main result, we prove that in the general ℓp/simplex setting where W is an ℓp ball for p∈[1,∞], any algorithm that utilizes two-sided matrix-vector multiplications requires tildeOmega(ε-2/3) iterations to return an ε-suboptimal solution. For any p∈[1,∞], this is either the first lower bound for such problems, or an exponential improvement over the previously best-known results. Moreover, for the canonical tasks of finding a linear separator and computing a Nash equilibrium, our lower bounds match (up to log factors) recent algorithms of Karmarkar, O'Carroll and Sidford (2026), thereby resolving their oracle complexities in a natural setting.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 13 of its 43 references that are in the map. First posted on arXiv 9 Dec 2024.

Builds on

13 of 43 references.

References · 13

  1. 2019Lower Bounds for Non-Convex Stochastic Optimizationcited by 307
  2. 2013Optimization, Learning, and Games with Predictable Sequencescited by 188
  3. 2017Lower Bounds for Finding Stationary Points Icited by 126
  4. 2018Lower complexity bounds of first-order methods for convex-concave bilinear saddle-point problemscited by 76
  5. 2019Variance Reduction for Matrix Gamescited by 38
  6. 2021Fast Margin Maximization via Dual Accelerationcited by 33
  7. 2020Acceleration with a Ball Optimization Oraclecited by 31
  8. 2022On Accelerated Perceptrons and Beyondcited by 6
  9. 2019Faster width-dependent algorithm for mixed packing and covering LPscited by 3
  10. 2023A Whole New Ball Game: A Primal Accelerated Method for Matrix Games and Minimizing the Maximum of Smooth Functionscited by 3
  11. 2020Semi-Streaming Bipartite Matching in Fewer Passes and Optimal Spacecited by 2
  12. 2023Towards Characterizing the First-order Query Complexity of Learning (Approximate) Nash Equilibria in Zero-sum Matrix Gamescited by 2
1 more
  1. 2024Multiplicative Weights Update, Area Convexity and Random Coordinate Descent for Densest Subgraph Problemscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 2.

4 papers.