Securing Equal Share: A Principled Approach for Learning Multiplayer Symmetric Games
Not on the map. Why?
Abstract (arXiv)
This paper examines multiplayer symmetric constant-sum games with more than two players in a competitive setting, including examples like Mahjong, Poker, and various board and video games. In contrast to two-player zero-sum games, equilibria in multiplayer games are neither unique nor non-exploitable, failing to provide meaningful guarantees when competing against opponents who play different equilibria or non-equilibrium strategies. This gives rise to a series of long-lasting fundamental questions in multiplayer games regarding suitable objectives, solution concepts, and principled algorithms. This paper takes an initial step towards addressing these challenges by focusing on the natural objective of equal share -- securing an expected payoff of C/n in an n-player symmetric game with a total payoff of C. We rigorously identify the theoretical conditions under which achieving an equal share is tractable and design a series of efficient algorithms, inspired by no-regret learning, that provably attain approximate equal share across various settings. Furthermore, we provide complementary lower bounds that justify the sharpness of our theoretical results. Our experimental results highlight worst-case scenarios where meta-algorithms from prior state-of-the-art systems for multiplayer games fail to secure an equal share, while our algorithm succeeds, demonstrating the effectiveness of our approach.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 39 references that are in the map. First posted on arXiv 6 Jun 2024.
Builds on
17 of 39 references.
References · 17
- 2019Dota 2 with Large Scale Deep Reinforcement Learningcited by 1,084
- 2017DeepStack: Expert-Level Artificial Intelligence in No-Limit Pokercited by 228
- 2015Fast Convergence of Regularized Learning in Gamescited by 149
- 2021V-Learning -- A Simple, Efficient, Decentralized Algorithm for Multiagent RLcited by 111
- 2015Strongly Adaptive Online Learningcited by 102
- 2018Last-Iterate Convergence: Zero-Sum Games and Constrained Min-Max Optimizationcited by 97
- 2021Near-Optimal No-Regret Learning in General Gamescited by 85
- 2020Towards Playing Full MOBA Games with Deep Reinforcement Learningcited by 78
- 2021DouZero: Mastering DouDizhu with Self-Play Deep Reinforcement Learningcited by 65
- 2020Hedging in games: Faster convergence of external and swap regretscited by 57
- 2020Suphx: Mastering Mahjong with Deep Reinforcement Learningcited by 55
- 2021Modeling Strong and Human-Like Gameplay with KL-Regularized Searchcited by 50
5 more
- 2022Mastering the Game of No-Press Diplomacy via Human-Regularized Reinforcement Learning and Planningcited by 47
- 2020Human-Level Performance in No-Press Diplomacy via Equilibrium Searchcited by 41
- 2022Near-Optimal Learning of Extensive-Form Games with Imperfect Informationcited by 26
- 2020No-Regret Learning Dynamics for Extensive-Form Correlated Equilibriumcited by 19
- 2022Efficient Phi-Regret Minimization in Extensive-Form Games via Online Mirror Descentcited by 15
Built on by
Not cited yet.