Equilibrium Residuals Expose Three Regimes of Matrix-Game Strategic Reasoning in Language Models
On the map: LLM reasoning → Reasoning for agents, planning and code
Abstract (arXiv)
Large language models can score well on named game-theory benchmarks while failing on the same strategic computation once semantic cues are removed. We show this gap with procedurally generated zero-sum matrix games: a model that recognizes familiar games drops to 34%, 18%, and 2% success on anonymous 2×2, 3×3, and 5×5 payoff matrices. The benchmark separates semantic recall, learned approximate Nash computation, and an output-interface bottleneck that limits scale. Training only on 2×2 and 3×3 games, supervised fine-tuning raises unseen 5×5--7×7 success from 2% to 61%, while exploitability-reward training averages 37% with high seed variance. We prove that the exploitability residual is 2-Lipschitz in payoff perturbations, unlike discontinuous vertex-returning LP equilibrium selectors, explaining why residual training can transfer under payoff shifts even when formatting instability limits mean performance. A dominated-action padding experiment provides causal evidence: trained models solve 3×3 games embedded in much larger matrices, while random-padded controls fail and dense 12×12 games remain near failure. Procedural evaluation is therefore necessary for measuring strategic reasoning, and residual rewards expose a real but format-limited route to approximate equilibrium computation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 20 of its 26 references that are in the map. First posted on arXiv 11 May 2026.
Builds on
20 of 26 references.
Closest ancestors · 3
Same direction, newest first
- 2025MARSHAL: Incentivizing Multi-Agent Reasoning via Self-Play with Strategic LLMs17 Oct
- 2024TMGBench: A Systematic Game Benchmark for Evaluating Strategic Reasoning Abilities of LLMs14 Oct
- 2023Strategic Reasoning with Language Models30 May
Other references · 17
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2017Deep reinforcement learning from human preferencescited by 3,912
- 2023Let's Verify Step by Stepcited by 3,789
- 2021Show Your Work: Scratchpads for Intermediate Computation with Language Modelscited by 886
- 2022What Can Transformers Learn In-Context? A Case Study of Simple Function Classescited by 715
- 2024Self-Rewarding Language Modelscited by 681
- 2024Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Modelscited by 557
- 2022CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learningcited by 358
- 2017A Unified Game-Theoretic Approach to Multiagent Reinforcement Learningcited by 268
5 more
- 2024Self-Play Preference Optimization for Language Model Alignmentcited by 232
- 2023Nash Learning from Human Feedbackcited by 224
- 2022Exploring Length Generalization in Large Language Modelscited by 206
- 2023Can Large Language Models Serve as Rational Players in Game Theory? A Systematic Analysiscited by 92
- 2024Large Language Models Playing Mixed Strategy Nash Equilibrium Gamescited by 9
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Solver-Guided Reasoning for Mixed-Equilibrium Strategies
- 2026GENSTRAT: Toward a Science of Strategic Reasoning in Large Language Models
- 2026Level-k Distinguishable Mechanisms for Evaluating Bounded Rationality in LLMs ↗
- 2026GameSmith: Scaling Zero-Sum Self-Play with Synthesised Games
- 2026Choosing LLMs for Strategic Agent Interactions
- 2026Towards Improving Sequential Decision-Making in LLM Agents via Experience Memory
- 2025Tracing LLM Reasoning Processes with Strategic Games: A Framework for Planning, Revision, and Resource-Constrained Decision Making
- 2025Do LLMs Know When to Flip a Coin? Strategic Randomization through Reasoning and Experience