How Far Are LLMs from Professional Poker Players? Revisiting Game-Theoretic Reasoning with Agentic Tool Use
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
As Large Language Models (LLMs) are increasingly applied in high-stakes domains, their ability to reason strategically under uncertainty becomes critical. Poker provides a rigorous testbed, requiring not only strong actions but also principled, game-theoretic reasoning. In this paper, we conduct a systematic study of LLMs in multiple realistic poker tasks, evaluating both gameplay outcomes and reasoning traces. Our analysis reveals LLMs fail to compete against traditional algorithms and identifies three recurring flaws: reliance on heuristics, factual misunderstandings, and a "knowing-doing" gap where actions diverge from reasoning. An initial attempt with behavior cloning and step-level reinforcement learning improves reasoning style but remains insufficient for accurate game-theoretic play. Motivated by these limitations, we propose ToolPoker, a tool-integrated reasoning framework that combines external solvers for GTO-consistent actions with more precise professional-style explanations. Experiments demonstrate that ToolPoker achieves state-of-the-art gameplay while producing reasoning traces that closely reflect game-theoretic principles.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 31 of its 58 references that are in the map. First posted on arXiv 31 Jan 2026.
Builds on
31 of 58 references.
Closest ancestors · 3
Same direction, newest first
- 2025R1-Code-Interpreter: LLMs Reason with Code via Supervised and Multi-stage Reinforcement Learning27 May
- 2025ReTool: Reinforcement Learning for Strategic Tool Use in LLMs15 Apr
- 2024GameBench: Evaluating Strategic Reasoning Abilities of LLM Agents7 Jun
Other references · 28
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen3 Technical Reportcited by 8,195
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2024GPT-4o System Cardcited by 4,467
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
- 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 1,916
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,371
- 2025s1: Simple test-time scalingcited by 1,311
- 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,057
- 2025Group-in-Group Policy Optimization for LLM Agent Trainingcited by 442
16 more
- 2023FreshLLMs: Refreshing Large Language Models with Search Engine Augmentationcited by 308
- 2025DeepResearcher: Scaling Deep Research via Reinforcement Learning in Real-world Environmentscited by 268
- 2025WebAgent-R1: Training Web Agents via End-to-End Multi-Turn Reinforcement Learningcited by 162
- 2016Deep Reinforcement Learning from Self-Play in Imperfect-Information Gamescited by 153
- 2014Solving Large Imperfect Information Games Using CFR+cited by 78
- 2023Suspicion-Agent: Playing Imperfect Information Games with Theory of Mind Aware GPT-4cited by 67
- 2024MATHSENSEI: A Tool-Augmented Large Language Model for Mathematical Reasoningcited by 34
- 2024A Survey on Self-play Methods in Reinforcement Learningcited by 26
- 2025SimPER: A Minimalist Approach to Preference Alignment without Hyperparameterscited by 25
- 2019Single Deep Counterfactual Regret Minimizationcited by 20
- 2023Are ChatGPT and GPT-4 Good Poker Players? -- A Pre-Flop Analysiscited by 20
- 2024PokerGPT: An End-to-End Lightweight Solver for Multi-Player Texas Hold'em via Large Language Modelcited by 20
- 2023LLM4Causal: Democratized Causal Tools for Everyone via Large Language Modelcited by 9
- 2025Beyond Correctness: Rewarding Faithful Reasoning in Retrieval-Augmented Generationcited by 6
- 2025Can Large Language Models Master Complex Card Games?cited by 4
- 2025Analysis of Bluffing by DQN and CFR in Leduc Hold'em Pokercited by 1
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Harness Updating Is Not Harness Benefit: Disentangling Evolution Capabilities in Self-Evolving LLM Agentscited by 28
- 2026MemMA: Coordinating the Memory Cycle through Multi-Agent Reasoning and In-Situ Self-Evolutioncited by 11
- 2026PokerSkill: LLMs Can Play Expert-Level Poker without Training or Solverscited by 5
- 2026Solver-Guided Reasoning for Mixed-Equilibrium Strategiescited by 2
- 2026Abstraction Agentcited by 1
- 2026GENSTRAT: Toward a Science of Strategic Reasoning in Large Language Modelscited by 0
- 2026Doing What They Say, Not What They Reason: Locating the Faithfulness Gap in LLM Agentscited by 0
- 2026Abstraction Agent3 Sep 2026
- 2026Solver-Guided Reasoning for Mixed-Equilibrium Strategies7 Aug 2026
- 2026Doing What They Say, Not What They Reason: Locating the Faithfulness Gap in LLM Agents30 May 2026
- 2026Harness Updating Is Not Harness Benefit: Disentangling Evolution Capabilities in Self-Evolving LLM Agents28 May 2026
- 2026PokerSkill: LLMs Can Play Expert-Level Poker without Training or Solvers28 May 2026
- 2026GENSTRAT: Toward a Science of Strategic Reasoning in Large Language Models22 May 2026
- 2026MemMA: Coordinating the Memory Cycle through Multi-Agent Reasoning and In-Situ Self-Evolution19 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2024GTBench: Uncovering the Strategic Reasoning Limitations of LLMs via Game-Theoretic Evaluations
- 2025LLM CHESS: Benchmarking Reasoning and Instruction-Following in LLMs through Chess
- 2026Poker Arena: Multi-Axis Profiling of Strategic Reasoning and Memory in LLMs
- 2024GAMEBoT: Transparent Assessment of LLM Reasoning in Games
- 2025Game Reasoning Arena: A Framework and Benchmark for Assessing Reasoning Capabilities of Large Language Models via Game Play
- 2026Clueing up LLMs with Tool-Augmented Deductive Reasoning
- 2025Rule Synergy Analysis using LLMs: State of the Art and Implications
- 2025Emergent World Beliefs: Exploring Transformers in Stochastic Games