mlsanityData to 7 Oct 2026

How Far Are LLMs from Professional Poker Players? Revisiting Game-Theoretic Reasoning with Agentic Tool Use

arXiv 2602.00528 ↗First posted 31 Jan 2026cs.AIcited by 7

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

As Large Language Models (LLMs) are increasingly applied in high-stakes domains, their ability to reason strategically under uncertainty becomes critical. Poker provides a rigorous testbed, requiring not only strong actions but also principled, game-theoretic reasoning. In this paper, we conduct a systematic study of LLMs in multiple realistic poker tasks, evaluating both gameplay outcomes and reasoning traces. Our analysis reveals LLMs fail to compete against traditional algorithms and identifies three recurring flaws: reliance on heuristics, factual misunderstandings, and a "knowing-doing" gap where actions diverge from reasoning. An initial attempt with behavior cloning and step-level reinforcement learning improves reasoning style but remains insufficient for accurate game-theoretic play. Motivated by these limitations, we propose ToolPoker, a tool-integrated reasoning framework that combines external solvers for GTO-consistent actions with more precise professional-style explanations. Experiments demonstrate that ToolPoker achieves state-of-the-art gameplay while producing reasoning traces that closely reflect game-theoretic principles.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 31 of its 58 references that are in the map. First posted on arXiv 31 Jan 2026.

Builds on

31 of 58 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025R1-Code-Interpreter: LLMs Reason with Code via Supervised and Multi-stage Reinforcement Learning27 May
  2. 2025ReTool: Reinforcement Learning for Strategic Tool Use in LLMs15 Apr
  3. 2024GameBench: Evaluating Strategic Reasoning Abilities of LLM Agents7 Jun

Other references · 28

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  4. 2025Qwen3 Technical Reportcited by 8,195
  5. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  6. 2024GPT-4o System Cardcited by 4,467
  7. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
  8. 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 1,916
  9. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,371
  10. 2025s1: Simple test-time scalingcited by 1,311
  11. 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,057
  12. 2025Group-in-Group Policy Optimization for LLM Agent Trainingcited by 442
16 more
  1. 2023FreshLLMs: Refreshing Large Language Models with Search Engine Augmentationcited by 308
  2. 2025DeepResearcher: Scaling Deep Research via Reinforcement Learning in Real-world Environmentscited by 268
  3. 2025WebAgent-R1: Training Web Agents via End-to-End Multi-Turn Reinforcement Learningcited by 162
  4. 2016Deep Reinforcement Learning from Self-Play in Imperfect-Information Gamescited by 153
  5. 2014Solving Large Imperfect Information Games Using CFR+cited by 78
  6. 2023Suspicion-Agent: Playing Imperfect Information Games with Theory of Mind Aware GPT-4cited by 67
  7. 2024MATHSENSEI: A Tool-Augmented Large Language Model for Mathematical Reasoningcited by 34
  8. 2024A Survey on Self-play Methods in Reinforcement Learningcited by 26
  9. 2025SimPER: A Minimalist Approach to Preference Alignment without Hyperparameterscited by 25
  10. 2019Single Deep Counterfactual Regret Minimizationcited by 20
  11. 2023Are ChatGPT and GPT-4 Good Poker Players? -- A Pre-Flop Analysiscited by 20
  12. 2024PokerGPT: An End-to-End Lightweight Solver for Multi-Player Texas Hold'em via Large Language Modelcited by 20
  13. 2023LLM4Causal: Democratized Causal Tools for Everyone via Large Language Modelcited by 9
  14. 2025Beyond Correctness: Rewarding Faithful Reasoning in Retrieval-Augmented Generationcited by 6
  15. 2025Can Large Language Models Master Complex Card Games?cited by 4
  16. 2025Analysis of Bluffing by DQN and CFR in Leduc Hold'em Pokercited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 7.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024GTBench: Uncovering the Strategic Reasoning Limitations of LLMs via Game-Theoretic Evaluations
  2. 2025LLM CHESS: Benchmarking Reasoning and Instruction-Following in LLMs through Chess
  3. 2026Poker Arena: Multi-Axis Profiling of Strategic Reasoning and Memory in LLMs
  4. 2024GAMEBoT: Transparent Assessment of LLM Reasoning in Games
  5. 2025Game Reasoning Arena: A Framework and Benchmark for Assessing Reasoning Capabilities of Large Language Models via Game Play
  6. 2026Clueing up LLMs with Tool-Augmented Deductive Reasoning
  7. 2025Rule Synergy Analysis using LLMs: State of the Art and Implications
  8. 2025Emergent World Beliefs: Exploring Transformers in Stochastic Games