Real-Time Parallel Counterfactual Regret Minimization
Not on the map. Why?
Abstract (arXiv)
Counterfactual Regret Minimization (CFR) is the dominant algorithmic family for solving large imperfect-information games, underpinning breakthroughs such as Libratus and Pluribus in No-Limit Texas Hold'em poker. In real-time game-playing systems, the solver must compute a near-equilibrium strategy within a strict time budget of only a few seconds per decision, and the number of CFR iterations completed in this window directly determines play strength. We present Parallel CFR, the first parallelization framework for real-time depth-limited CFR solving that seamlessly integrates pruning, abstraction, and advanced CFR variants. We decompose each CFR iteration into a pipeline of seven stages and identify two orthogonal dimensions of parallelism: by information set and by tree node. Leaf node evaluation is offloaded to GPUs via batched neural network inference, creating a heterogeneous CPU--GPU pipeline. Experiments on Heads-Up No-Limit Texas Hold'em demonstrate that Parallel CFR achieves 3.3--3.4× speedup over the single-threaded baseline on postflop streets, with per-iteration time of ~47--54~ms on a depth-limited game tree with over 1 billion histories. All experiments run on a single desktop-class device (NVIDIA DGX Spark), enabling hundreds of CFR iterations within a typical real-time decision budget without requiring datacenter-scale infrastructure.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 11 of its 29 references that are in the map. First posted on arXiv 19 May 2026.
Builds on
11 of 29 references.
References · 11
- 2017DeepStack: Expert-Level Artificial Intelligence in No-Limit Pokercited by 228
- 2020Combining Deep Reinforcement Learning and Search for Imperfect-Information Gamescited by 110
- 2014Solving Large Imperfect Information Games Using CFR+cited by 78
- 2018Solving Imperfect-Information Games via Discounted Regret Minimizationcited by 68
- 2020Faster Game Solving via Predictive Blackwell Approachability: Connecting Regret Matching and Mirror Descentcited by 56
- 2013Solving Imperfect Information Games Using Decompositioncited by 27
- 2018Depth-Limited Solving for Imperfect-Information Gamescited by 24
- 2024RL-CFR: Improving Action Abstraction for Imperfect Information Extensive-Form Games with Reinforcement Learningcited by 10
- 2026Effective, Efficient, and General Information Abstraction for Imperfect-Information Extensive-Form Gamescited by 7
- 2021Fast Payoff Matrix Sparsification Techniques for Structured Extensive-Form Gamescited by 2
- 2026Parallelizing Counterfactual Regret Minimizationcited by 2
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026PokerSkill: LLMs Can Play Expert-Level Poker without Training or Solverscited by 5
- 2026Agents That Certify Their Own Exploits: Confidence-Scheduled Restricted Responses for Safe Opponent Exploitationcited by 4
- 2026ICM Out! Better Tournament Strategy from Computed Continuations, vs. Solvers and LLMscited by 2
- 2026AV-AIVAT: 74x Cheaper Agent Evaluation with Certified Anytime-Valid Stopping in Imperfect-Information Gamescited by 1
- 2026Abstraction Agentcited by 1
- 2026GPU-CFR: 80x Faster Counterfactual Regret Minimization by Compiling the Game to Static Dataflow and CUDA Graph Replaycited by 0
- 2026GPU-CFR: 80x Faster Counterfactual Regret Minimization by Compiling the Game to Static Dataflow and CUDA Graph Replay10 Sep 2026
- 2026Abstraction Agent3 Sep 2026
- 2026ICM Out! Better Tournament Strategy from Computed Continuations, vs. Solvers and LLMs10 Aug 2026
- 2026AV-AIVAT: 74x Cheaper Agent Evaluation with Certified Anytime-Valid Stopping in Imperfect-Information Games6 Aug 2026
- 2026Agents That Certify Their Own Exploits: Confidence-Scheduled Restricted Responses for Safe Opponent Exploitation30 Jul 2026
- 2026PokerSkill: LLMs Can Play Expert-Level Poker without Training or Solvers28 May 2026