Deep Synoptic Monte Carlo Planning in Reconnaissance Blind Chess
Not on the map. Why?
Abstract (arXiv)
This paper introduces deep synoptic Monte Carlo planning (DSMCP) for large imperfect information games. The algorithm constructs a belief state with an unweighted particle filter and plans via playouts that start at samples drawn from the belief state. The algorithm accounts for uncertainty by performing inference on "synopses," a novel stochastic abstraction of information states. DSMCP is the basis of the program Penumbra, which won the official 2020 reconnaissance blind chess competition versus 33 other programs. This paper also evaluates algorithm variants that incorporate caution, paranoia, and a novel bandit algorithm. Furthermore, it audits the synopsis features used in Penumbra with per-bit saliency statistics.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 25 of its 67 references that are in the map. First posted on arXiv 5 Oct 2021.
Builds on
25 of 67 references.
References · 25
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2017Axiomatic Attribution for Deep Networkscited by 3,384
- 2013Playing Atari with Deep Reinforcement Learningcited by 3,274
- 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,353
- 2018Sanity Checks for Saliency Mapscited by 1,156
- 2017SmoothGrad: removing noise by adding noisecited by 1,109
- 2017Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithmcited by 734
- 2018A Benchmark for Interpretability Methods in Deep Neural Networkscited by 476
- 2018An Intriguing Failing of Convolutional Neural Networks and the CoordConv Solutioncited by 307
- 2017DeepStack: Expert-Level Artificial Intelligence in No-Limit Pokercited by 233
- 2016Deep Reinforcement Learning from Self-Play in Imperfect-Information Gamescited by 158
- 2019XRAI: Better Attributions Through Regionscited by 116
13 more
- 2020Combining Deep Reinforcement Learning and Search for Imperfect-Information Gamescited by 114
- 2018Deep Counterfactual Regret Minimizationcited by 103
- 2019On the Limitations of Representing Functions on Setscited by 90
- 2014Algorithms for multi-armed bandit problemscited by 64
- 2019Accelerating Self-Play Learning in Gocited by 64
- 2019ELF OpenGo: An Analysis and Open Reimplementation of AlphaZerocited by 39
- 2020Corralling Stochastic Bandit Algorithmscited by 23
- 2019DualSMC: Tunneling Differentiable Filtering and Planning under Continuous POMDPscited by 21
- 2019To Balance or Not to Balance: A Simple-yet-Effective Approach for Learning with Long-Tailed Distributionscited by 20
- 2020Assessing Game Balance with AlphaZero: Exploring Alternative Rule Sets in Chesscited by 15
- 2020Measuring and Harnessing Transference in Multi-Task Learningcited by 11
- 2014Computing Approximate Nash Equilibria and Robust Best-Responses Using Samplingcited by 6
- 2018On the Complexity of Reconnaissance Blind Chesscited by 4
Built on by
Citing papers per year: 2022: 2; 2023: 0; 2024: 1; 2025: 1.
4 papers.
- 2022Supervised and Reinforcement Learning from Observations in Reconnaissance Blind Chesscited by 3
- 2022Towards Using Fully Observable Policies for POMDPscited by 1
- 2024Neural Network-based Information Set Weighting for Playing Reconnaissance Blind Chesscited by 1
- 2025Adaptive Bias Generalized Rollout Policy Adaptation on the Flexible Job-Shop Scheduling Problemcited by 0
- 2025Adaptive Bias Generalized Rollout Policy Adaptation on the Flexible Job-Shop Scheduling Problem13 May 2025
- 2024Neural Network-based Information Set Weighting for Playing Reconnaissance Blind Chess8 Jul 2024
- 2022Supervised and Reinforcement Learning from Observations in Reconnaissance Blind Chess3 Aug 2022
- 2022Towards Using Fully Observable Policies for POMDPs24 Jul 2022