Tracking vs. Deciding: The Dual-Capability Bottleneck in Searchless Chess Transformers
Not on the map. Why?
Abstract (arXiv)
A human-like chess engine should mimic the style, errors, and consistency of a strong human player rather than maximize playing strength. We show that training from move sequences alone forces a model to learn two capabilities: state tracking, which reconstructs the board from move history, and decision quality, which selects good moves from that reconstructed state. These impose contradictory data requirements: low-rated games provide the diversity needed for tracking, while high-rated games provide the quality signal for decision learning. Removing low-rated data degrades performance. We formalize this tension as a dual-capability bottleneck, P <= min(T,Q), where overall performance is limited by the weaker capability. Guided by this view, we scale the model from 28M to 120M parameters to improve tracking, then introduce Elo-weighted training to improve decisions while preserving diversity. A 2 x 2 factorial ablation shows that scaling improves tracking, weighting improves decisions, and their combination is superadditive. Linear weighting works best, while overly aggressive weighting harms tracking despite lower validation loss. We also introduce a coverage-decay formula, t* = log(N/kcrit)/log b, as a reliability horizon for intra-game degeneration risk. Our final 120M-parameter model, without search, reached Lichess bullet 2570 over 253 rated games. On human move prediction it achieves 55.2% Top-1 accuracy, exceeding Maia-2 rapid and Maia-2 blitz. Unlike position-based methods, sequence input naturally encodes full game history, enabling history-dependent decisions that single-position models cannot exhibit.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 14 references that are in the map. First posted on arXiv 31 Mar 2026.
Builds on
7 of 14 references.
References · 7
- 2022Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Taskcited by 431
- 2020Aligning Superhuman AI with Human Behavior: Chess as a Model Systemcited by 79
- 2021Chess as a Testbed for Language Model State Trackingcited by 72
- 2024Emergent World Models and Latent Variable Estimation in Chess-Playing Language Modelscited by 62
- 2024Amortized Planning with Large-Scale Transformers: A Case Study on Chesscited by 49
- 2024Maia-2: A Unified Model for Human-AI Alignment in Chesscited by 25
- 2025Complete Chess Games Enable LLM Become A Chess Mastercited by 16
Built on by
Not cited yet.