Learning to Plan via Supervised Contrastive Learning and Strategic Interpolation: A Chess Case Study
Not on the map. Why?
Abstract (arXiv)
Modern chess engines achieve superhuman performance through deep tree search and regressive evaluation, while human players rely on intuition to select candidate moves followed by a shallow search to validate them. To model this intuition-driven planning process, we train a transformer encoder using supervised contrastive learning to embed board states into a latent space structured by positional evaluation. In this space, distance reflects evaluative similarity, and visualized trajectories display interpretable transitions between game states. We demonstrate that move selection can occur entirely within this embedding space by advancing toward favorable regions, without relying on deep search. Despite using only a 6-ply beam search, our model achieves an estimated Elo rating of 2593. Performance improves with both model size and embedding dimensionality, suggesting that latent planning may offer a viable alternative to traditional search. Although we focus on chess, the proposed embedding-based planning method can be generalized to other perfect-information games where state evaluations are learnable. All source code is available at https://github.com/andrewhamara/SOLIS.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 12 of its 28 references that are in the map. First posted on arXiv 5 Jun 2025.
Builds on
12 of 28 references.
References · 12
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
- 2017Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithmcited by 734
- 2020Aligning Superhuman AI with Human Behavior: Chess as a Model Systemcited by 79
- 2024Amortized Planning with Large-Scale Transformers: A Case Study on Chesscited by 49
- 2024Maia-2: A Unified Model for Human-AI Alignment in Chesscited by 25
- 2015Giraffe: Using Deep Reinforcement Learning to Play Chesscited by 12
Built on by
Citing papers per year: 2025: 2; 2026: 2.
4 papers.
- 2025Causal Masking on Spatial Data: An Information-Theoretic Case for Learning Spatial Datasets with Unimodal Language Modelscited by 0
- 2025Supervised Contrastive Frame Aggregation for Video Representation Learningcited by 0
- 2026RePAIR: Predictive Self-Supervised Representation Learning in Chesscited by 0
- 2026Beyond Search-Imitation: Prior-Directed Exploration for Searchless Chesscited by 0
- 2026Beyond Search-Imitation: Prior-Directed Exploration for Searchless Chess27 Aug 2026
- 2026RePAIR: Predictive Self-Supervised Representation Learning in Chess10 Jun 2026
- 2025Supervised Contrastive Frame Aggregation for Video Representation Learning14 Dec 2025
- 2025Causal Masking on Spatial Data: An Information-Theoretic Case for Learning Spatial Datasets with Unimodal Language Models30 Oct 2025