Grounded Chess Reasoning in Language Models via Master Distillation
On the map: LLM reasoning → Reasoning for agents, planning and code
Abstract (arXiv)
Language models often lack grounded reasoning capabilities in specialized domains where training data is scarce but bespoke systems excel. We introduce a general framework for distilling expert system reasoning into natural language chain-of-thought explanations, enabling compact models to acquire domain expertise and the ability to generate faithful, grounded explanations. Rather than distilling only final outputs, we capture the full reasoning process, transforming opaque expert computations into transparent, step-by-step explanations. We demonstrate this approach in chess, a canonical reasoning domain where language models continue to underperform. Our 4B parameter model, C1, advances from a near-zero baseline to 48.1% accuracy, outperforming all open-source models and most frontier proprietary systems. Notably, C1 surpasses its distillation teacher and generates solutions in two orders of magnitude fewer tokens than baselines. Unlike prior neural chess approaches that predict only best moves, C1 generates explainable solutions revealing strategic reasoning. Our pipeline combines supervised fine-tuning and reinforcement learning with theme-balanced data sampling for comprehensive tactical coverage. Master Distillation demonstrates how to inject expert-level knowledge into compact models for under-optimized domains, offering a recipe for unlocking RLVR where LLMs lack sufficient base capabilities.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 19 of its 51 references that are in the map. First posted on arXiv 20 Mar 2026.
Builds on
19 of 51 references.
Closest ancestors · 3
Same direction, newest first
- 2025WebSailor: Navigating Super-human Reasoning for Web Agent3 Jul
- 2025Can Large Language Models Develop Strategic Reasoning? Post-training Insights from Learning Chess1 Jul
- 2024OpenAI o1 System Card21 Dec
Other references · 16
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen3 Technical Reportcited by 8,195
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,371
- 2025Understanding R1-Zero-Like Training: A Critical Perspectivecited by 1,276
- 2025Group Sequence Policy Optimizationcited by 788
- 2017Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithmcited by 723
- 2025Process Reinforcement through Implicit Rewardscited by 478
4 more
- 2024Back to Basics: Revisiting REINFORCE Style Optimization for Learning from Human Feedback in LLMscited by 103
- 2020The Chess Transformer: Mastering Play using Generative Language Modelscited by 36
- 2024Mastering Chess with a Transformer Modelcited by 14
- 2025ChessQA: Evaluating Large Language Models for Chess Understandingcited by 8
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026SafeGEO: Understanding Generative Engine Optimization Risks in Recommendation Agentscited by 4
- 2026GAMBIT: A Three-Mode Benchmark for Adversarial Robustness in Multi-Agent LLM Collectivescited by 1
- 2026MicroVerse: An Instrument for Measuring Self-Authored Identity Drift in Long-Horizon Multi-Agent Language-Model Simulationscited by 1
- 2026Generalization or Memorization? Brittleness Testing for Chess-Trained Language Modelscited by 0
- 2026Do Chess Explanations Reflect Model Decisions? Behavioral and Token-Level Tests of LLM Reasoning Faithfulnesscited by 0
- 2026Do Chess Explanations Reflect Model Decisions? Behavioral and Token-Level Tests of LLM Reasoning Faithfulness5 Sep 2026
- 2026MicroVerse: An Instrument for Measuring Self-Authored Identity Drift in Long-Horizon Multi-Agent Language-Model Simulations16 Aug 2026
- 2026SafeGEO: Understanding Generative Engine Optimization Risks in Recommendation Agents8 Jun 2026
- 2026Generalization or Memorization? Brittleness Testing for Chess-Trained Language Models17 May 2026
- 2026GAMBIT: A Three-Mode Benchmark for Adversarial Robustness in Multi-Agent LLM Collectives9 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026How Reasoning Evolves from Post-Training Data: An Empirical Study Using Chess
- 2025LLM CHESS: Benchmarking Reasoning and Instruction-Following in LLMs through Chess
- 2025ChessArena: A Chess Testbed for Evaluating Strategic Reasoning Capabilities of Large Language Models
- 2024Explore the Reasoning Capability of LLMs in the Chess Testbed
- 2026Understanding Reasoning from Pretraining to Post-Training
- 2023Large Language Models on the Chessboard: A Study on ChatGPT's Formal Language Comprehension and Complex Reasoning Skills
- 2026What Counts as Strategic Reasoning? A Systematic Mapping of Chess Research on Humans, Engines, and Language Models
- 2025MastermindEval: A Simple But Scalable Reasoning Benchmark