The Weight of Silence: A Causal Case for Weights Over the Scratchpad in Latent Chess Reasoning
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Latent, or silent, reasoning lets language models carry out intermediate computation in continuous vector space instead of words, and is widely assumed to function as an internal scratchpad the model consults during inference. Whether that assumption survives reinforcement learning has not been tested directly: existing causal analyses of latent reasoning are confined to math and logic tasks, comparing reliance on thoughts within one checkpoint, never before and after RL. We train a chess-playing model through a staged latent-reasoning curriculum followed by reinforcement learning, and find legality climbs monotonically to 61% (from a 48% pre-RL baseline) while checkmate confabulation is eliminated entirely. To locate this gain, we run a six-condition causal intervention suite on the same model before and after RL: substituting or noising the thought vectors leaves performance unchanged, ablating them costs only mild degradation, and only exact-zero vectors cause collapse. This robustness gap is itself the finding: under exact-zero corruption, legality collapses to 1% pre-RL versus 9% post-RL, a gap that survives correction across the full battery. A 10x-larger replication of the post-RL checkpoint's own battery confirms this: removing the thoughts, with or without restoring sequence length, also reaches significance; substitution and noise remain indistinguishable from baseline. RL appears to add robustness to disruption, not reliance on thought content. These results push back against the field's default assumption that latent thoughts function as an actively consulted inference-time scratchpad, and instead indicate latent reasoning's principal effect here is shaping the model's parameters during training. We also demonstrate a working RL gain in chess, where multiple groups report the same latent-reasoning-plus-RL recipe failing to improve accuracy over SFT.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 17 of its 21 references that are in the map. First posted on arXiv 23 Jul 2026.
Builds on
17 of 21 references.
Closest ancestors · 3
Same direction, newest first
- 2026Demystifying Hidden-State Recurrence: Switchable Latent Reasoning with On-Policy Reinforcement Learning11 Jun
- 2026Unlocking the Black Box of Latent Reasoning: An Interpretability-Guided Approach to Intervention31 May
- 2025Scaling Latent Reasoning via Looped Language Models29 Oct
Other references · 14
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,739
- 2022Locating and Editing Factual Associations in GPTcited by 2,691
- 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 797
- 2023Towards Best Practices of Activation Patching in Language Models: Metrics and Methodscited by 359
- 2026Verbalizable Representations Form a Global Workspace in Language Modelscited by 75
- 2025Do Latent Tokens Think? A Causal and Adversarial Analysis of Chain-of-Continuous-Thoughtcited by 23
- 2025SofT-GRPO: Surpassing Discrete-Token LLM Reinforcement Learning via Gumbel-Reparameterized Soft-Thinking Policy Optimizationcited by 21
- 2026How Do Latent Reasoning Methods Perform Under Weak and Strong Supervision?cited by 10
- 2025Can Large Language Models Develop Strategic Reasoning? Post-training Insights from Learning Chesscited by 9
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026How Reasoning Evolves from Post-Training Data: An Empirical Study Using Chess
- 2026Understanding Reasoning from Pretraining to Post-Training
- 2026Final Checkpoints Are Not Enough: Analyzing Latent Reasoning Faithfulness Along Training Trajectories
- 2025LLM CHESS: Benchmarking Reasoning and Instruction-Following in LLMs through Chess
- 2026Emergent Search and Backtracking in Latent Reasoning Models
- 2026LatentHarness: Learning Latent Actions for Memory and Reasoning via Counterfactual Policy Distillation
- 2025The Climb Carves Wisdom Deeper Than the Summit: On the Noisy Rewards in Learning to Reason
- 2026Disentangling generalization and memorization in large language models using chess