Does Out-of-Sight Equal Out-of-Mind in CoT Monitorability?
On the map: LLM reasoning → Prompting and chain-of-thought reasoning
Abstract (arXiv)
Chain-of-thought (CoT) reasoning offers a window into the decision-making of large language models (LLMs), which can be monitored for target behaviors by reading the reasoning trace, motivating work on CoT monitorability. Latent CoT approaches, however, replace the explicit tokens with a small number of continuous states, lowering inference costs but removing the readable trace this monitoring relies on. Monitoring then requires alternative access to the model, such as probing its activations or verbalizing the latent states back into text, but how much monitorability these alternatives preserve is unclear. We study this question with a hint-based intervention setup, a proxy for behaviors where models exploit biasing input cues, e.g., an inadvertently leaked answer or a belief stated by the user, without acknowledging them. Taking hint-reliance as the monitorability target, we compare monitors across reasoning modes, from explicit CoT to weakly- and strongly-supervised latent CoT, on math reasoning and question answering. We find that, in this setup, monitorability depends more on properties of the task (such as whether the correct answer constrains the supporting reasoning) and the level of access to model internals than on the reasoning mode.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Prompting and chain-of-thought reasoning, one of 17 directions in LLM reasoning. Builds on 36 of its 51 references that are in the map. First posted on arXiv 5 Aug 2026.
Builds on
36 of 51 references.
Closest ancestors · 14
Same direction, newest first
- 2026Decoding Hidden Deception in Reasoning LLMs: Activation Explainers for Deception Auditing16 Jun
- 2026Ulterior Motives: Detecting Misaligned Reasoning in Continuous Thought Models25 Apr
- 2026Catching rationalization in the act: detecting motivated reasoning before and after CoT via activation probing17 Mar
- 2026Analyzing and Improving Chain-of-Thought Monitorability Through Information Theory20 Feb
- 2025A Pragmatic Way to Measure Chain-of-Thought Monitorability28 Oct
- 2025Can Reasoning Models Obfuscate Reasoning? Stress-Testing Chain-of-Thought Monitorability21 Oct
- 2025Is It Thinking or Cheating? Detecting Implicit Reward Hacking by Measuring Reasoning Effort1 Oct
- 2025SIM-CoT: Supervised Implicit Chain-of-Thought24 Sep
- 2025Reasoning Models Don't Always Say What They Think8 May
- 2025Monitoring Reasoning Models for Misbehavior and the Risks of Promoting Obfuscation14 Mar
- 2025CODI: Compressing Chain-of-Thought into Continuous Space via Self-Distillation28 Feb
- 2024Training Large Language Models to Reason in a Continuous Latent Space9 Dec
2 more
Other references · 22
- 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,822
- 2016Understanding intermediate layers using linear classifier probescited by 1,353
- 2024Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvementcited by 1,090
- 2021Are NLP Models really able to Solve Simple Math Word Problems?cited by 878
- 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 712
- 2023Eliciting Latent Predictions from Transformers with the Tuned Lenscited by 623
- 2025Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approachcited by 415
- 2024Patchscopes: A Unifying Framework for Inspecting Hidden Representations of Language Modelscited by 235
- 2025Think Silently, Think Fast: Dynamic Latent Compression of LLM Reasoning Chainscited by 85
- 2025Are DeepSeek R1 And Other Reasoning Models More Faithful?cited by 72
- 2024SelfIE: Self-Interpretation of Large Language Model Embeddingscited by 67
- 2025Detecting High-Stakes Interactions with Activation Probescited by 53
10 more
- 2025Activation Oracles: Training and Evaluating LLMs as General-Purpose Activation Explainerscited by 52
- 2024LatentQA: Teaching LLMs to Decode Activations Into Natural Languagecited by 51
- 2024Obfuscated Activations Bypass LLM Latent-Space Defensescited by 45
- 2025RL-Obfuscation: Can Language Models Learn to Evade Latent-Space Monitors?cited by 24
- 2026How Do Latent Reasoning Methods Perform Under Weak and Strong Supervision?cited by 10
- 2026Are Latent Reasoning Models Easily Interpretable?cited by 9
- 2025KaVa: Latent Reasoning via Compressed KV-Cache Distillationcited by 8
- 2026Monitoring the Internal Monologue: Probe Trajectories Reveal Reasoning Dynamicscited by 5
- 2026Monitorability as a Free Gift: How RLVR Spontaneously Aligns Reasoningcited by 4
- 2026Selective Latent Thinking: Adaptive Compression of LLM Reasoning Chainscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Investigating CoT Monitorability in Large Reasoning Models
- 2025Measuring Chain-of-Thought Monitorability Through Faithfulness and Verbosity
- 2026Reasoning Models Struggle to Control their Chains of Thought
- 2023Measuring Faithfulness in Chain-of-Thought Reasoning
- 2026The Potential of CoT for Reasoning: A Closer Look at Trace Dynamics
- 2026The Fragility of Chain-of-Thought Monitoring Across Typologically Diverse Languages
- 2026Efficient Reasoning Training Does Not Always Harm CoT Faithfulness and Monitorability
- 2026MonitorBench: A Comprehensive Benchmark for Chain-of-Thought Monitorability in Large Language Models