From Leaky Thoughts to Private Reasoning: Controlling What LRMs Say to Themselves
On the map: LLM reasoning → Reasoning for agents, planning and code
Abstract (arXiv)
Large reasoning models (LRMs) produce reasoning traces (RTs) that often contain sensitive information. These leaky thoughts are difficult to control and frequently violate explicit privacy directives. Because RTs can be exposed through prompt injection attacks, this becomes a direct privacy risk to the user. We approach this as a controllability problem: since privacy directives are themselves instructions, improving instruction-following (IF) within the RT provides a direct path to reducing privacy leaks. To this end, we introduce an SFT dataset that teaches models to follow general instructions throughout their reasoning process, and propose Staged Decoding, a simple decoding strategy that decouples RT and answer generation using separate LoRA adapters to maximize IF of each component. We evaluate our approach on six models from two families (1.7B-14B parameters), across two IF benchmarks and two privacy benchmarks. Our method yields substantial improvements, with gains of up to 20.9 points in IF and 51.9 percentage points on privacy benchmarks, though these can come at the cost of task utility due to the trade-off between reasoning performance and IF. Our results show that improving IF in LRMs can significantly enhance privacy, suggesting a promising direction for future privacy-aware LRMs. Our code is available at https://github.com/UKPLab/arxiv2026-controllable-reasoning-models.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 10 of its 58 references that are in the map. First posted on arXiv 27 Feb 2026.
Builds on
10 of 58 references.
Closest ancestors · 2
Same direction, newest first
- 2026Chain-of-Sanitized-Thoughts: Plugging PII Leakage in CoT of Large Reasoning Models8 Jan
- 2025Evaluating Language Model Reasoning about Confidential Information27 Aug
Other references · 8
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2025Qwen3 Technical Reportcited by 8,195
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
- 2023Instruction-Following Evaluation for Large Language Modelscited by 1,143
- 2024Phi-4 Technical Reportcited by 675
- 2025Monitoring Reasoning Models for Misbehavior and the Risks of Promoting Obfuscationcited by 338
- 2025Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safetycited by 222
- 2025Efficient Multi-Adapter LLM Serving via Cross-Model KV-Cache Reuse with Activated LoRAcited by 7
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Leaky Thoughts: Large Reasoning Models Are Not Private Thinkers
- 2025SALT: Steering Activations towards Leakage-free Thinking in Chain of Thought
- 2026Safer Reasoning Traces: Measuring and Mitigating Chain-of-Thought Leakage in LLMs
- 2023Can LLMs Keep a Secret? Testing Privacy Implications of Language Models via Contextual Integrity Theory
- 2026OCELOT: Inference-Leakage Budgets for Privacy-Preserving LLM Agents
- 2026LLMs as Linguistic Chameleons: Decoupling Semantics and Structure for Privacy-Preserving Communication
- 2026STaR: Sensitive Trajectory Regulation for Unlearning in Large Reasoning Models
- 2025Personalizing Agent Privacy Decisions via Logical Entailment