mlsanityData to 7 Oct 2026

Chain-of-Sanitized-Thoughts: Plugging PII Leakage in CoT of Large Reasoning Models

arXiv 2601.05076 ↗First posted 8 Jan 2026cs.AIcited by 5

On the map: LLM reasoning → Reasoning for agents, planning and code

Abstract (arXiv)

Large Reasoning Models (LRMs) improve performance, reliability, and interpretability by generating explicit chain-of-thought (CoT) reasoning, but this transparency introduces a serious privacy risk: intermediate reasoning often leaks personally identifiable information (PII) even when final answers are sanitized. We study how to induce privacy-first reasoning, where models reason without exposing sensitive information, using deployable interventions rather than post-hoc redaction. We introduce PII-CoT-Bench, a supervised dataset with privacy-aware CoT annotations, and a category-balanced evaluation benchmark covering realistic and adversarial leakage scenarios. Our results reveal a capability-dependent trend: state-of-the-art models benefit most from prompt-based controls, whereas weaker models require fine-tuning to achieve meaningful leakage reduction. Across models and categories, both approaches substantially reduce PII exposure with minimal degradation in utility, demonstrating that private reasoning can be achieved without sacrificing performance. Overall, we show that private CoT reasoning can be achieved with minimal utility loss, providing practical guidance for building privacy-preserving reasoning systems.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 23 of its 32 references that are in the map. First posted on arXiv 8 Jan 2026.

Builds on

23 of 32 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025SALT: Steering Activations towards Leakage-free Thinking in Chain of Thought11 Nov
  2. 2025Leaky Thoughts: Large Reasoning Models Are Not Private Thinkers18 Jun
  3. 2025Contextual Integrity in LLMs via Reasoning and Reinforcement Learning29 May

Other references · 20

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  4. 2017Deep reinforcement learning from human preferencescited by 3,846
  5. 2016Membership Inference Attacks against Machine Learning Modelscited by 2,221
  6. 2020Extracting Training Data from Large Language Modelscited by 2,144
  7. 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 763
  8. 2025Reasoning Models Don't Always Say What They Thinkcited by 388
  9. 2019Differential Privacy Has Disparate Impact on Model Accuracycited by 316
  10. 2025The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexitycited by 298
  11. 2023Faithful Chain-of-Thought Reasoningcited by 285
  12. 2025Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safetycited by 222
8 more
  1. 2023Can LLMs Keep a Secret? Testing Privacy Implications of Language Models via Contextual Integrity Theorycited by 218
  2. 2024Chain-of-Thought Reasoning Without Promptingcited by 208
  3. 2023User Inference Attacks on Large Language Modelscited by 36
  4. 2024Mind the Privacy Unit! User-Level Differential Privacy for Language Model Fine-Tuningcited by 21
  5. 2025The Sum Leaks More Than Its Parts: Compositional Privacy Risks and Mitigations in Multi-Agent Collaborationcited by 19
  6. 2025Does Chain-of-Thought Reasoning Really Reduce Harmfulness from Jailbreaking?cited by 8
  7. 2025Privacy-Aware Decoding: Mitigating Privacy Leakage of Large Language Models in Retrieval-Augmented Generationcited by 8
  8. 2025PrivacyScalpel: Enhancing LLM Privacy via Interpretable Feature Intervention with Sparse Autoencoderscited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Can Reasoning Models Obfuscate Reasoning? Stress-Testing Chain-of-Thought Monitorability
  2. 2026NEST: Nascent Encoded Steganographic Thoughts
  3. 2026OCELOT: Inference-Leakage Budgets for Privacy-Preserving LLM Agents
  4. 2025Policy Frameworks for Transparent Chain-of-Thought Reasoning in Large Language Models
  5. 2025A Comprehensive Survey on Trustworthiness in Reasoning with Large Language Models
  6. 2026Hidden Reasoning Must Leak, but Need Not Be Readable: Fundamental Opportunities and Limits for Chain-of-Thought Monitoring
  7. 2026Selective Disclosure of Hidden Directives in Reasoning Models: Behavioral Asymmetry and Steering
  8. 2025H-CoT: Hijacking the Chain-of-Thought Safety Reasoning Mechanism to Jailbreak Large Reasoning Models, Including OpenAI o1/o3, DeepSeek-R1, and Gemini 2.0 Flash Thinking