Thought Purity: A Defense Framework For Chain-of-Thought Attack
On the map: LLM reasoning → Reasoning for agents, planning and code
Abstract (arXiv)
Large Reasoning Models (LRMs) leverage Chain-of-Thought (CoT) reasoning to solve complex tasks, but this explicit reasoning process introduces a critical vulnerability: adversarial manipulation of the thought chain itself, known as Chain-of-Thought Attacks (CoTA). Such attacks subtly corrupt the reasoning path to produce erroneous outputs, challenging conventional defenses that often sacrifice model utility for safety. To address this, we propose Thought Purity(TP), a defense framework that shifts from passive refusal to active reasoning recovery. TP integrates a safety-aware data pipeline with reinforcement learning, employing a dual-reward mechanism to teach models to dynamically identify and isolate malicious logic while preserving correct reasoning. Experiments on multiple model families demonstrate that TP significantly reduces the attack success rate of CoTA while maintaining or enhancing the model's performance on benign tasks.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 19 of its 31 references that are in the map. First posted on arXiv 16 Jul 2025.
Builds on
19 of 31 references.
Closest ancestors · 6
Same direction, newest first
- 2025GuardReasoner-VL: Safeguarding VLMs via Reinforced Reasoning16 May
- 2025Safety in Large Reasoning Models: A Survey24 Apr
- 2025SafeChain: Safety of Language Models with Long Chain-of-Thought Reasoning Capabilities17 Feb
- 2025To Think or Not to Think: Exploring the Unthinking Vulnerability in Large Reasoning Models16 Feb
- 2025GuardReasoner: Towards Reasoning-based LLM Safeguards30 Jan
- 2025DarkMind: Latent Chain-of-Thought Backdoor in Customized LLMs24 Jan
Other references · 13
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2024StruQ: Defending Against Prompt Injection with Structured Queriescited by 375
- 2025Safety at Scale: A Comprehensive Survey of Large Model and Agent Safetycited by 67
- 2024BackdoorLLM: A Comprehensive Benchmark for Backdoor Attacks and Defenses on Large Language Modelscited by 50
- 2024Breaking Down the Defenses: A Comparative Survey of Attacks on Large Language Modelscited by 44
- 2024SPML: A DSL for Defending Language Models Against Prompt Attackscited by 34
- 2024Chain-of-Scrutiny: Detecting Backdoor Attacks for Large Language Modelscited by 28
1 more
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2026MirageBackdoor: A Stealthy Attack that Induces Think-Well-Answer-Wrong Reasoningcited by 4
- 2025Rethinking Reasoning: A Survey on Reasoning-based Backdoors in LLMscited by 2
- 2026Critical-CoT: A Robust Defense Framework against Reasoning-Level Backdoor Attacks in Large Language Modelscited by 1
- 2026Make LLM Learn to Synthesize from Streaming Experiences through Feedbackcited by 1
- 2026Make LLM Learn to Synthesize from Streaming Experiences through Feedback28 May 2026
- 2026Critical-CoT: A Robust Defense Framework against Reasoning-Level Backdoor Attacks in Large Language Models12 Apr 2026
- 2026MirageBackdoor: A Stealthy Attack that Induces Think-Well-Answer-Wrong Reasoning8 Apr 2026
- 2025Rethinking Reasoning: A Survey on Reasoning-based Backdoors in LLMs9 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2025H-CoT: Hijacking the Chain-of-Thought Safety Reasoning Mechanism to Jailbreak Large Reasoning Models, Including OpenAI o1/o3, DeepSeek-R1, and Gemini 2.0 Flash Thinking
- 2025Chain-of-Thought Hijacking
- 2025Chain-of-Defensive-Thought: Structured Reasoning Elicits Robustness in Large Language Models against Reference Corruption
- 2026Thought-Transfer: Indirect Targeted Poisoning Attacks on Chain-of-Thought Reasoning Models
- 2025AdvChain: Adversarial Chain-of-Thought Tuning for Robust Safety Alignment of Large Reasoning Models
- 2025ShadowCoT: Cognitive Hijacking for Stealthy Reasoning Backdoors in LLMs
- 2025HauntAttack: When Attack Follows Reasoning as a Shadow
- 2026Hidden in Thought: Transferable Chain-of-Thought Artifacts Induce Harmful Behavior