mlsanityData to 14 Oct 2026

Thought Purity: A Defense Framework For Chain-of-Thought Attack

arXiv 2507.12314 ↗First posted 16 Jul 2025cs.LG cs.AI cs.CEcited by 4

On the map: LLM reasoning → Reasoning for agents, planning and code

Abstract (arXiv)

Large Reasoning Models (LRMs) leverage Chain-of-Thought (CoT) reasoning to solve complex tasks, but this explicit reasoning process introduces a critical vulnerability: adversarial manipulation of the thought chain itself, known as Chain-of-Thought Attacks (CoTA). Such attacks subtly corrupt the reasoning path to produce erroneous outputs, challenging conventional defenses that often sacrifice model utility for safety. To address this, we propose Thought Purity(TP), a defense framework that shifts from passive refusal to active reasoning recovery. TP integrates a safety-aware data pipeline with reinforcement learning, employing a dual-reward mechanism to teach models to dynamically identify and isolate malicious logic while preserving correct reasoning. Experiments on multiple model families demonstrate that TP significantly reduces the attack success rate of CoTA while maintaining or enhancing the model's performance on benign tasks.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 19 of its 31 references that are in the map. First posted on arXiv 16 Jul 2025.

Builds on

19 of 31 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025GuardReasoner-VL: Safeguarding VLMs via Reinforced Reasoning16 May
  2. 2025Safety in Large Reasoning Models: A Survey24 Apr
  3. 2025SafeChain: Safety of Language Models with Long Chain-of-Thought Reasoning Capabilities17 Feb
  4. 2025To Think or Not to Think: Exploring the Unthinking Vulnerability in Large Reasoning Models16 Feb
  5. 2025GuardReasoner: Towards Reasoning-based LLM Safeguards30 Jan
  6. 2025DarkMind: Latent Chain-of-Thought Backdoor in Customized LLMs24 Jan

Other references · 13

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  3. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  5. 2025Qwen3 Technical Reportcited by 8,820
  6. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  7. 2024StruQ: Defending Against Prompt Injection with Structured Queriescited by 375
  8. 2025Safety at Scale: A Comprehensive Survey of Large Model and Agent Safetycited by 67
  9. 2024BackdoorLLM: A Comprehensive Benchmark for Backdoor Attacks and Defenses on Large Language Modelscited by 50
  10. 2024Breaking Down the Defenses: A Comparative Survey of Attacks on Large Language Modelscited by 44
  11. 2024SPML: A DSL for Defending Language Models Against Prompt Attackscited by 34
  12. 2024Chain-of-Scrutiny: Detecting Backdoor Attacks for Large Language Modelscited by 28
1 more
  1. 2024Is poisoning a real threat to LLM alignment? Maybe more so than you thinkcited by 28

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 3.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025H-CoT: Hijacking the Chain-of-Thought Safety Reasoning Mechanism to Jailbreak Large Reasoning Models, Including OpenAI o1/o3, DeepSeek-R1, and Gemini 2.0 Flash Thinking
  2. 2025Chain-of-Thought Hijacking
  3. 2025Chain-of-Defensive-Thought: Structured Reasoning Elicits Robustness in Large Language Models against Reference Corruption
  4. 2026Thought-Transfer: Indirect Targeted Poisoning Attacks on Chain-of-Thought Reasoning Models
  5. 2025AdvChain: Adversarial Chain-of-Thought Tuning for Robust Safety Alignment of Large Reasoning Models
  6. 2025ShadowCoT: Cognitive Hijacking for Stealthy Reasoning Backdoors in LLMs
  7. 2025HauntAttack: When Attack Follows Reasoning as a Shadow
  8. 2026Hidden in Thought: Transferable Chain-of-Thought Artifacts Induce Harmful Behavior