Distractor Injection Attacks on Large Reasoning Models: Characterization and Defense
On the map: LLM reasoning → Reasoning for agents, planning and code
Abstract (arXiv)
Recent advances in large reasoning models (LRMs) have enabled remarkable performance on complex tasks such as mathematics and coding by generating long Chain-of-Thought (CoT) traces. In this paper, we identify and systematically analyze a critical vulnerability we term reasoning distraction, where LRMs are diverted from their primary objective by irrelevant yet complex tasks maliciously embedded in the prompt. Through a comprehensive study across diverse models and benchmarks, we show that even state-of-the-art LRMs are highly susceptible, with injected distractors reducing task accuracy by up to 60%. We further reveal that certain alignment techniques can amplify this weakness and that models may exhibit covert compliance, following hidden adversarial instructions in reasoning while concealing them in the final output. To mitigate these risks, we propose a training-based defense that combines Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL) on synthetic adversarial data, improving robustness by over 50 points on challenging distractor attacks. Our findings establish reasoning distraction as a distinct and urgent threat to LRM reliability and provide a practical step toward safer and more trustworthy reasoning systems.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 37 of its 49 references that are in the map. First posted on arXiv 17 Oct 2025.
Builds on
37 of 49 references.
Closest ancestors · 2
Same direction, newest first
- 2025OverThink: Slowdown Attacks on Reasoning LLMs4 Feb
- 2024OpenAI o1 System Card21 Dec
Other references · 35
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
- 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,807
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
- 2023Instruction-Following Evaluation for Large Language Modelscited by 1,228
- 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 1,053
- 2023Prompt Injection attack against LLM-integrated Applicationscited by 605
- 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMscited by 570
- 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Modelscited by 464
23 more
- 2025Reasoning Models Don't Always Say What They Thinkcited by 415
- 2023JudgeLM: Fine-tuned Large Language Models are Scalable Judgescited by 367
- 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 320
- 2025Towards Large Reasoning Models: A Survey of Reinforced Reasoning with Large Language Modelscited by 293
- 2024Token-Budget-Aware LLM Reasoningcited by 247
- 2025ZebraLogic: On the Scaling Limits of LLMs for Logical Reasoningcited by 201
- 2025Phi-4-reasoning Technical Reportcited by 151
- 2025BIG-Bench Extra Hardcited by 125
- 2024Automatic and Universal Prompt Injection Attacks against Large Language Modelscited by 119
- 2025Proof or Bluff? Evaluating LLMs on 2025 USA Math Olympiadcited by 74
- 2025SEAL: Steerable Reasoning Calibration of Large Language Models for Freecited by 68
- 2024Efficiently Scaling LLM Reasoning with Certaindexcited by 58
- 2025LiveCodeBench Pro: How Do Olympiad Medalists Judge LLMs in Competitive Programming?cited by 55
- 2025Phi-4-Mini-Reasoning: Exploring the Limits of Small Reasoning Language Models in Mathcited by 44
- 2025LLMs Cannot Reliably Judge (Yet?): A Comprehensive Assessment on the Robustness of LLM-as-a-Judgecited by 37
- 2025THOUGHTTERMINATOR: Benchmarking, Calibrating, and Mitigating Overthinking in Reasoning Modelscited by 35
- 2025Mitigating Overthinking in Large Reasoning Models via Manifold Steeringcited by 33
- 2025Towards Understanding Distilled Reasoning Models: A Representational Approachcited by 26
- 2025Thought Manipulation: External Thought Can Be Efficient for Large Reasoning Modelscited by 23
- 2024Systematically Analyzing Prompt Injection Vulnerabilities in Diverse LLM Architecturescited by 12
- 2025Investigating the Vulnerability of LLM-as-a-Judge Architectures to Prompt-Injection Attackscited by 10
- 2025Too Easily Fooled? Prompt Injection Breaks LLMs on Frustratingly Simple Multiple-Choice Questionscited by 4
- 2025Quantifying Fairness in LLMs Beyond Tokens: A Semantic and Statistical Perspectivecited by 3
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026On the Efficiency-Safety Dilemma in Large Reasoning Models
- 2025To Think or Not to Think: Exploring the Unthinking Vulnerability in Large Reasoning Models
- 2026Consistency of Large Reasoning Models Under Multi-Turn Attacks
- 2026Reasoning Hijacking: The Fragility of Reasoning Alignment in Large Language Models
- 2026Mitigating Adaptive Attacks against Reasoning Models with Activation Consistency Training
- 2026Dual-Adversarial Safety Alignment: Cultivating Intrinsic Threat Comprehension in LRMs
- 2026Does Deeper Reasoning Compromise Alignment? Revealing and Mitigating of Alignment Collapse in Large Reasoning Models
- 2025AdvChain: Adversarial Chain-of-Thought Tuning for Robust Safety Alignment of Large Reasoning Models