mlsanityData to 14 Oct 2026

Distractor Injection Attacks on Large Reasoning Models: Characterization and Defense

arXiv 2510.16259 ↗First posted 17 Oct 2025cs.AIcited by 2

On the map: LLM reasoning → Reasoning for agents, planning and code

Abstract (arXiv)

Recent advances in large reasoning models (LRMs) have enabled remarkable performance on complex tasks such as mathematics and coding by generating long Chain-of-Thought (CoT) traces. In this paper, we identify and systematically analyze a critical vulnerability we term reasoning distraction, where LRMs are diverted from their primary objective by irrelevant yet complex tasks maliciously embedded in the prompt. Through a comprehensive study across diverse models and benchmarks, we show that even state-of-the-art LRMs are highly susceptible, with injected distractors reducing task accuracy by up to 60%. We further reveal that certain alignment techniques can amplify this weakness and that models may exhibit covert compliance, following hidden adversarial instructions in reasoning while concealing them in the final output. To mitigate these risks, we propose a training-based defense that combines Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL) on synthetic adversarial data, improving robustness by over 50 points on challenging distractor attacks. Our findings establish reasoning distraction as a distinct and urgent threat to LRM reliability and provide a practical step toward safer and more trustworthy reasoning systems.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 37 of its 49 references that are in the map. First posted on arXiv 17 Oct 2025.

Builds on

37 of 49 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025OverThink: Slowdown Attacks on Reasoning LLMs4 Feb
  2. 2024OpenAI o1 System Card21 Dec

Other references · 35

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  4. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  5. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  6. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,807
  7. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
  8. 2023Instruction-Following Evaluation for Large Language Modelscited by 1,228
  9. 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 1,053
  10. 2023Prompt Injection attack against LLM-integrated Applicationscited by 605
  11. 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMscited by 570
  12. 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Modelscited by 464
23 more
  1. 2025Reasoning Models Don't Always Say What They Thinkcited by 415
  2. 2023JudgeLM: Fine-tuned Large Language Models are Scalable Judgescited by 367
  3. 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 320
  4. 2025Towards Large Reasoning Models: A Survey of Reinforced Reasoning with Large Language Modelscited by 293
  5. 2024Token-Budget-Aware LLM Reasoningcited by 247
  6. 2025ZebraLogic: On the Scaling Limits of LLMs for Logical Reasoningcited by 201
  7. 2025Phi-4-reasoning Technical Reportcited by 151
  8. 2025BIG-Bench Extra Hardcited by 125
  9. 2024Automatic and Universal Prompt Injection Attacks against Large Language Modelscited by 119
  10. 2025Proof or Bluff? Evaluating LLMs on 2025 USA Math Olympiadcited by 74
  11. 2025SEAL: Steerable Reasoning Calibration of Large Language Models for Freecited by 68
  12. 2024Efficiently Scaling LLM Reasoning with Certaindexcited by 58
  13. 2025LiveCodeBench Pro: How Do Olympiad Medalists Judge LLMs in Competitive Programming?cited by 55
  14. 2025Phi-4-Mini-Reasoning: Exploring the Limits of Small Reasoning Language Models in Mathcited by 44
  15. 2025LLMs Cannot Reliably Judge (Yet?): A Comprehensive Assessment on the Robustness of LLM-as-a-Judgecited by 37
  16. 2025THOUGHTTERMINATOR: Benchmarking, Calibrating, and Mitigating Overthinking in Reasoning Modelscited by 35
  17. 2025Mitigating Overthinking in Large Reasoning Models via Manifold Steeringcited by 33
  18. 2025Towards Understanding Distilled Reasoning Models: A Representational Approachcited by 26
  19. 2025Thought Manipulation: External Thought Can Be Efficient for Large Reasoning Modelscited by 23
  20. 2024Systematically Analyzing Prompt Injection Vulnerabilities in Diverse LLM Architecturescited by 12
  21. 2025Investigating the Vulnerability of LLM-as-a-Judge Architectures to Prompt-Injection Attackscited by 10
  22. 2025Too Easily Fooled? Prompt Injection Breaks LLMs on Frustratingly Simple Multiple-Choice Questionscited by 4
  23. 2025Quantifying Fairness in LLMs Beyond Tokens: A Semantic and Statistical Perspectivecited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026On the Efficiency-Safety Dilemma in Large Reasoning Models
  2. 2025To Think or Not to Think: Exploring the Unthinking Vulnerability in Large Reasoning Models
  3. 2026Consistency of Large Reasoning Models Under Multi-Turn Attacks
  4. 2026Reasoning Hijacking: The Fragility of Reasoning Alignment in Large Language Models
  5. 2026Mitigating Adaptive Attacks against Reasoning Models with Activation Consistency Training
  6. 2026Dual-Adversarial Safety Alignment: Cultivating Intrinsic Threat Comprehension in LRMs
  7. 2026Does Deeper Reasoning Compromise Alignment? Revealing and Mitigating of Alignment Collapse in Large Reasoning Models
  8. 2025AdvChain: Adversarial Chain-of-Thought Tuning for Robust Safety Alignment of Large Reasoning Models