Are Reasoning LLMs Robust to Interventions on Their Chain-of-Thought?
On the map: LLM reasoning → Mathematical reasoning
Abstract (arXiv)
Reasoning LLMs (RLLMs) generate step-by-step chains of thought (CoTs) before giving an answer, which improves performance on complex tasks and makes reasoning more transparent. But how robust are these reasoning traces to disruptions that occur within them? To address this question, we introduce a controlled evaluation framework that perturbs a model's own CoT at fixed timesteps. We design seven interventions (benign, neutral, and adversarial) and apply them to multiple open-weight RLLMs across Math, Science, and Logic tasks. Our results show that RLLMs are generally robust, reliably recovering from diverse perturbations, with robustness improving with model size and degrading when interventions occur early. However, robustness is not style-invariant: paraphrasing suppresses doubt-like expressions and reduces performance, while other interventions trigger doubt and support recovery. Recovery also carries a cost: neutral and adversarial noise can inflate CoT length by more than 200%, whereas paraphrasing shortens traces but harms accuracy. These findings provide new evidence on how RLLMs maintain reasoning integrity, identify doubt as a central recovery mechanism, and highlight trade-offs between robustness and efficiency that future training methods should address.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 1 of its 55 references that are in the map. First posted on arXiv 7 Feb 2026.
Builds on
1 of 55 references.
References · 1
- 2023Prompt Injection attack against LLM-integrated Applicationscited by 568
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Evaluation Awareness in Language Models Has Limited Effect on Behaviourcited by 5
- 2026Robust Reasoning Benchmarkcited by 3
- 2026Reliable Chain-of-Thought via Prefix Consistencycited by 3
- 2026SABER: Stability-Aware Early Exit for LLM Reasoning via Adversarial Branch Probingcited by 1
- 2026Should We be Pedantic About Reasoning Errors in Machine Translation?cited by 0
- 2026Adaptive Triggering for Bias Correction in LLM Reasoningcited by 0
- 2026SABER: Stability-Aware Early Exit for LLM Reasoning via Adversarial Branch Probing28 Aug 2026
- 2026Adaptive Triggering for Bias Correction in LLM Reasoning26 Aug 2026
- 2026Reliable Chain-of-Thought via Prefix Consistency8 May 2026
- 2026Evaluation Awareness in Language Models Has Limited Effect on Behaviour7 May 2026
- 2026Should We be Pedantic About Reasoning Errors in Machine Translation?10 Apr 2026
- 2026Robust Reasoning Benchmark26 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026Fragile Thoughts: How Large Language Models Handle Chain-of-Thought Perturbations
- 2025Is Reasoning All You Need? Probing Bias in the Age of Reasoning Language Models
- 2025Robust Answers, Fragile Logic: Probing the Decoupling Hypothesis in LLM Reasoning
- 2025Patterns Over Principles: The Fragility of Inductive Reasoning in LLMs under Noisy Observations
- 2025Reasoning Models Better Express Their Confidence
- 2025Exploring LLM Reasoning Through Controlled Prompt Variations
- 2026Understanding and Mitigating Premature Confidence for Better LLM Reasoning
- 2025An Investigation of Robustness of LLMs in Mathematical Reasoning: Benchmarking with Mathematically-Equivalent Transformation of Advanced Mathematical Problems