Process or Result? Manipulated Ending Tokens Can Mislead Reasoning LLMs to Ignore the Correct Reasoning Steps
On the map: LLM reasoning → Reasoning for agents, planning and code
Abstract (arXiv)
Recent reasoning large language models (LLMs) have demonstrated remarkable improvements in mathematical reasoning capabilities through long Chain-of-Thought. The reasoning tokens of these models enable self-correction within reasoning chains, enhancing robustness. This motivates our exploration: how vulnerable are reasoning LLMs to subtle errors in their input reasoning chains? We introduce "Compromising Thought" (CPT), a vulnerability where models presented with reasoning tokens containing manipulated calculation results tend to ignore correct reasoning steps and adopt incorrect results instead. Through systematic evaluation across multiple reasoning LLMs, we design three increasingly explicit prompting methods to measure CPT resistance, revealing that models struggle significantly to identify and correct these manipulations. Notably, contrary to existing research suggesting structural alterations affect model performance more than content modifications, we find that local ending token manipulations have greater impact on reasoning outcomes than structural changes. Moreover, we discover a security vulnerability in DeepSeek-R1 where tampered reasoning tokens can trigger complete reasoning cessation. Our work enhances understanding of reasoning robustness and highlights security considerations for reasoning-intensive applications.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 20 of its 23 references that are in the map. First posted on arXiv 25 Mar 2025.
Builds on
20 of 23 references.
Closest ancestors · 1
Same direction, newest first
Other references · 19
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,193
- 2024Training Language Models to Self-Correct via Reinforcement Learningcited by 405
- 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 381
- 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 319
- 2023Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology Viewcited by 221
- 2024GSM-Plus: A Comprehensive Benchmark for Evaluating the Robustness of LLMs as Mathematical Problem Solverscited by 155
- 2025LLMs Can Easily Learn to Reason from Demonstrations Structure, not content, is what matters!cited by 132
- 2023How well do Large Language Models perform in Arithmetic tasks?cited by 130
- 2024MathBench: Evaluating the Theory and Application Proficiency of LLMs with a Hierarchical Mathematics Benchmarkcited by 103
- 2024Interpreting and Improving Large Language Models in Arithmetic Calculationcited by 43
- 2025Can Large Language Models Detect Errors in Long Chain-of-Thought Reasoning?cited by 43
- 2024Confidence v.s. Critique: A Decomposition of Self-Correction Capability for LLMscited by 28
7 more
- 2024Language Models Do Hard Arithmetic Tasks Easily and Hardly Do Easy Arithmetic Taskscited by 24
- 2025Mathematical Reasoning in Large Language Models: Assessing Logical and Arithmetic Errors across Wide Numerical Rangescited by 24
- 2025Premise-Augmented Reasoning Chains Improve Error Identification in Math reasoning with LLMscited by 22
- 2025BoostStep: Boosting mathematical capability of Large Language Models via improved single-step reasoningcited by 19
- 2024Learning From Correctness Without Prompting Makes LLM Efficient Reasonercited by 15
- 2025ProgCo: Program Helps Self-Correction of Large Language Modelscited by 14
- 2025FINEREASON: Evaluating and Improving LLMs' Deliberate Reasoning through Reflective Puzzle Solvingcited by 10
Built on by
Citing papers per year: 2025: 8; 2026: 1.
9 papers.
- 2025Safety in Large Reasoning Models: A Surveycited by 58
- 2025A Comprehensive Survey on Trustworthiness in Reasoning with Large Language Modelscited by 22
- 2025MAD-Spear: A Conformity-Driven Prompt Injection Attack on Multi-Agent Debate Systemscited by 10
- 2025Practical Reasoning Interruption Attacks on Reasoning Large Language Modelscited by 7
- 2026What Matters For Safety Alignment?cited by 6
- 2025Token-Efficient Prompt Injection Attack: Provoking Cessation in LLM Reasoning via Adaptive Token Compressioncited by 3
- 2025Red Teaming Large Reasoning Modelscited by 2
- 2025Rethinking Reasoning: A Survey on Reasoning-based Backdoors in LLMscited by 1
- 2025From Perception to Reasoning: Deep Thinking Empowers Multimodal Large Language Modelscited by 1
- 2026What Matters For Safety Alignment?7 Jan 2026
- 2025Red Teaming Large Reasoning Models29 Nov 2025
- 2025From Perception to Reasoning: Deep Thinking Empowers Multimodal Large Language Models17 Nov 2025
- 2025Rethinking Reasoning: A Survey on Reasoning-based Backdoors in LLMs9 Oct 2025
- 2025A Comprehensive Survey on Trustworthiness in Reasoning with Large Language Models4 Sep 2025
- 2025MAD-Spear: A Conformity-Driven Prompt Injection Attack on Multi-Agent Debate Systems17 Jul 2025
- 2025Practical Reasoning Interruption Attacks on Reasoning Large Language Models10 May 2025
- 2025Token-Efficient Prompt Injection Attack: Provoking Cessation in LLM Reasoning via Adaptive Token Compression29 Apr 2025
- 2025Safety in Large Reasoning Models: A Survey24 Apr 2025
Similar, not cited
Close in wording, no citation either way
- 2026Fragile Thoughts: How Large Language Models Handle Chain-of-Thought Perturbations
- 2025Exploring LLM Reasoning Through Controlled Prompt Variations
- 2025CodeCrash: Exposing LLM Fragility to Misleading Natural Language in Code Reasoning
- 2025To Think or Not to Think: Exploring the Unthinking Vulnerability in Large Reasoning Models
- 2026First Token Matters: Understanding Safety Collapse in Large Reasoning Models
- 2026Beyond Content Safety: Real-Time Monitoring for Reasoning Vulnerabilities in Large Language Models
- 2025Beyond Semantics: The Unreasonable Effectiveness of Reasonless Intermediate Tokens
- 2024Dissociation of Faithful and Unfaithful Reasoning in LLMs