mlsanityData to 7 Oct 2026

Process or Result? Manipulated Ending Tokens Can Mislead Reasoning LLMs to Ignore the Correct Reasoning Steps

arXiv 2503.19326 ↗First posted 25 Mar 2025cs.AIcited by 9

On the map: LLM reasoning → Reasoning for agents, planning and code

Abstract (arXiv)

Recent reasoning large language models (LLMs) have demonstrated remarkable improvements in mathematical reasoning capabilities through long Chain-of-Thought. The reasoning tokens of these models enable self-correction within reasoning chains, enhancing robustness. This motivates our exploration: how vulnerable are reasoning LLMs to subtle errors in their input reasoning chains? We introduce "Compromising Thought" (CPT), a vulnerability where models presented with reasoning tokens containing manipulated calculation results tend to ignore correct reasoning steps and adopt incorrect results instead. Through systematic evaluation across multiple reasoning LLMs, we design three increasingly explicit prompting methods to measure CPT resistance, revealing that models struggle significantly to identify and correct these manipulations. Notably, contrary to existing research suggesting structural alterations affect model performance more than content modifications, we find that local ending token manipulations have greater impact on reasoning outcomes than structural changes. Moreover, we discover a security vulnerability in DeepSeek-R1 where tampered reasoning tokens can trigger complete reasoning cessation. Our work enhances understanding of reasoning robustness and highlights security considerations for reasoning-intensive applications.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 20 of its 23 references that are in the map. First posted on arXiv 25 Mar 2025.

Builds on

20 of 23 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025The Hidden Risks of Large Reasoning Models: A Safety Assessment of R118 Feb

Other references · 19

  1. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,193
  2. 2024Training Language Models to Self-Correct via Reinforcement Learningcited by 405
  3. 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 381
  4. 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 319
  5. 2023Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology Viewcited by 221
  6. 2024GSM-Plus: A Comprehensive Benchmark for Evaluating the Robustness of LLMs as Mathematical Problem Solverscited by 155
  7. 2025LLMs Can Easily Learn to Reason from Demonstrations Structure, not content, is what matters!cited by 132
  8. 2023How well do Large Language Models perform in Arithmetic tasks?cited by 130
  9. 2024MathBench: Evaluating the Theory and Application Proficiency of LLMs with a Hierarchical Mathematics Benchmarkcited by 103
  10. 2024Interpreting and Improving Large Language Models in Arithmetic Calculationcited by 43
  11. 2025Can Large Language Models Detect Errors in Long Chain-of-Thought Reasoning?cited by 43
  12. 2024Confidence v.s. Critique: A Decomposition of Self-Correction Capability for LLMscited by 28
7 more
  1. 2024Language Models Do Hard Arithmetic Tasks Easily and Hardly Do Easy Arithmetic Taskscited by 24
  2. 2025Mathematical Reasoning in Large Language Models: Assessing Logical and Arithmetic Errors across Wide Numerical Rangescited by 24
  3. 2025Premise-Augmented Reasoning Chains Improve Error Identification in Math reasoning with LLMscited by 22
  4. 2025BoostStep: Boosting mathematical capability of Large Language Models via improved single-step reasoningcited by 19
  5. 2024Learning From Correctness Without Prompting Makes LLM Efficient Reasonercited by 15
  6. 2025ProgCo: Program Helps Self-Correction of Large Language Modelscited by 14
  7. 2025FINEREASON: Evaluating and Improving LLMs' Deliberate Reasoning through Reflective Puzzle Solvingcited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 8; 2026: 1.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Fragile Thoughts: How Large Language Models Handle Chain-of-Thought Perturbations
  2. 2025Exploring LLM Reasoning Through Controlled Prompt Variations
  3. 2025CodeCrash: Exposing LLM Fragility to Misleading Natural Language in Code Reasoning
  4. 2025To Think or Not to Think: Exploring the Unthinking Vulnerability in Large Reasoning Models
  5. 2026First Token Matters: Understanding Safety Collapse in Large Reasoning Models
  6. 2026Beyond Content Safety: Real-Time Monitoring for Reasoning Vulnerabilities in Large Language Models
  7. 2025Beyond Semantics: The Unreasonable Effectiveness of Reasonless Intermediate Tokens
  8. 2024Dissociation of Faithful and Unfaithful Reasoning in LLMs