mlsanityData to 14 Oct 2026

Reasoning Model is Stubborn: Diagnosing Instruction Overriding in Reasoning Models

arXiv 2505.17225 ↗First posted 22 May 2025cs.AIcited by 6

On the map: LLM reasoning → Mathematical reasoning

Abstract (arXiv)

Large language models have demonstrated remarkable proficiency in long and complex reasoning tasks. However, they frequently exhibit a problematic reliance on familiar reasoning patterns, a phenomenon we term textitreasoning rigidity. Despite explicit instructions from users, these models often override clearly stated conditions and default to habitual reasoning trajectories, leading to incorrect conclusions. This behavior presents significant challenges, particularly in domains such as mathematics and logic puzzle, where precise adherence to specified constraints is critical. To systematically investigate reasoning rigidity, a behavior largely unexplored in prior work, we introduce a expert-curated diagnostic set, dataset. Our dataset includes specially modified variants of existing mathematical benchmarks, namely AIME and MATH500, as well as well-known puzzles deliberately redesigned to require deviation from familiar reasoning strategies. Using this dataset, we identify recurring contamination patterns that occur when models default to ingrained reasoning. Specifically, we categorize this contamination into three distinctive modes: (i) Interpretation Overload, (ii) Input Distrust, and (iii) Partial Instruction Attention, each causing models to ignore or distort provided instructions. We publicly release our diagnostic set to facilitate future research on mitigating reasoning rigidity in language models.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 24 of its 49 references that are in the map. First posted on arXiv 22 May 2025.

Builds on

24 of 49 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models5 Feb
  2. 2023Llemma: An Open Language Model For Mathematics16 Oct
  3. 2023MathPrompter: Mathematical Reasoning using Large Language Models4 Mar

Other references · 21

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  3. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  4. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  5. 2024Qwen2.5 Technical Reportcited by 4,942
  6. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
  7. 2024OpenAI o1 System Cardcited by 1,244
  8. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
  9. 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?cited by 982
  10. 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 872
  11. 2025Process Reinforcement through Implicit Rewardscited by 504
  12. 2020ReClor: A Reading Comprehension Dataset Requiring Logical Reasoningcited by 217
9 more
  1. 2019CLUTRR: A Diagnostic Benchmark for Inductive Reasoning from Textcited by 162
  2. 2025RM-R1: Reward Modeling as Reasoningcited by 154
  3. 2025Process Reward Models That Thinkcited by 118
  4. 2024o1-Coder: an o1 Replication for Codingcited by 78
  5. 2020LogiQA: A Challenge Dataset for Machine Reading Comprehension with Logical Reasoningcited by 69
  6. 2025Limitations of Large Language Models in Clinical Problem-Solving Arising from Inflexible Reasoningcited by 31
  7. 2024Easy Problems That LLMs Get Wrongcited by 30
  8. 2024Chain of Thought Still Thinks Fast: APriCoT Helps with Thinking Slowcited by 8
  9. 2025Do Chains-of-Thoughts of Large Language Models Suffer from Hallucinations, Cognitive Biases, or Phobias in Bayesian Reasoning?cited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 4.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Scaling Reasoning, Losing Control: Evaluating Instruction Following in Large Reasoning Models
  2. 2026Compliance vs. Sensibility: On the Reasoning Controllability in Large Language Models
  3. 2026Thinking Past the Answer: Evaluating Harmful Overthinking in Large Reasoning Models
  4. 2025Schoenfeld's Anatomy of Mathematical Reasoning by Language Models
  5. 2025Large Reasoning Models are not thinking straight: on the unreliability of thinking trajectories
  6. 2025The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexity
  7. 2025Catch Me If You Can: How Smaller Reasoning Models Pretend to Reason with Mathematical Fidelity
  8. 2025ReasonIF: Large Reasoning Models Fail to Follow Instructions During Reasoning