Compliance vs. Sensibility: On the Reasoning Controllability in Large Language Models
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
Large Language Models (LLMs) acquire reasoning capabilities through shared inference patterns in pre-training data, which are further elicited via Chain-of-Thought (CoT). However, whether fundamental reasoning patterns, such as induction, deduction, and abduction, can be decoupled from specific problem instances remains a critical challenge for model controllability. In this paper, we present the first systematic investigation of this problem through the lens of reasoning conflicts, an explicit tension between parametric and contextual information induced by mandating logical schemata that deviate from those expected for a target task. Our evaluation reveals that LLMs consistently prioritize sensibility over compliance, favoring task-appropriate reasoning patterns despite conflicting instructions. We further demonstrate that reasoning conflicts are internally detectable, as confidence scores drop during conflicting episodes. Probing reveals instruction decodability even without compliance, while CKA identifies geometric differences across models and spans. Leveraging these insights, we steer models towards compliance, increasing instruction following by up to 29%. Overall, our findings establish that while LLM reasoning is anchored to concrete instances, active mechanistic interventions can effectively decouple logical schemata from data, offering a path toward improved controllability, faithfulness, and generalizability.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 18 of its 48 references that are in the map. First posted on arXiv 29 Apr 2026.
Builds on
18 of 48 references.
Closest ancestors · 5
Same direction, newest first
- 2026Fundamental Reasoning Paradigms Induce Out-of-Domain Generalization in Language Models9 Feb
- 2025Do Language Models Follow Occam's Razor? An Evaluation of Parsimony in Inductive and Abductive Reasoning3 Sep
- 2025Qwen3 Technical Report14 May
- 2025Logical Reasoning in Large Language Models: A Survey13 Feb
- 2025Are DeepSeek R1 And Other Reasoning Models More Faithful?14 Jan
Other references · 13
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2022Language Models (Mostly) Know What They Knowcited by 1,856
- 2019Similarity of Neural Network Representations Revisitedcited by 1,755
- 2023Measuring Faithfulness in Chain-of-Thought Reasoningcited by 703
- 2023Eliciting Latent Predictions from Transformers with the Tuned Lenscited by 623
- 2024A Comprehensive Study of Knowledge Editing for Large Language Modelscited by 163
- 2025Olmo 3cited by 129
- 2024Isambard-AI: a leadership class supercomputer optimised specifically for Artificial Intelligencecited by 62
- 2025Measuring Chain of Thought Faithfulness by Unlearning Reasoning Stepscited by 47
- 2025Beyond 'Aha!': Toward Systematic Meta-Abilities Alignment in Large Reasoning Modelscited by 18
- 2025Mitigating Content Effects on Reasoning in Language Models through Fine-Grained Activation Steeringcited by 18
1 more
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025ReasonIF: Large Reasoning Models Fail to Follow Instructions During Reasoning
- 2024Beyond Accuracy: Evaluating the Reasoning Behavior of Large Language Models -- A Survey
- 2026Can We Break LLMs Out of Self-Loops? Fine-Grained Reasoning Control with Activation Steering
- 2025Flying Pigs, FaR and Beyond: Evaluating LLM Reasoning in Counterfactual Worlds
- 2025Exploring LLM Reasoning Through Controlled Prompt Variations
- 2024General Purpose Verification for Chain of Thought Prompting
- 2026Towards a Mechanistic Understanding of Propositional Logical Reasoning in Large Language Models
- 2026Large Language Model Reasoning Failures