Reasoning Shift: How Context Silently Shortens LLM Reasoning
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Large language models (LLMs) exhibiting test-time scaling behavior, such as extended reasoning traces and self-verification, have demonstrated remarkable performance on complex, long-term reasoning tasks. However, the robustness of these reasoning behaviors remains underexplored. To investigate this, we conduct a systematic evaluation of multiple reasoning models across three scenarios: (1) problems augmented with lengthy, irrelevant context; (2) multi-turn conversational settings with independent tasks; and (3) problems presented as a subtask within a complex task. We observe an interesting phenomenon: reasoning models tend to produce much shorter reasoning traces (up to 74%) for the same problem under different context conditions compared to the traces produced when the problem is presented in isolation. A finer-grained analysis reveals that this compression is associated with a decrease in self-verification and uncertainty management behaviors, such as double-checking. Importantly, we show that even when additional self-checks are forced, their efficiency depends not only on the content of the reasoning traces, but also on the presence of redundant context. We hope our findings draw additional attention to both the robustness of reasoning models and the problem of context management for LLMs.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 38 of its 59 references that are in the map. First posted on arXiv 1 Apr 2026.
Builds on
38 of 59 references.
Closest ancestors · 10
Same direction, newest first
- 2025Recursive Language Models31 Dec
- 2025Parallel-R1: Towards Parallel Thinking via Reinforcement Learning9 Sep
- 2025OptimalThinkingBench: Evaluating Over and Underthinking in LLMs18 Aug
- 2025gpt-oss-120b & gpt-oss-20b Model Card8 Aug
- 2025Understanding Reasoning in Thinking Language Models via Steering Vectors22 Jun
- 2025Don't Overthink it. Preferring Shorter Thinking Chains for Improved LLM Reasoning23 May
- 2025Between Underthinking and Overthinking: An Empirical Study of Reasoning Length and correctness in LLMs30 Apr
- 2025InftyThink: Breaking the Length Limits of Long-Context Reasoning in Large Language Models9 Mar
- 2025s1: Simple test-time scaling31 Jan
- 2024Training Language Models to Self-Correct via Reinforcement Learning19 Sep
Other references · 28
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen3 Technical Reportcited by 8,195
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
- 2024OpenAI o1 System Cardcited by 1,220
- 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
- 2025Kimi K2: Open Agentic Intelligencecited by 523
- 2025LIMO: Less is More for Reasoningcited by 488
- 2025Cognitive Behaviors that Enable Self-Improving Reasoners, or, Four Habits of Highly Effective STaRscited by 373
16 more
- 2024Long-context LLMs Struggle with Long In-context Learningcited by 285
- 2025When More is Less: Understanding Chain-of-Thought Length in LLMscited by 182
- 2025Open Problems in Mechanistic Interpretabilitycited by 173
- 2025Thought Anchors: Which LLM Reasoning Steps Matter?cited by 126
- 2025Context Length Alone Hurts LLM Performance Despite Perfect Retrievalcited by 118
- 2025A Comprehensive Survey on Long Context Language Modelingcited by 113
- 2025Olmo 3cited by 95
- 2025DeepSeekMath-V2: Towards Self-Verifiable Mathematical Reasoningcited by 84
- 2025LongReason: A Synthetic Long-Context Reasoning Benchmark via Context Expansioncited by 47
- 2026Building Production-Ready Probes For Geminicited by 38
- 2025PENCIL: Long Thoughts with Short Memorycited by 31
- 2025Learning to Keep a Promise: Scaling Language Model Decoding Parallelism with Learned Asynchronous Decodingcited by 26
- 2025What Characterizes Effective Reasoning? Revisiting Length, Review, and Structure of CoTcited by 24
- 2026How do LLMs Compute Verbal Confidencecited by 23
- 2026Causal Evidence that Language Models use Confidence to Drive Behaviorcited by 9
- 2025Towards Solving More Challenging IMO Problems via Decoupled Reasoning and Provingcited by 7
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026MemOps: Benchmarking Lifecycle Memory Operations in Long-Horizon Conversationscited by 3
- 2026The Illusion of Robustness: Aggregate Accuracy Hides Prediction Flips under Task-Irrelevant Contextcited by 1
- 2026Semantic Drift and the Stability of Operator Control in Reasoning-Class Decision Support Systemscited by 0
- 2026The Illusion of Robustness: Aggregate Accuracy Hides Prediction Flips under Task-Irrelevant Context14 Jul 2026
- 2026MemOps: Benchmarking Lifecycle Memory Operations in Long-Horizon Conversations14 Jul 2026
- 2026Semantic Drift and the Stability of Operator Control in Reasoning-Class Decision Support Systems8 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2025Longer Context, Deeper Thinking: Uncovering the Role of Long-Context Ability in Reasoning
- 2025Exploring LLM Reasoning Through Controlled Prompt Variations
- 2024Large Language Models Can Self-Improve in Long-context Reasoning
- 2024Beyond Accuracy: Evaluating the Reasoning Behavior of Large Language Models -- A Survey
- 2026Contextual Drag: How Errors in the Context Affect LLM Reasoning
- 2026Can We Break LLMs Out of Self-Loops? Fine-Grained Reasoning Control with Activation Steering
- 2025Double-Checker: Enhancing Reasoning of Slow-Thinking LLMs via Self-Critical Fine-Tuning
- 2024Inference Scaling vs Reasoning: An Empirical Analysis of Compute-Optimal LLM Problem-Solving