When Reasoning Goes Astray: Attention Dynamics of Uncontrolled Reasoning
On the map: LLM reasoning → Test-time compute and efficient thinking also fits: Prompting and chain-of-thought reasoning
Abstract (arXiv)
Large reasoning models (LRMs) improve performance on complex tasks through extended reasoning, yet the same process can degenerate into redundant verification and persistent generation loops. Such uncontrolled reasoning increases inference cost and creates risks of resource exhaustion and service degradation. However, existing mitigations largely truncate long outputs or react to surface repetition, and thus fail to distinguish normal thinking from uncontrolled reasoning or explain how benign reasoning degenerates into harmful behavior. In this paper, we operationalize LRM generation as four states and further introduce Reasoning-state Analysis via Dynamic Attention Responses (RADAR), which identifies the current reasoning state in real time and characterizes how effective reflection can develop into uncontrolled generation. Guided by RADAR's analysis, we further realign abnormal attention distributions toward patterns observed in normal requests and examine how this correction affects excessive reflection and persistent looping. Temporal analyses show that uncontrolled reasoning is characterized by attention distributions that deviate from normal generation, with abnormal trends becoming detectable before repetition begins. Correcting these deviations through Attention Realignment consistently reduces looping while largely preserving benign performance. Together, RADAR provide a mechanistic account of how reasoning becomes uncontrolled, offering actionable guidance for identifying critical failure stages and designing targeted runtime interventions.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 32 of its 40 references that are in the map. First posted on arXiv 30 Sep 2026.
Builds on
32 of 40 references.
Closest ancestors · 11
Same direction, newest first
- 2026Early Stopping for Large Reasoning Models via Confidence Dynamics6 Apr
- 2025Inverse Scaling in Test-Time Compute19 Jul
- 2025Dynamic Early Exit in Reasoning Models22 Apr
- 2025Missing Premise exacerbates Overthinking: Are Reasoning Models losing Critical Thinking Skill?9 Apr
- 2025ThinkPrune: Pruning Long Chain-of-Thought of LLMs via Reinforcement Learning2 Apr
- 2025TokenSkip: Controllable Chain-of-Thought Compression in LLMs17 Feb
- 2025s1: Simple test-time scaling31 Jan
- 2025O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruning22 Jan
- 2024Token-Budget-Aware LLM Reasoning24 Dec
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Models17 May
- 2022STaR: Bootstrapping Reasoning With Reasoning28 Mar
Other references · 21
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2025Qwen3 Technical Reportcited by 8,820
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2023Let's Verify Step by Stepcited by 3,789
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2017A Deep Reinforced Model for Abstractive Summarizationcited by 365
- 2020Sponge Examples: Energy-Latency Attacks on Neural Networkscited by 111
- 2025OverThink: Slowdown Attacks on Reasoning LLMscited by 96
- 2025S-GRPO: Early Exit via Reinforcement Learning in Reasoning Modelscited by 87
9 more
- 2024Denial-of-Service Poisoning Attacks against Large Language Modelscited by 35
- 2024An Engorgio Prompt Makes Large Language Model Babble oncited by 30
- 2025LoopLLM: Transferable Energy-Latency Attacks in LLMs via Repetitive Generationcited by 8
- 2026Fine-Grained Activation Steering: Steering Less, Achieving Morecited by 7
- 2026RECUR: Resource Exhaustion Attack via Recursive-Entropy Guided Counterfactual Utilization and Reflectioncited by 4
- 2023Mitigating the Learning Bias towards Repetition by Self-Contrastive Training for Open-Ended Generationcited by 3
- 2026CODE: A Contradiction-Based Deliberation Extension Framework for Overthinking Attacks on Retrieval-Augmented Generationcited by 3
- 2026Resource Consumption Threats in Large Language Modelscited by 2
- 2026</think> Doesn't Stop Reasoning: Analysis of Spurious CoT Terminationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Stop When Further Reasoning Won't Help: Attention-State Adaptive Generation in Reasoning Models
- 2025When Can Large Reasoning Models Save Thinking? Mechanistic Analysis of Behavioral Divergence in Reasoning
- 2026Dynamic Thinking-Token Selection for Efficient Reasoning in Large Reasoning Models
- 2025Understanding and Steering the Cognitive Behaviors of Reasoning Models at Test-Time
- 2025The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexity
- 2025Thinking Sparks!: Emergent Attention Heads in Reasoning Models During Post Training
- 2025Probing the "Psyche'' of Large Reasoning Models: Understanding Through a Human Lens
- 2025The Evolution of Thought: Tracking LLM Overthinking via Reasoning Dynamics Analysis