The Danger of Overthinking: Examining the Reasoning-Action Dilemma in Agentic Tasks
On the map: LLM reasoning → Test-time compute and efficient thinking
also in 1 more
Abstract (arXiv)
Large Reasoning Models (LRMs) represent a breakthrough in AI problem-solving capabilities, but their effectiveness in interactive environments can be limited. This paper introduces and analyzes overthinking in LRMs. A phenomenon where models favor extended internal reasoning chains over environmental interaction. Through experiments on software engineering tasks using SWE Bench Verified, we observe three recurring patterns: Analysis Paralysis, Rogue Actions, and Premature Disengagement. We propose a framework to study these behaviors, which correlates with human expert assessments, and analyze 4018 trajectories. We observe that higher overthinking scores correlate with decreased performance, with reasoning models exhibiting stronger tendencies toward overthinking compared to non-reasoning models. Our analysis reveals that simple efforts to mitigate overthinking in agentic environments, such as selecting the solution with the lower overthinking score, can improve model performance by almost 30% while reducing computational costs by 43%. These results suggest that mitigating overthinking has strong practical implications. We suggest that by leveraging native function-calling capabilities and selective reinforcement learning overthinking tendencies could be mitigated. We also open-source our evaluation framework and dataset to facilitate research in this direction at https://github.com/AlexCuadron/Overthinking.
Key facts. Cited by 152 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 26 of its 53 references that are in the map. First posted on arXiv 12 Feb 2025.
Builds on
26 of 53 references.
Closest ancestors · 4
Same direction, newest first
- 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMs30 Dec
- 2024Reasoning Paths Optimization: Learning to Reason and Explore From Diverse Paths7 Oct
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Models17 May
- 2023Self-Refine: Iterative Refinement with Self-Feedback30 Mar
Other references · 22
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2024Qwen2 Technical Reportcited by 2,120
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 1,002
- 2022A Survey on In-context Learningcited by 721
- 2024Executable Code Actions Elicit Better LLM Agentscited by 564
10 more
- 2025Search-o1: Agentic Search-Enhanced Large Reasoning Modelscited by 433
- 2024Agentless: Demystifying LLM-based Software Engineering Agentscited by 421
- 2025rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinkingcited by 313
- 2025Towards Large Reasoning Models: A Survey of Reinforced Reasoning with Large Language Modelscited by 293
- 2024AI Agents That Mattercited by 219
- 2024Evaluation of OpenAI o1: Opportunities and Challenges of AGIcited by 127
- 2024CodeR: Issue Resolving with Multi-Agent and Task Graphscited by 91
- 2024MarsCode Agent: AI-native Automated Bug Fixingcited by 71
- 2024HyperAgent: Generalist Software Engineering Agents to Solve Coding Tasks at Scalecited by 61
- 2024Agentic Information Retrievalcited by 21
Built on by
Citing papers per year: 2025: 108; 2026: 44.
152 papers.
Sort:
By area:
- 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Modelscited by 464
- 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 384
- 2025Dynamic Early Exit in Reasoning Modelscited by 219
- 2025A Survey of Efficient Reasoning for Large Reasoning Models: Language, Multimodality, and Beyondcited by 132
- 2025Process Reward Models That Thinkcited by 118
- 2025Thinkless: LLM Learns When to Thinkcited by 113
- 2025Efficient Reasoning Models: A Surveycited by 95
- 2025S-GRPO: Early Exit via Reinforcement Learning in Reasoning Modelscited by 87
- 2025ShorterBetter: Guiding Reasoning Models to Find Optimal Inference Length for Efficient Reasoningcited by 72
- 2025Wait, We Don't Need to "Wait"! Removing Thinking Tokens Improves Reasoning Efficiencycited by 66
- 2025SWE-Exp: Experience-Driven Software Issue Resolutioncited by 65
- 2025Safety in Large Reasoning Models: A Surveycited by 64
38 more
- 2025Efficient Inference for Large Reasoning Models: A Surveycited by 61
- 2025Missing Premise exacerbates Overthinking: Are Reasoning Models losing Critical Thinking Skill?cited by 58
- 2025Inverse Scaling in Test-Time Computecited by 50
- 2025Crosslingual Reasoning through Test-Time Scalingcited by 46
- 2025Think or Not Think: A Study of Explicit Thinking in Rule-Based Visual Reinforcement Fine-Tuningcited by 44
- 2025SciReplicate-Bench: Benchmarking LLMs in Agent-driven Algorithmic Reproduction from Research Paperscited by 43
- 2025Optimizing Length Compression in Large Reasoning Modelscited by 38
- 2025Making Slow Thinking Faster: Compressing LLM Chain-of-Thought via Step Entropycited by 38
- 2025ParaThinker: Native Parallel Thinking as a New Paradigm to Scale LLM Test-time Computecited by 38
- 2025ThinkSwitcher: When to Think Hard, When to Think Fastcited by 37
- 2025Don't Overthink It: A Survey of Efficient R1-style Large Reasoning Modelscited by 37
- 2025Harnessing the Reasoning Economy: A Survey of Efficient Reasoning for Large Language Modelscited by 36
- 2025Cost-of-Pass: An Economic Framework for Evaluating Language Modelscited by 35
- 2025OptimalThinkingBench: Evaluating Over and Underthinking in LLMscited by 35
- 2025Retro-Search: Exploring Untaken Paths for Deeper and Efficient Reasoningcited by 34
- 2025Mitigating Overthinking in Large Reasoning Models via Manifold Steeringcited by 33
- 2025100 Days After DeepSeek-R1: A Survey on Replication Studies and More Directions for Reasoning Language Modelscited by 30
- 2025Topology of Reasoning: Understanding Large Reasoning Models through Reasoning Graph Propertiescited by 29
- 2025Synergizing RAG and Reasoning: A Systematic Reviewcited by 27
- 2025Stable Reinforcement Learning for Efficient Reasoningcited by 27
- 2025Wait, Wait, Wait... Why Do Reasoning Models Loop?cited by 26
- 2025A Comprehensive Survey on Trustworthiness in Reasoning with Large Language Modelscited by 25
- 2025MathAgent: Leveraging a Mixture-of-Math-Agent Framework for Real-World Multimodal Mathematical Error Detectioncited by 24
- 2025Beyond Prompt Engineering: Robust Behavior Control in LLMs via Steering Target Atomscited by 24
- 2025How to Train Your Advisor: Steering Black-Box LLMs with Advisor Modelscited by 24
- 2025Position: Agent Should Invoke External Tools ONLY When Epistemically Necessarycited by 22
- 2025Language Mixing in Reasoning Language Models: Patterns, Impact, and Internal Causescited by 21
- 2025What Makes a Good Reasoning Chain? Uncovering Structural Patterns in Long Chain-of-Thought Reasoningcited by 21
- 2025The Lighthouse of Language: Enhancing LLM Agents via Critique-Guided Improvementcited by 20
- 2025THINK-Bench: Evaluating Thinking Efficiency and Chain-of-Thought Quality of Large Reasoning Modelscited by 19
- 2025Reasoning Models Hallucinate More: Factuality-Aware Reinforcement Learning for Large Reasoning Modelscited by 19
- 2025Do Language Models Mirror Human Confidence? Exploring Psychological Insights to Address Overconfidence in LLMscited by 19
- 2025Towards Concise and Adaptive Thinking in Large Reasoning Models: A Surveycited by 18
- 2025WebCoT: Enhancing Web Agent Reasoning by Reconstructing Chain-of-Thought in Reflection, Branching, and Rollbackcited by 17
- 2025OThink-R1: Intrinsic Fast/Slow Thinking Mode Switching for Over-Reasoning Mitigationcited by 17
- 2025Causal Sufficiency and Necessity Improves Chain-of-Thought Reasoningcited by 17
- 2025Reasoning on a Spectrum: Aligning LLMs to System 1 and System 2 Thinkingcited by 16
- 2025Two Experts Are All You Need for Steering Thinking: Reinforcing Cognitive Effort in MoE Reasoning Models Without Additional Trainingcited by 16
50 most cited of 152 All 152 (JSON)
- 2026Hybrid Reasoning Agents13 Oct 2026
- 2026From Token-Max to Outcome-Max: How You Use AI Determines Its Productivity5 Oct 2026
- 2026Anthropomorphism in the age of Large Language Models: An overview of potential risks and mitigations29 Sep 2026
- 2026Absorbed in Inertia: Activation Analysis for Computer-Use Agents29 Sep 2026
- 2026Making Agents More Consistent: Skills Should Form Habits for Repeat Tasks21 Sep 2026
- 2026Assessing Adversarial Robustness of Latent Reasoning Models3 Sep 2026
- 2026Geometry of Divergence: Tracking Hidden-State Trajectories for Adaptive Multi-Turn Reasoning31 Aug 2026
- 2026GRIP: Granular Reward-Guided Parameter Interpolation for Efficient Reasoning26 Aug 2026
- 2026Alignment of LRMs via Counter-Aligned Few-Shot Conversation Exposure16 Aug 2026
- 2026Test-time reasoning effort and unauthorized tool use in language-model agents: a prespecified equivalence study4 Aug 2026
- 2026EvoThink: Evolving Thinking in Large Reasoning Models via Self-Pruning and Aha-Moment Preference Optimization22 Jul 2026
- 2026WordPolo: Evaluating Language Models Through Iterative Semantic Feedback18 Jul 2026
38 more
- 2026From Trajectories to Prefixes: Reusing Teacher Trajectories via Replayed Prefixes and Online Continuation3 Jul 2026
- 2026AdaThinking-E: One-Token Entropy Regulation for Adaptive Thinking26 Jun 2026
- 2026SQLConductor: Search-to-Policy Learning for Step-wise Text-to-SQL Orchestration22 Jun 2026
- 2026The Periodic Table of LLM Reasoning: A Structured Survey of Reasoning Paradigms, Methods, and Failure Modes9 Jun 2026
- 2026Human oversight of agentic systems in practice: Examining the oversight work, challenges, and heuristics of developers using software agents3 Jun 2026
- 2026Thinking Past the Answer: Evaluating Harmful Overthinking in Large Reasoning Models1 Jun 2026
- 2026TRIAGE: Evaluating Prospective Metacognitive Control in LLMs under Resource Constraints13 May 2026
- 2026Inducing Overthink: Hierarchical Genetic Algorithm-based DoS Attack on Black-Box Large Language Reasoning Models13 May 2026
- 2026Implicit Compression Regularization: Concise Reasoning via Internal Shorter Distributions in RL Post-Training8 May 2026
- 2026TACT: Mitigating Overthinking and Overacting in Coding Agents via Activation Steering7 May 2026
- 2026AcademiClaw: When Students Set Challenges for AI Agents4 May 2026
- 2026FitText: Evolving Agent Tool Ecologies via Memetic Retrieval4 May 2026
- 2026Efficient Test-Time Scaling via Temporal Reasoning Aggregation19 Apr 2026
- 2026When Is Thinking Enough? Early Exit via Sufficiency Assessment for Efficient Reasoning8 Apr 2026
- 2026The Detection-Extraction Gap: Models Know the Answer Before They Can Say It8 Apr 2026
- 2026Balancing the Reasoning Load: Difficulty-Differentiated Policy Optimization with Length Redistribution for Efficient and Robust Reinforcement Learning19 Mar 2026
- 2026Re2: Unlocking LLM Reasoning via Reinforcement Learning with Re-solving7 Mar 2026
- 2026Draft-Thinking: Learning Efficient Reasoning in Long Chain-of-Thought LLMs28 Feb 2026
- 2026Overthinking Loops in Agents: A Structural Risk via MCP Tools16 Feb 2026
- 2026Agentic Test-Time Scaling for WebAgents12 Feb 2026
- 2026ADORA: Training Reasoning Models with Dynamic Advantage Estimation on Reinforcement Learning10 Feb 2026
- 2026Making Expert Reasoning Learnable with Self-Distillation2 Feb 2026
- 2026Anytime Safe PAC Efficient Reasoning30 Jan 2026
- 2026Reasoning While Asking: Transforming Reasoning Large Language Models from Passive Solvers to Proactive Inquirers29 Jan 2026
- 2026Self-Compression of Chain-of-Thought via Multi-Agent Reinforcement Learning29 Jan 2026
- 2026FROST: Filtering Reasoning Outliers with Attention for Efficient Reasoning26 Jan 2026
- 2026CODE: A Contradiction-Based Deliberation Extension Framework for Overthinking Attacks on Retrieval-Augmented Generation19 Jan 2026
- 2026Beyond Model Scaling: Test-Time Intervention for Efficient Deep Reasoning16 Jan 2026
- 2026ENTRA: Entropy-Based Redundancy Avoidance in Large Language Model Reasoning12 Jan 2026
- 2026Towards a Mechanistic Understanding of Large Reasoning Models: A Survey of Training, Inference, and Failures11 Jan 2026
- 2026QA-Merging: Query-Adaptive Reasoning via Layer Selective Model Merging7 Jan 2026
- 2026SketchThinker-R1: Towards Efficient Sketch-Style Reasoning in Large Multimodal Models6 Jan 2026
- 2025Semantic Deception: When Reasoning Models Can't Compute an Addition23 Dec 2025
- 2025Wait, Wait, Wait... Why Do Reasoning Models Loop?15 Dec 2025
- 2025Think in Parallel, Answer as One: Logit Averaging for Open-Ended Reasoning2 Dec 2025
- 2025Focused Chain-of-Thought: Efficient LLM Reasoning via Structured Input Information27 Nov 2025
- 2025Understanding the Effects of Distractors on Reasoning Vision-Language Models26 Nov 2025
- 2025Reducing Latency of LLM Search Agent via Speculation-based Algorithm-System Co-Design25 Nov 2025
50 newest of 152 All 152 (JSON)
- 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Modelscited by 464
- 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 384
- 2025Dynamic Early Exit in Reasoning Modelscited by 219
- 2025A Survey of Efficient Reasoning for Large Reasoning Models: Language, Multimodality, and Beyondcited by 132
- 2025Process Reward Models That Thinkcited by 118
- 2025Thinkless: LLM Learns When to Thinkcited by 113
- 2025Efficient Reasoning Models: A Surveycited by 95
- 2025S-GRPO: Early Exit via Reinforcement Learning in Reasoning Modelscited by 87
- 2025ShorterBetter: Guiding Reasoning Models to Find Optimal Inference Length for Efficient Reasoningcited by 72
- 2025Wait, We Don't Need to "Wait"! Removing Thinking Tokens Improves Reasoning Efficiencycited by 66
- 2025Safety in Large Reasoning Models: A Surveycited by 64
- 2025Efficient Inference for Large Reasoning Models: A Surveycited by 61
12 most cited of 120 All 120 (JSON)
- 2026Hybrid Reasoning Agents13 Oct 2026
- 2026Assessing Adversarial Robustness of Latent Reasoning Models3 Sep 2026
- 2026Geometry of Divergence: Tracking Hidden-State Trajectories for Adaptive Multi-Turn Reasoning31 Aug 2026
- 2026GRIP: Granular Reward-Guided Parameter Interpolation for Efficient Reasoning26 Aug 2026
- 2026Alignment of LRMs via Counter-Aligned Few-Shot Conversation Exposure16 Aug 2026
- 2026Test-time reasoning effort and unauthorized tool use in language-model agents: a prespecified equivalence study4 Aug 2026
- 2026EvoThink: Evolving Thinking in Large Reasoning Models via Self-Pruning and Aha-Moment Preference Optimization22 Jul 2026
- 2026WordPolo: Evaluating Language Models Through Iterative Semantic Feedback18 Jul 2026
- 2026From Trajectories to Prefixes: Reusing Teacher Trajectories via Replayed Prefixes and Online Continuation3 Jul 2026
- 2026AdaThinking-E: One-Token Entropy Regulation for Adaptive Thinking26 Jun 2026
- 2026The Periodic Table of LLM Reasoning: A Structured Survey of Reasoning Paradigms, Methods, and Failure Modes9 Jun 2026
- 2026Thinking Past the Answer: Evaluating Harmful Overthinking in Large Reasoning Models1 Jun 2026
12 newest of 120 All 120 (JSON)
- 2025SciReplicate-Bench: Benchmarking LLMs in Agent-driven Algorithmic Reproduction from Research Paperscited by 43
- 2025Position: Agent Should Invoke External Tools ONLY When Epistemically Necessarycited by 22
- 2025The Hidden Strength of Disagreement: Unraveling the Consensus-Diversity Tradeoff in Adaptive Multi-Agent Systemscited by 11
- 2026Human oversight of agentic systems in practice: Examining the oversight work, challenges, and heuristics of developers using software agentscited by 6
- 2025Pok'eAI: A Goal-Generating, Battle-Optimizing Multi-agent System for Pokemon Redcited by 1
- 2026Absorbed in Inertia: Activation Analysis for Computer-Use Agentscited by 0
- 2026Absorbed in Inertia: Activation Analysis for Computer-Use Agents29 Sep 2026
- 2026Human oversight of agentic systems in practice: Examining the oversight work, challenges, and heuristics of developers using software agents3 Jun 2026
- 2025Pok'eAI: A Goal-Generating, Battle-Optimizing Multi-agent System for Pokemon Red30 Jun 2025
- 2025Position: Agent Should Invoke External Tools ONLY When Epistemically Necessary1 Jun 2025
- 2025SciReplicate-Bench: Benchmarking LLMs in Agent-driven Algorithmic Reproduction from Research Papers31 Mar 2025
- 2025The Hidden Strength of Disagreement: Unraveling the Consensus-Diversity Tradeoff in Adaptive Multi-Agent Systems23 Feb 2025
- 2025SWE-Exp: Experience-Driven Software Issue Resolutioncited by 65
- 2025Cost-of-Pass: An Economic Framework for Evaluating Language Modelscited by 35
- 2025Beyond Prompt Engineering: Robust Behavior Control in LLMs via Steering Target Atomscited by 24
- 2025How to Train Your Advisor: Steering Black-Box LLMs with Advisor Modelscited by 24
- 2025Do Language Models Mirror Human Confidence? Exploring Psychological Insights to Address Overconfidence in LLMscited by 19
- 2025Are Large Language Models Reliable AI Scientists? Assessing Reverse-Engineering of Black-Box Systemscited by 14
- 2025EllieSQL: Cost-Efficient Text-to-SQL with Complexity-Aware Routingcited by 13
- 2025MinorBench: A hand-built benchmark for content-based risks for childrencited by 9
- 2025Enhancing Decision-Making of Large Language Models via Actor-Criticcited by 7
- 2025Large Language Models as Virtual Survey Respondents: Evaluating Sociodemographic Response Generationcited by 7
- 2026TRIAGE: Evaluating Prospective Metacognitive Control in LLMs under Resource Constraintscited by 6
- 2025Enterprise Large Language Model Evaluation Benchmarkcited by 5
12 most cited of 23 All 23 (JSON)
- 2026From Token-Max to Outcome-Max: How You Use AI Determines Its Productivity5 Oct 2026
- 2026Anthropomorphism in the age of Large Language Models: An overview of potential risks and mitigations29 Sep 2026
- 2026Making Agents More Consistent: Skills Should Form Habits for Repeat Tasks21 Sep 2026
- 2026SQLConductor: Search-to-Policy Learning for Step-wise Text-to-SQL Orchestration22 Jun 2026
- 2026TRIAGE: Evaluating Prospective Metacognitive Control in LLMs under Resource Constraints13 May 2026
- 2026AcademiClaw: When Students Set Challenges for AI Agents4 May 2026
- 2026FitText: Evolving Agent Tool Ecologies via Memetic Retrieval4 May 2026
- 2026FROST: Filtering Reasoning Outliers with Attention for Efficient Reasoning26 Jan 2026
- 2025When Researchers Say Mental Model/Theory of Mind of AI, What Are They Really Talking About?3 Oct 2025
- 2025How to Train Your Advisor: Steering Black-Box LLMs with Advisor Models2 Oct 2025
- 2025Large Language Models as Virtual Survey Respondents: Evaluating Sociodemographic Response Generation8 Sep 2025
- 2025"Harmless to You, Hurtful to Me!": Investigating the Detection of Toxic Languages Grounded in the Perspective of Youth4 Aug 2025
12 newest of 23 All 23 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025Large Reasoning Models are not thinking straight: on the unreliability of thinking trajectories
- 2026Mitigating Overthinking in Large Reasoning Models via Difficulty-aware Reinforcement Learning
- 2025Think How to Think: Mitigating Overthinking with Autonomous Difficulty Cognition in Large Reasoning Models
- 2026Don't Overthink, Don't Underthink: Toward Adaptive Reasoning in Agentic AI
- 2026Mitigating Overthinking in Large Reasoning Language Models via Reasoning Path Deviation Monitoring
- 2025Let LRMs Break Free from Overthinking via Self-Braking Tuning
- 2025Rethinking the Illusion of Thinking
- 2026Constructing Pareto Frontiers of Optimal Reasoning Termination Methods for Overthinking in Reasoning Models