mlsanityData to 14 Oct 2026

When Should Agents Think? Adaptive Reasoning via Cross-Turn Estimation

arXiv 2610.12061 ↗First posted 8 Oct 2026cs.AI cs.CLcited by 0

On the map: LLM reasoning → Reasoning for agents, planning and code also fits: Reinforcement learning for reasoning

also in 1 more
Abstract (arXiv)

Large language model (LLM)-based agents have demonstrated strong capabilities on complex tasks. They typically perform reasoning before each action throughout an interaction trajectory. However, reasoning may not be necessary at every turn, as reasoning produced earlier can continue to support subsequent actions. A key challenge is therefore to determine when existing reasoning remains sufficient and when a new reasoning step is needed, without relying on costly generation-based verification. We find that decreases in the likelihood of subsequent reference actions after removing additional reasoning closely track whether those actions remain recoverable given earlier reasoning, providing an effective and lightweight signal for estimating cross-turn action support. Based on this observation, we propose Reasoning Adaptation through Cross-Turn Estimation (RACE), a training approach for adaptive agent reasoning. RACE introduces a Likelihood-Guided Progressive Reasoning Cover Detection (LoGiC) procedure that progressively identifies reasoning turns whose removal has limited impact on the current and subsequent reference actions. The resulting removal signals are incorporated into both supervised fine-tuning and agentic reinforcement learning, enabling the policy to learn when to reason and when to act directly. Extensive experiments on four representative agent benchmarks show that RACE substantially reduces reasoning cost while maintaining or improving task performance.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 28 of its 61 references that are in the map. First posted on arXiv 8 Oct 2026.

Builds on

28 of 61 references.

Closest ancestors · 4

Same direction, newest first

  1. 2026Ares: Adaptive Reasoning Effort Selection for Efficient LLM Agents9 Mar
  2. 2026Think Fast and Slow: Step-Level Cognitive Depth Adaptation for LLM Agents13 Feb
  3. 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agents18 Jan
  4. 2025Toward Effective Tool-Integrated Reasoning via Self-Evolved Preference Learning27 Sep

Other references · 24

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  4. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
  5. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
  6. 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 587
  7. 2025RAGEN: Understanding Self-Evolution in LLM Agents via Multi-Turn Reinforcement Learningcited by 386
  8. 2023ReWOO: Decoupling Reasoning from Observations for Efficient Augmented Language Modelscited by 184
  9. 2025Agentic Reinforced Policy Optimizationcited by 172
  10. 2026Kimi K3: Open Frontier Intelligencecited by 138
  11. 2025AdaCoT: Pareto-Optimal Adaptive Chain-of-Thought Triggering via Reinforcement Learningcited by 87
  12. 2025AgentGym-RL: Training LLM Agents for Long-Horizon Decision Making through Multi-Turn Reinforcement Learningcited by 72
12 more
  1. 2026Hierarchy-of-Groups Policy Optimization for Long-Horizon Agentic Taskscited by 49
  2. 2025Agentic Entropy-Balanced Policy Optimizationcited by 40
  3. 2026OpenResearcher: A Fully Open Pipeline for Long-Horizon Deep Research Trajectory Synthesiscited by 37
  4. 2025Prolonged Reasoning Is Not All You Need: Certainty-Based Adaptive Routing for Efficient LLM/MLLM Reasoningcited by 35
  5. 2026Beyond Trajectory-Level Attribution: Graph-Based Credit Assignment for Agentic Reinforcement Learningcited by 31
  6. 2026Toward Generalist Autonomous Research via Hypothesis-Tree Refinementcited by 22
  7. 2026Branching Policy Optimization: Sandbox-Native Language Agent Reinforcement Learningcited by 12
  8. 2026DART: Draft-Agreement Routing for Training-Free Adaptive Thinking Budgets in Hybrid Reasoning Modelscited by 8
  9. 2026Agent-Omit: Adaptive Context Omission for Efficient LLM Agentscited by 5
  10. 2026Search More, Think Less: Rethinking Long-Horizon Agentic Search for Efficiency and Generalizationcited by 5
  11. 2025Can Confidence Estimates Decide When Chain-of-Thought Is Necessary for LLMs?cited by 2
  12. 2026ChatShopBuddy: Towards Reliable Conversational Shopping Agents via Reinforcement Learningcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Not All Turns Are Equally Hard: Adaptive Thinking Budgets For Efficient Multi-Turn Reasoning in Agents
  2. 2026Adaptive Latent Agentic Reasoning
  3. 2025AlphaApollo: A System for Deep Agentic Reasoning
  4. 2026Geometry of Divergence: Tracking Hidden-State Trajectories for Adaptive Multi-Turn Reasoning
  5. 2025From Efficiency to Adaptivity: A Deeper Look at Adaptive Reasoning in Large Language Models
  6. 2026ECHO: Learning Epistemically Adaptive Language Agents with Turn-Level Credit ↗
  7. 2026Don't Overthink, Don't Underthink: Toward Adaptive Reasoning in Agentic AI
  8. 2026Second Thought: Reasoning in Parallel as LLM Agents Act and Observe