mlsanityData to 7 Oct 2026

Think Short, Defer Smart, Act, and Repeat: Calibrated Reasoning and Uncertainty-Aware Deferral for Edge LLM Agents

arXiv 2607.26865 ↗First posted 29 Jul 2026stat.ML cs.AI cs.ITcited by 1

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

LLM agents following the ReAct paradigm are promising enablers of complex multi-step tasks, including multi-hop question answering, code generation, and control of physical AI systems. Yet, when deployed at the edge, they must tightly manage their reasoning budget while remaining reliable and deferring to a cloud-side model only when local uncertainty is too high to act safely. We propose Think Short, Defer Smart (TSDS), a framework that synergistically integrates a lightweight convergence probe, which halts on-device reasoning once the intended action has stabilized, with a perplexity-based deferral rule that escalates uncertain actions to a cloud-side model. Both mechanisms are jointly calibrated on end-to-end episode trajectories via a multi-objective Learn-Then-Test (LTT) procedure, providing simultaneous finite-sample guarantees on expected episode reward and cloud-call rate. We evaluate TSDS on four ReAct benchmarks spanning arithmetic reasoning (GSM8K), multi-hop question answering (HotpotQA), code generation (MBPP), and multi-step embodied planning (household robot), and compare against thought-calibration-only and calibrated-deferral-only standalone baselines. TSDS reduces per-episode thinking compute by 43%-65% over deferral-only baselines across HotpotQA, MBPP, and the household robot task, while maintaining certified reward and cloud-call rate guarantees.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 25 of its 36 references that are in the map. First posted on arXiv 29 Jul 2026.

Builds on

25 of 36 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Models6 Oct

Other references · 24

  1. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  3. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  4. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  5. 2021Program Synthesis with Large Language Modelscited by 3,509
  6. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
  7. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  8. 2025s1: Simple test-time scalingcited by 1,311
  9. 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,143
  10. 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 791
  11. 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 633
  12. 2023Minigrid & Miniworld: Modular & Customizable Reinforcement Learning Environments for Goal-Oriented Taskscited by 320
12 more
  1. 2021Learn then Test: Calibrating Predictive Algorithms to Achieve Risk Controlcited by 256
  2. 2025Dynamic Early Exit in Reasoning Modelscited by 217
  3. 2020Unsupervised Quality Estimation for Neural Machine Translationcited by 210
  4. 2023AdaPlanner: Adaptive Planning from Feedback with Language Modelscited by 193
  5. 2023Large Language Model Cascades with Mixture of Thoughts Representations for Cost-efficient Reasoningcited by 140
  6. 2025Are Sparse Autoencoders Useful? A Case Study in Sparse Probingcited by 109
  7. 2024On-Device Language Models: A Comprehensive Reviewcited by 101
  8. 2026Building Production-Ready Probes For Geminicited by 38
  9. 2025Thought calibration: Efficient and confident test-time scalingcited by 20
  10. 2023Knowing When to Stop: Delay-Adaptive Spiking Neural Network Classifiers with Reliability Guaranteescited by 8
  11. 2026ReDAct: Uncertainty-Aware Deferral for LLM Agentscited by 5
  12. 2025Reliable LLM-Based Edge-Cloud-Expert Cascades for Telecom Knowledge Systemscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Reasoning on a Budget: A Survey of Adaptive and Controllable Test-Time Compute in LLMs
  2. 2026ODAR: Principled Adaptive Routing for LLM Reasoning via Active Inference
  3. 2025FastTTS: Accelerating Test-Time Scaling for Edge LLM Reasoning
  4. 2026Not All Turns Are Equally Hard: Adaptive Thinking Budgets For Efficient Multi-Turn Reasoning in Agents
  5. 2025A Survey of Frontiers in LLM Reasoning: Inference Scaling, Learning to Reason, and Agentic Systems
  6. 2026AgentCollab: A Self-Evaluation-Driven Collaboration Paradigm for Efficient LLM Agents
  7. 2025The Cost of Dynamic Reasoning: Demystifying AI Agents and Test-Time Scaling from an AI Infrastructure Perspective
  8. 2026Efficient Reasoning on the Edge