Clarify the User or Verify the World? Uncertainty Routing for Proactive Agents
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Tool-using LLM agents must decide not only whether additional information is needed, but also which source can resolve the uncertainty. Existing proactive approaches often specialize in either user clarification or environment verification, without explicitly determining the appropriate information source for each decision. We formulate this problem as uncertainty routing among ACT, CLARIFY, and VERIFY, and propose PROUR, a proactive uncertainty routing framework. PROUR decomposes action uncertainty into disagreement across plausible user-goal interpretations, which signals user-side ambiguity, and the entropy remaining within each interpretation, which signals missing world-side evidence. To acquire information from the routed source, a query generator is trained with a mode-conditioned information-gain reward, targeting user-goal identification under CLARIFY and next-action identification under VERIFY. On τ-bench, PROUR achieves 28.17% average success rate across retail and airline, outperforming the strongest prior method by 4.57% while using 2.17 fewer interaction steps. The learned policy further generalizes to stronger task agents and transactional domains of τ3-bench without retraining, demonstrating the benefit of source-aligned uncertainty resolution for proactive agents.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 25 of its 28 references that are in the map. First posted on arXiv 26 Sep 2026.
Builds on
25 of 28 references.
Closest ancestors · 7
Same direction, newest first
- 2026Uncertainty-Aware Clarification in LLM Agents with Information Gain2 Jun
- 2026τ-Voice: Benchmarking Full-Duplex Voice Agents on Real-World Domains14 Mar
- 2025Structured Uncertainty guided Clarification for LLM Agents11 Nov
- 2025VerifiAgent: a Unified Verification Agent in Language Model Reasoning1 Apr
- 2025Active Task Disambiguation with LLMs6 Feb
- 2024Ask-before-Plan: Proactive Language Agents for Real-World Planning18 Jun
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains17 Jun
Other references · 18
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2022Language Models (Mostly) Know What They Knowcited by 1,783
- 2023Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generationcited by 795
- 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 751
- 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 558
- 2020How Can We Know When Language Models Know? On the Calibration of Language Models for Question Answeringcited by 439
- 2025CollabLLM: From Passive Responders to Active Collaboratorscited by 117
- 2023Prompting and Evaluating Large Language Models for Proactive Dialogues: Clarification, Target-guided, and Non-collaborationcited by 115
- 2023Decomposing Uncertainty for Large Language Models through Input Clarification Ensemblingcited by 113
6 more
- 2018Learning to Ask Good Questions: Ranking Clarification Questions using Neural Expected Value of Perfect Informationcited by 110
- 2023Clarify When Necessary: Resolving Ambiguity Through Interaction with LMscited by 93
- 2024Uncertainty Quantification for In-Context Learning of Large Language Modelscited by 45
- 2025Information Gain-based Policy Optimization: A Simple and Effective Approach for Multi-Turn Search Agentscited by 43
- 2026τ-Knowledge: Evaluating Conversational Agents over Unstructured Knowledgecited by 35
- 2025SABER: Small Actions, Big Errors -- Safeguarding Mutating Steps in LLM Agentscited by 21
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Uncertainty Decomposition for Clarification Seeking in LLM Agents
- 2026TRACER: Trajectory Risk Aggregation for Critical Episodes in Agentic Reasoning
- 2026Exploring Agentic Tool-Calling Decisions via Uncertainty-Aligned Reinforcement Learning
- 2026Knowing When to Ask: Self-Gated Clarification for Hierarchical Language Agents
- 2026Proper Scoring Rules for Agentic Uncertainty Quantification
- 2026GRUET: Quantifying Uncertainty of Agentic Reasoning-and-Acting Processes
- 2026From Uncertainty to Action: Learning to Steer LLM Agents
- 2026Ask or Assume? Uncertainty-Aware Clarification-Seeking in Coding Agents