Beyond Correctness: Resolving Underspecification in Agentic Text-to-SQL
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
Agentic Text-to-SQL systems can interact with users to clarify underspecified queries before generating SQL. However, a correct execution result does not necessarily imply that the agent has adequately resolved the underlying underspecification: the agent may silently make unverified assumptions that happen to match the intended answer. We show that this behavior is driven in part by premature clarification termination. Although forcing an agent to ask more questions improves execution accuracy, ambiguities are concentrated in earlier interactions, making brute-force questioning inefficient. More importantly, even when explicitly prompted to plan its clarification process, the agent frequently abandons questions that it has already identified as relevant. To address this failure mode, we introduce PlanPool, which externalizes the clarification plan as a mutable question pool. Every planned question must be explicitly asked or dropped before submission, while newly discovered ambiguities can be added during interaction. Across three benchmarks derived from BIRD-Interact and Spider, PlanPool consistently improves ambiguity coverage and reduces silent failures over unconstrained and prompt-based alternatives, while maintaining competitive execution accuracy. Our results highlight an important distinction in agentic reasoning: identifying missing information is not sufficient, and the agent must also reliably maintain and resolve it before committing to an answer.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. First posted on arXiv 2 Oct 2026.
Builds on
No reference list yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Never the Number: Structural Abstention for AI Systems Whose Answers Are Consumed as Fact
- 2025Agent-Based Detection and Resolution of Incompleteness and Ambiguity in Interactions with Large Language Models
- 2026QUIETT: Query-Independent Table Transformation for Robust Reasoning
- 2026Ask or Assume? Uncertainty-Aware Clarification-Seeking in Coding Agents
- 2025MTSQL-R1: Towards Long-Horizon Multi-Turn Text-to-SQL via Agentic Training
- 2026A Tri-Agent Framework for Evaluating and Aligning Question Clarification Capabilities of Large Language Models
- 2026AgentSM: Semantic Memory for Agentic Text-to-SQL
- 2023On Evaluating the Integration of Reasoning and Action in LLM Agents with Database Question Answering