Disentangling Ambiguity from Instability in Large Language Models: A Clinical Text-to-SQL Case Study
Not on the map. Why?
Abstract (arXiv)
Deploying large language models for clinical Text-to-SQL requires distinguishing two qualitatively different causes of output diversity: (i) input ambiguity that should trigger clarification, and (ii) model instability that should trigger human review. We propose CLUES, a framework that models Text-to-SQL as a two-stage process (interpretations --> answers) and decomposes semantic uncertainty into an ambiguity score and an instability score. The instability score is computed via the Schur complement of a bipartite semantic graph matrix. Across AmbigQA/SituatedQA (gold interpretations) and a clinical Text-to-SQL benchmark (known interpretations), CLUES improves failure prediction over state-of-the-art Kernel Language Entropy. In deployment settings, it remains competitive while providing a diagnostic decomposition unavailable from a single score. The resulting uncertainty regimes map to targeted interventions - query refinement for ambiguity, model improvement for instability. The high-ambiguity/high-instability regime contains 51% of errors while covering 25% of queries, enabling efficient triage.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 21 of its 40 references that are in the map. First posted on arXiv 12 Feb 2026.
Builds on
21 of 40 references.
References · 21
- 2021Convex optimizationcited by 2,479
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,120
- 2019Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methodscited by 903
- 2020AmbigQA: Answering Ambiguous Open-domain Questionscited by 385
- 2024Kernel Language Entropy: Fine-grained Uncertainty Quantification for LLMs from Semantic Similaritiescited by 156
- 2021SituatedQA: Incorporating Extra-Linguistic Contexts into QAcited by 145
- 2022Recent Advances in Text-to-SQL: A Survey of What We Have and What We Expectcited by 47
- 2024Distinguishing the Knowable from the Unknowable with Language Modelscited by 45
- 2024AMBROSIA: A Benchmark for Parsing Ambiguous Questions into Database Queriescited by 32
- 2025Semantic Volume: Quantifying and Detecting both External and Internal Uncertainty in LLMscited by 19
- 2025Disambiguate First, Parse Later: Generating Interpretations for Ambiguity Resolution in Semantic Parsingcited by 12
9 more
- 2023A Bias-Variance-Covariance Decomposition of Kernel Scores for Generative Modelscited by 8
- 2024Retrieval augmented text-to-SQL generation for epidemiological question answering using electronic health recordscited by 8
- 2024LG AI Research & KAIST at EHRSQL 2024: Self-Training Large Language Models with Pseudo-Labeled Unanswerable Questions for a Reliable Text-to-SQL System on EHRscited by 7
- 2024ProbGate at EHRSQL 2024: Enhancing SQL Query Generation Accuracy through Probabilistic Threshold Filtering and Error Handlingcited by 6
- 2025Inv-Entropy: A Fully Probabilistic Framework for Uncertainty Quantification in Language Modelscited by 6
- 2025Generating patient cohorts from electronic health records using two-step retrieval-augmented text-to-SQL generationcited by 4
- 2025BiomedSQL: Text-to-SQL for Scientific Reasoning on Biomedical Knowledge Basescited by 4
- 2025Semantic uncertainty in advanced decoding methods for LLM generationcited by 3
- 2025A Survey on LLM-Assisted Clinical Trial Recruitmentcited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.