mlsanityData to 7 Oct 2026

Disentangling Ambiguity from Instability in Large Language Models: A Clinical Text-to-SQL Case Study

arXiv 2602.12015 ↗First posted 12 Feb 2026cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

Deploying large language models for clinical Text-to-SQL requires distinguishing two qualitatively different causes of output diversity: (i) input ambiguity that should trigger clarification, and (ii) model instability that should trigger human review. We propose CLUES, a framework that models Text-to-SQL as a two-stage process (interpretations --> answers) and decomposes semantic uncertainty into an ambiguity score and an instability score. The instability score is computed via the Schur complement of a bipartite semantic graph matrix. Across AmbigQA/SituatedQA (gold interpretations) and a clinical Text-to-SQL benchmark (known interpretations), CLUES improves failure prediction over state-of-the-art Kernel Language Entropy. In deployment settings, it remains competitive while providing a diagnostic decomposition unavailable from a single score. The resulting uncertainty regimes map to targeted interventions - query refinement for ambiguity, model improvement for instability. The high-ambiguity/high-instability regime contains 51% of errors while covering 25% of queries, enabling efficient triage.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 21 of its 40 references that are in the map. First posted on arXiv 12 Feb 2026.

Builds on

21 of 40 references.

References · 21

  1. 2021Convex optimizationcited by 2,479
  2. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
  3. 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,120
  4. 2019Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methodscited by 903
  5. 2020AmbigQA: Answering Ambiguous Open-domain Questionscited by 385
  6. 2024Kernel Language Entropy: Fine-grained Uncertainty Quantification for LLMs from Semantic Similaritiescited by 156
  7. 2021SituatedQA: Incorporating Extra-Linguistic Contexts into QAcited by 145
  8. 2022Recent Advances in Text-to-SQL: A Survey of What We Have and What We Expectcited by 47
  9. 2024Distinguishing the Knowable from the Unknowable with Language Modelscited by 45
  10. 2024AMBROSIA: A Benchmark for Parsing Ambiguous Questions into Database Queriescited by 32
  11. 2025Semantic Volume: Quantifying and Detecting both External and Internal Uncertainty in LLMscited by 19
  12. 2025Disambiguate First, Parse Later: Generating Interpretations for Ambiguity Resolution in Semantic Parsingcited by 12
9 more
  1. 2023A Bias-Variance-Covariance Decomposition of Kernel Scores for Generative Modelscited by 8
  2. 2024Retrieval augmented text-to-SQL generation for epidemiological question answering using electronic health recordscited by 8
  3. 2024LG AI Research & KAIST at EHRSQL 2024: Self-Training Large Language Models with Pseudo-Labeled Unanswerable Questions for a Reliable Text-to-SQL System on EHRscited by 7
  4. 2024ProbGate at EHRSQL 2024: Enhancing SQL Query Generation Accuracy through Probabilistic Threshold Filtering and Error Handlingcited by 6
  5. 2025Inv-Entropy: A Fully Probabilistic Framework for Uncertainty Quantification in Language Modelscited by 6
  6. 2025Generating patient cohorts from electronic health records using two-step retrieval-augmented text-to-SQL generationcited by 4
  7. 2025BiomedSQL: Text-to-SQL for Scientific Reasoning on Biomedical Knowledge Basescited by 4
  8. 2025Semantic uncertainty in advanced decoding methods for LLM generationcited by 3
  9. 2025A Survey on LLM-Assisted Clinical Trial Recruitmentcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.