LatentRefusal: Latent-Signal Refusal for Unanswerable Text-to-SQL Queries
Not on the map. Why?
Abstract (arXiv)
In LLM-based text-to-SQL systems, unanswerable and underspecified user queries may generate not only incorrect text but also executable programs that yield misleading results or violate safety constraints, posing a major barrier to safe deployment. Existing refusal strategies for such queries either rely on output-level instruction following, which is brittle due to model hallucinations, or estimate output uncertainty, which adds complexity and overhead. To address this challenge, we formalize safe refusal in text-to-SQL systems as an answerability-gating problem and propose LatentRefusal, a latent-signal refusal mechanism that predicts query answerability from intermediate hidden activations of a large language model. We introduce the Tri-Residual Gated Encoder, a lightweight probing architecture, to suppress schema noise and amplify sparse, localized cues of question-schema mismatch that indicate unanswerability. Extensive empirical evaluations across diverse ambiguous and unanswerable settings, together with ablation studies and interpretability analyses, demonstrate the effectiveness of the proposed approach and show that LatentRefusal provides an attachable and efficient safety layer for text-to-SQL systems. Across four benchmarks, LatentRefusal improves average F1 to 88.5 percent on both backbones while adding approximately 2 milliseconds of probe overhead.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 23 of its 38 references that are in the map. First posted on arXiv 15 Jan 2026.
Builds on
23 of 38 references.
References · 23
- 2017Attention Is All You Needcited by 60,361
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
- 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,554
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
- 2023Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMscited by 974
- 2017Selective Classification for Deep Neural Networkscited by 852
- 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 767
- 2022Teaching Models to Express Their Uncertainty in Wordscited by 751
- 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 712
- 2024A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applicationscited by 431
- 2023Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluationcited by 385
11 more
- 2019SelectiveNet: A Deep Neural Network with an Integrated Reject Optioncited by 350
- 2024INSIDE: LLMs' Internal States Retain the Power of Hallucination Detectioncited by 323
- 2025Layer by Layer: Uncovering Hidden Representations in Language Modelscited by 311
- 2024Semantic Entropy Probes: Robust and Cheap Hallucination Detection in LLMscited by 259
- 2022Out-of-Distribution Detection and Selective Generation for Conditional Language Modelscited by 197
- 2024HaloScope: Harnessing Unlabeled LLM Generations for Hallucination Detectioncited by 99
- 2025Steer LLM Latents for Hallucination Detectioncited by 50
- 2024AMBROSIA: A Benchmark for Parsing Ambiguous Questions into Database Queriescited by 35
- 2024PRACTIQ: A Practical Conversational Text-to-SQL dataset with Ambiguous and Unanswerable Queriescited by 19
- 2020Did You Ask a Good Question? A Cross-Domain Question Intention Classification Benchmark for Text-to-SQLcited by 16
- 2022Know What I don't Know: Handling Ambiguous and Unanswerable Questions for Text-to-SQLcited by 6
Built on by
Citing papers per year: 2026: 3.
3 papers.