mlsanityData to 14 Oct 2026

Did You Ask a Good Question? A Cross-Domain Question Intention Classification Benchmark for Text-to-SQL

arXiv 2010.12634 ↗First posted 23 Oct 2020cs.CLcited by 16

Not on the map. Why?

Abstract (arXiv)

Neural models have achieved significant results on the text-to-SQL task, in which most current work assumes all the input questions are legal and generates a SQL query for any input. However, in the real scenario, users can input any text that may not be able to be answered by a SQL query. In this work, we propose TriageSQL, the first cross-domain text-to-SQL question intention classification benchmark that requires models to distinguish four types of unanswerable questions from answerable questions. The baseline RoBERTa model achieves a 60% F1 score on the test set, demonstrating the need for further improvement on this task. Our dataset is available at https://github.com/chatc/TriageSQL.

Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). First posted on arXiv 23 Oct 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 1; 2022: 3; 2023: 1; 2024: 5; 2025: 3; 2026: 3.

16 papers.

Sort:

  1. 2021KaggleDBQA: Realistic Evaluation of Text-to-SQL Parserscited by 106
  2. 2022Recent Advances in Text-to-SQL: A Survey of What We Have and What We Expectcited by 47
  3. 2023EHRSQL: A Practical Text-to-SQL Benchmark for Electronic Health Recordscited by 45
  4. 2024PRACTIQ: A Practical Conversational Text-to-SQL dataset with Ambiguous and Unanswerable Queriescited by 19
  5. 2024TrustSQL: Benchmarking Text-to-SQL Reliability with Penalty-Based Scoringcited by 17
  6. 2022Deep Learning Driven Natural Languages Text to SQL Query Conversion: A Surveycited by 11
  7. 2022NL2INTERFACE: Interactive Visualization Interface Generation from Natural Language Queriescited by 8
  8. 2024QDA-SQL: Questions Enhanced Dialogue Augmentation for Multi-Turn Text-to-SQLcited by 5
  9. 2024Towards Unbiased Evaluation of Detecting Unanswerable Questions in EHRSQLcited by 3
  10. 2024Evaluating and Enhancing LLMs for Multi-turn Text-to-SQL with Multiple Question Typescited by 3
  11. 2025Confidence Estimation for Text-to-SQL in Large Language Modelscited by 3
  12. 2026LatentRefusal: Latent-Signal Refusal for Unanswerable Text-to-SQL Queriescited by 3
4 more
  1. 2025SCARE: A Benchmark for SQL Correction and Question Answerability Classification for Reliable EHR Question Answeringcited by 0
  2. 2025Query Carefully: Detecting the Unanswerables in Text-to-SQL Taskscited by 0
  3. 2026Natural Language Interfaces for Spatial and Temporal Databases: A Comprehensive Overview of Methods, Taxonomy, and Future Directionscited by 0
  4. 2026TrustDABench: Benchmarking Reliability and Robustness of LLMs for Structured Data Analysiscited by 0