Photon: A Robust Cross-Domain Text-to-SQL System
Not on the map. Why?
Abstract (arXiv)
Natural language interfaces to databases (NLIDB) democratize end user access to relational data. Due to fundamental differences between natural language communication and programming, it is common for end users to issue questions that are ambiguous to the system or fall outside the semantic scope of its underlying query language. We present Photon, a robust, modular, cross-domain NLIDB that can flag natural language input to which a SQL mapping cannot be immediately determined. Photon consists of a strong neural semantic parser (63.2% structure accuracy on the Spider dev benchmark), a human-in-the-loop question corrector, a SQL executor and a response generator. The question corrector is a discriminative neural sequence editor which detects confusion span(s) in the input question and suggests rephrasing until a translatable input is given by the user or a maximum number of iterations are conducted. Experiments on simulated data show that the proposed method effectively improves the robustness of text-to-SQL system against untranslatable user input. The live demo of our system is available at http://naturalsql.com.
Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 5; 2023: 9; 2024: 1; 2025: 2; 2026: 1.
26 papers.
Sort:
By area:
- 2021Towards Robustness of Text-to-SQL Models against Synonym Substitutioncited by 110
- 2021KaggleDBQA: Realistic Evaluation of Text-to-SQL Parserscited by 105
- 2023Exploring Chain-of-Thought Style Prompting for Text-to-SQLcited by 69
- 2022Recent Advances in Text-to-SQL: A Survey of What We Have and What We Expectcited by 47
- 2023RobuT: A Systematic Study of Table QA Robustness Against Human-Annotated Adversarial Perturbationscited by 41
- 2021MWPToolkit: An Open-Source Framework for Deep Learning-Based Math Word Problem Solverscited by 39
- 2022Towards Robustness of Text-to-SQL Models Against Natural and Realistic Adversarial Table Perturbationcited by 28
- 2023Natural Language Interfaces for Tabular Data Querying and Visualization: A Surveycited by 27
- 2023Text-to-SQL Error Correction with Language Models of Codecited by 21
- 2021Database Reasoning Over Textcited by 20
- 2023Learning to Simulate Natural Language Feedback for Interactive Semantic Parsingcited by 19
- 2023Towards Knowledge-Intensive Text-to-SQL Semantic Parsing with Formulaic Knowledgecited by 18
14 more
- 2023Error Detection for Text-to-SQL Semantic Parsingcited by 11
- 2025SQLens: An End-to-End Framework for Error Detection and Correction in Text-to-SQLcited by 10
- 2021NeurIPS 2020 NLC2CMD Competition: Translating Natural Language to Bash Commandscited by 7
- 2021Ember: No-Code Context Enrichment via Similarity-Based Keyless Joinscited by 7
- 2023Multimodal Neural Databasescited by 7
- 2021Code Generation from Natural Language with Less Prior and More Monolingual Datacited by 6
- 2022Know What I don't Know: Handling Ambiguous and Unanswerable Questions for Text-to-SQLcited by 6
- 2023NL2CMD: An Updated Workflow for Natural Language to Bash Commands Translationcited by 3
- 2025Abacus-SQL: A Text-to-SQL System Empowering Cross-Domain and Open-Domain Database Retrievalcited by 3
- 2022On the Security Vulnerabilities of Text-to-SQL Modelscited by 2
- 2021Turing: an Accurate and Interpretable Multi-Hypothesis Cross-Domain Natural Language Database Interfacecited by 1
- 2024Understanding the Effect of Algorithm Transparency of Model Explanations in Text-to-SQL Semantic Parsingcited by 1
- 2022Improving Text-to-SQL Semantic Parsing with Fine-grained Query Understandingcited by 0
- 2026CAPER: Clause-Aligned Process Supervision for Text-to-SQLcited by 0
- 2026CAPER: Clause-Aligned Process Supervision for Text-to-SQL2 Jun 2026
- 2025SQLens: An End-to-End Framework for Error Detection and Correction in Text-to-SQL4 Jun 2025
- 2025Abacus-SQL: A Text-to-SQL System Empowering Cross-Domain and Open-Domain Database Retrieval14 Apr 2025
- 2024Understanding the Effect of Algorithm Transparency of Model Explanations in Text-to-SQL Semantic Parsing5 Oct 2024
- 2023Natural Language Interfaces for Tabular Data Querying and Visualization: A Survey27 Oct 2023
- 2023RobuT: A Systematic Study of Table QA Robustness Against Human-Annotated Adversarial Perturbations25 Jun 2023
- 2023Exploring Chain-of-Thought Style Prompting for Text-to-SQL23 May 2023
- 2023Error Detection for Text-to-SQL Semantic Parsing23 May 2023
- 2023Text-to-SQL Error Correction with Language Models of Code22 May 2023
- 2023Learning to Simulate Natural Language Feedback for Interactive Semantic Parsing14 May 2023
- 2023Multimodal Neural Databases2 May 2023
- 2023NL2CMD: An Updated Workflow for Natural Language to Bash Commands Translation15 Feb 2023
14 more
- 2023Towards Knowledge-Intensive Text-to-SQL Semantic Parsing with Formulaic Knowledge3 Jan 2023
- 2022Towards Robustness of Text-to-SQL Models Against Natural and Realistic Adversarial Table Perturbation20 Dec 2022
- 2022Know What I don't Know: Handling Ambiguous and Unanswerable Questions for Text-to-SQL17 Dec 2022
- 2022On the Security Vulnerabilities of Text-to-SQL Models28 Nov 2022
- 2022Improving Text-to-SQL Semantic Parsing with Fine-grained Query Understanding28 Sep 2022
- 2022Recent Advances in Text-to-SQL: A Survey of What We Have and What We Expect22 Aug 2022
- 2021MWPToolkit: An Open-Source Framework for Deep Learning-Based Math Word Problem Solvers2 Sep 2021
- 2021KaggleDBQA: Realistic Evaluation of Text-to-SQL Parsers22 Jun 2021
- 2021Turing: an Accurate and Interpretable Multi-Hypothesis Cross-Domain Natural Language Database Interface8 Jun 2021
- 2021Ember: No-Code Context Enrichment via Similarity-Based Keyless Joins2 Jun 2021
- 2021Database Reasoning Over Text2 Jun 2021
- 2021Towards Robustness of Text-to-SQL Models against Synonym Substitution2 Jun 2021
- 2021NeurIPS 2020 NLC2CMD Competition: Translating Natural Language to Bash Commands3 Mar 2021
- 2021Code Generation from Natural Language with Less Prior and More Monolingual Data1 Jan 2021
- 2023Exploring Chain-of-Thought Style Prompting for Text-to-SQLcited by 69
- 2023Exploring Chain-of-Thought Style Prompting for Text-to-SQL23 May 2023
- 2021Towards Robustness of Text-to-SQL Models against Synonym Substitutioncited by 110
- 2021KaggleDBQA: Realistic Evaluation of Text-to-SQL Parserscited by 105
- 2022Recent Advances in Text-to-SQL: A Survey of What We Have and What We Expectcited by 47
- 2023RobuT: A Systematic Study of Table QA Robustness Against Human-Annotated Adversarial Perturbationscited by 41
- 2021MWPToolkit: An Open-Source Framework for Deep Learning-Based Math Word Problem Solverscited by 39
- 2022Towards Robustness of Text-to-SQL Models Against Natural and Realistic Adversarial Table Perturbationcited by 28
- 2023Natural Language Interfaces for Tabular Data Querying and Visualization: A Surveycited by 27
- 2023Text-to-SQL Error Correction with Language Models of Codecited by 21
- 2021Database Reasoning Over Textcited by 20
- 2023Learning to Simulate Natural Language Feedback for Interactive Semantic Parsingcited by 19
- 2023Towards Knowledge-Intensive Text-to-SQL Semantic Parsing with Formulaic Knowledgecited by 18
- 2023Error Detection for Text-to-SQL Semantic Parsingcited by 11
12 most cited of 24 All 24 (JSON)
- 2025SQLens: An End-to-End Framework for Error Detection and Correction in Text-to-SQL4 Jun 2025
- 2025Abacus-SQL: A Text-to-SQL System Empowering Cross-Domain and Open-Domain Database Retrieval14 Apr 2025
- 2024Understanding the Effect of Algorithm Transparency of Model Explanations in Text-to-SQL Semantic Parsing5 Oct 2024
- 2023Natural Language Interfaces for Tabular Data Querying and Visualization: A Survey27 Oct 2023
- 2023RobuT: A Systematic Study of Table QA Robustness Against Human-Annotated Adversarial Perturbations25 Jun 2023
- 2023Error Detection for Text-to-SQL Semantic Parsing23 May 2023
- 2023Text-to-SQL Error Correction with Language Models of Code22 May 2023
- 2023Learning to Simulate Natural Language Feedback for Interactive Semantic Parsing14 May 2023
- 2023Multimodal Neural Databases2 May 2023
- 2023NL2CMD: An Updated Workflow for Natural Language to Bash Commands Translation15 Feb 2023
- 2023Towards Knowledge-Intensive Text-to-SQL Semantic Parsing with Formulaic Knowledge3 Jan 2023
- 2022Towards Robustness of Text-to-SQL Models Against Natural and Realistic Adversarial Table Perturbation20 Dec 2022
12 newest of 24 All 24 (JSON)