Natural SQL: Making SQL Easier to Infer from Natural Language Specifications
Not on the map. Why?
Abstract (arXiv)
Addressing the mismatch between natural language descriptions and the corresponding SQL queries is a key challenge for text-to-SQL translation. To bridge this gap, we propose an SQL intermediate representation (IR) called Natural SQL (NatSQL). Specifically, NatSQL preserves the core functionalities of SQL, while it simplifies the queries as follows: (1) dispensing with operators and keywords such as GROUP BY, HAVING, FROM, JOIN ON, which are usually hard to find counterparts for in the text descriptions; (2) removing the need for nested subqueries and set operators; and (3) making schema linking easier by reducing the required number of schema items. On Spider, a challenging text-to-SQL benchmark that contains complex and nested SQL queries, we demonstrate that NatSQL outperforms other IRs, and significantly improves the performance of several previous SOTA models. Furthermore, for existing models that do not support executable SQL generation, NatSQL easily enables them to generate executable SQL queries, and achieves the new state-of-the-art execution accuracy.
Key facts. Cited by 68 papers in the map (data through 14 Oct 2026). Builds on 18 of its 32 references that are in the map. First posted on arXiv 11 Sep 2021.
Builds on
18 of 32 references.
References · 18
- 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,139
- 2017Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learningcited by 687
- 2019RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parserscited by 424
- 2019Towards Complex Text-to-SQL in Cross-Domain Database with Intermediate Representationcited by 210
- 2017SQLNet: Generating Structured Queries From Natural Language Without Reinforcement Learningcited by 135
- 2018Improving Text-to-SQL Evaluation Methodologycited by 135
- 2020Bridging Textual and Tabular Data for Cross-Domain Text-to-SQL Semantic Parsingcited by 133
- 2018Coarse-to-Fine Decoding for Neural Semantic Parsingcited by 110
- 2017Learning a Neural Semantic Parser from User Feedbackcited by 99
- 2020SmBoP: Semi-autoregressive Bottom-up Semantic Parsingcited by 97
- 2019Editing-Based SQL Query Generation for Cross-Domain Context-Dependent Questionscited by 80
- 2020Grounded Adaptation for Zero-shot Executable Semantic Parsingcited by 76
6 more
- 2018SyntaxSQLNet: Syntax Tree Networks for Complex and Cross-DomainText-to-SQL Taskcited by 74
- 2019Representing Schema Structure with Graph Neural Networks for Text-to-SQL Parsingcited by 74
- 2020Learning Contextual Representations for Semantic Parsing with Generation-Augmented Pre-Trainingcited by 65
- 2021Unlocking Compositional Generalization in Pre-trained Models Using Intermediate Representationscited by 55
- 2018Robust Text-to-SQL Generation with Execution-Guided Decodingcited by 52
- 2019Global Reasoning over Database Structures for Text-to-SQL Parsingcited by 43
Built on by
Citing papers per year: 2022: 9; 2023: 18; 2024: 17; 2025: 13; 2026: 11.
68 papers.
Sort:
By area:
- 2023DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-Correctioncited by 477
- 2023RESDSQL: Decoupling Schema Linking and Skeleton Parsing for Text-to-SQLcited by 195
- 2023Graphix-T5: Mixing Pre-Trained Transformers with Graph-Aware Layers for Text-to-SQL Parsingcited by 93
- 2022RASAT: Integrating Relational Structures into Pretrained Seq2Seq Model for Text-to-SQLcited by 85
- 2024A Survey on Employing Large Language Models for Text-to-SQL Taskscited by 67
- 2023How to Prompt LLMs for Text-to-SQL: A Study in Zero-shot, Single-domain, and Cross-domain Settingscited by 58
- 2024A Survey of Text-to-SQL in the Era of LLMs: Where are we, and where are we going?cited by 56
- 2024Before Generation, Align it! A Novel and Effective Strategy for Mitigating Hallucinations in Text-to-SQL Generationcited by 50
- 2022Recent Advances in Text-to-SQL: A Survey of What We Have and What We Expectcited by 47
- 2023ScienceBenchmark: A Complex Real-World Benchmark for Evaluating Natural Language to SQL Systemscited by 45
- 2024FinSQL: Model-Agnostic LLMs-based Text-to-SQL Framework for Financial Analysiscited by 36
- 2023Benchmarking and Improving Text-to-SQL Generation under Ambiguitycited by 34
38 more
- 2024PURPLE: Making a Large Language Model a Better SQL Writercited by 34
- 2022Importance of Synthesizing High-quality Data for Text-to-SQL Parsingcited by 28
- 2023Natural Language Interfaces for Tabular Data Querying and Visualization: A Surveycited by 27
- 2022HIE-SQL: History Information Enhanced Network for Context-Dependent Text-to-SQL Semantic Parsingcited by 26
- 2023Improving Generalization in Language Model-Based Text-to-SQL Semantic Parsing: Two Simple Semantic Boundary-Based Techniquescited by 24
- 2023Text-to-SQL Error Correction with Language Models of Codecited by 21
- 2025Reliable Text-to-SQL with Adaptive Abstentioncited by 20
- 2024Metasql: A Generate-then-Rank Framework for Natural Language to SQL Translationcited by 17
- 2025STaR-SQL: Self-Taught Reasoner for Text-to-SQLcited by 17
- 2022Measuring and Improving Compositional Generalization in Text-to-SQL via Component Alignmentcited by 16
- 2023Semantic Decomposition of Question and SQL for Text-to-SQL Parsingcited by 14
- 2025Understanding, Detecting, and Repairing Real-World In-Context-Learning-Based Text-to-SQL Errorscited by 14
- 2023Error Detection for Text-to-SQL Semantic Parsingcited by 12
- 2024Evaluating the Data Model Robustness of Text-to-SQL Systems Based on Real User Queriescited by 12
- 2024SQL-to-Schema Enhances Schema Linking in Text-to-SQLcited by 12
- 2025ExeSQL: Self-Taught Text-to-SQL Models with Execution-Driven Bootstrapping for SQL Dialectscited by 12
- 2023Knowledge Graphs in Practice: Characterizing their Users, Challenges, and Visualization Opportunitiescited by 9
- 2022NL2INTERFACE: Interactive Visualization Interface Generation from Natural Language Queriescited by 8
- 2022T5QL: Taming language models for SQL generationcited by 8
- 2024Grounding Natural Language to SQL Translation with Data-Based Self-Explanationscited by 8
- 2022Towards Generalizable and Robust Text-to-SQL Parsingcited by 7
- 2023Exploring Equation as a Better Intermediate Meaning Representation for Numerical Reasoningcited by 7
- 2025Are Your LLM-based Text-to-SQL Models Secure? Exploring SQL Injection via Backdoor Attackscited by 6
- 2024Improving Generalization in Semantic Parsing by Increasing Natural Language Variationcited by 4
- 2026FlexSQL: Flexible Exploration and Execution Make Better Text-to-SQL Agentscited by 4
- 2022Cross-TOP: Zero-Shot Cross-Schema Task-Oriented Parsingcited by 3
- 2024Towards Automated Data Sciences with Natural Language and SageCopilot: Practices and Lessons Learnedcited by 3
- 2025MultiTEND: A Multilingual Benchmark for Natural Language to NoSQL Query Translationcited by 3
- 2023T5-SR: A Unified Seq-to-Seq Decoding Strategy for Semantic Parsingcited by 2
- 2024On Linearizing Structured Data in Encoder-Decoder Language Models: Insights from Text-to-SQLcited by 2
- 2024Infusing Prompts with Syntax and Semanticscited by 2
- 2025End-to-End Text-to-SQL with Dataset Selection: Leveraging LLMs for Adaptive Query Generationcited by 2
- 2023On the Structural Generalization in Text-to-SQLcited by 1
- 2023Decoupling SQL Query Hardness Parsing for Text-to-SQLcited by 1
- 2023Dynamic Retrieval-Augmented Generationcited by 1
- 2023Semantic Parsing for Complex Data Retrieval: Targeting Query Plans vs. SQL for No-Code Access to Relational Databasescited by 1
- 2024Schema-Aware Multi-Task Learning for Complex Text-to-SQLcited by 1
- 2024Understanding the Effect of Algorithm Transparency of Model Explanations in Text-to-SQL Semantic Parsingcited by 1
50 most cited of 68 All 68 (JSON)
- 2026VeriPIE: Checkable Query Plans and Evidence-Guided Selection for Text-to-SQL12 Oct 2026
- 2026The Stochastic Shift: A New Evaluation Paradigm for Text-to-SQL with AI Operators17 Sep 2026
- 2026SQLMorph: Query Mutation and Fine-Grained Metrics for Text-to-SQL Evaluation8 Sep 2026
- 2026ProcArena: A Multi-Scenario Benchmark for LLMs on Direct and Interactive PL/SQL Development from Natural Language6 Sep 2026
- 2026The Nuts and Bolts of Natural Language to SQL Translation: A Systematic Analysis of Model Pipeline Optimisation Approaches and their Interactions12 Jul 2026
- 2026CHS-SQL: A Text-to-SQL approach based on Confidence-Guided Heuristic Search Schema Linking process17 Jun 2026
- 2026EvoSQL: Memory-Augmented Critic-Generator Co-Evolution for Text-to-SQL4 Jun 2026
- 2026SIRIUS-SQL: Anchoring Multi-Candidate Text-to-SQL in Execution Feedback31 May 2026
- 2026FlexSQL: Flexible Exploration and Execution Make Better Text-to-SQL Agents4 May 2026
- 2026NL2SQLBench: A Modular Benchmarking Framework for LLM-Enabled NL2SQL Solutions13 Apr 2026
- 2026Schema on the Inside: A Two-Phase Fine-Tuning Method for High-Efficiency Text-to-SQL at Scale25 Mar 2026
- 2025FINCH: Financial Intelligence using Natural language for Contextualized SQL Handling2 Oct 2025
38 more
- 2025X-SQL: Expert Schema Linking and Understanding of Text-to-SQL with Multi-LLMs7 Sep 2025
- 2025Omne-R1: Learning to Reason with Memory for Multi-hop Question Answering24 Aug 2025
- 2025CRED-SQL: Enhancing Real-world Large Scale Database Text-to-SQL Parsing through Cluster Retrieval and Execution Description18 Aug 2025
- 2025End-to-End Text-to-SQL with Dataset Selection: Leveraging LLMs for Adaptive Query Generation8 Aug 2025
- 2025StreamLink: Large-Language-Model Driven Distributed Data Engineering System27 May 2025
- 2025ExeSQL: Self-Taught Text-to-SQL Models with Execution-Driven Bootstrapping for SQL Dialects22 May 2025
- 2025Text-to-TrajVis: Enabling Trajectory Data Visualizations from Natural Language Questions23 Apr 2025
- 2025Are Your LLM-based Text-to-SQL Models Secure? Exploring SQL Injection via Backdoor Attacks7 Mar 2025
- 2025STaR-SQL: Self-Taught Reasoner for Text-to-SQL19 Feb 2025
- 2025MultiTEND: A Multilingual Benchmark for Natural Language to NoSQL Query Translation16 Feb 2025
- 2025Reliable Text-to-SQL with Adaptive Abstention18 Jan 2025
- 2025Understanding, Detecting, and Repairing Real-World In-Context-Learning-Based Text-to-SQL Errors16 Jan 2025
- 2024Infusing Prompts with Syntax and Semantics8 Dec 2024
- 2024EzSQL: An SQL intermediate representation for improving SQL-to-text Generation28 Nov 2024
- 2024Grounding Natural Language to SQL Translation with Data-Based Self-Explanations5 Nov 2024
- 2024Understanding the Effect of Algorithm Transparency of Model Explanations in Text-to-SQL Semantic Parsing5 Oct 2024
- 2024A Survey of Text-to-SQL in the Era of LLMs: Where are we, and where are we going?9 Aug 2024
- 2024Towards Automated Data Sciences with Natural Language and SageCopilot: Practices and Lessons Learned21 Jul 2024
- 2024A Survey on Employing Large Language Models for Text-to-SQL Tasks21 Jul 2024
- 2024RH-SQL: Refined Schema and Hardness Prompt for Text-to-SQL13 Jun 2024
- 2024Before Generation, Align it! A Novel and Effective Strategy for Mitigating Hallucinations in Text-to-SQL Generation24 May 2024
- 2024SQL-to-Schema Enhances Schema Linking in Text-to-SQL15 May 2024
- 2024On Linearizing Structured Data in Encoder-Decoder Language Models: Insights from Text-to-SQL3 Apr 2024
- 2024PURPLE: Making a Large Language Model a Better SQL Writer29 Mar 2024
- 2024Schema-Aware Multi-Task Learning for Complex Text-to-SQL9 Mar 2024
- 2024Metasql: A Generate-then-Rank Framework for Natural Language to SQL Translation27 Feb 2024
- 2024Improving Generalization in Semantic Parsing by Increasing Natural Language Variation13 Feb 2024
- 2024Evaluating the Data Model Robustness of Text-to-SQL Systems Based on Real User Queries13 Feb 2024
- 2024FinSQL: Model-Agnostic LLMs-based Text-to-SQL Framework for Financial Analysis19 Jan 2024
- 2023Semantic Parsing for Complex Data Retrieval: Targeting Query Plans vs. SQL for No-Code Access to Relational Databases22 Dec 2023
- 2023Dynamic Retrieval-Augmented Generation14 Dec 2023
- 2023Decoupling SQL Query Hardness Parsing for Text-to-SQL11 Dec 2023
- 2023Natural Language Interfaces for Tabular Data Querying and Visualization: A Survey27 Oct 2023
- 2023Benchmarking and Improving Text-to-SQL Generation under Ambiguity20 Oct 2023
- 2023Semantic Decomposition of Question and SQL for Text-to-SQL Parsing20 Oct 2023
- 2023Exploring Equation as a Better Intermediate Meaning Representation for Numerical Reasoning21 Aug 2023
- 2023T5-SR: A Unified Seq-to-Seq Decoding Strategy for Semantic Parsing14 Jun 2023
- 2023ScienceBenchmark: A Complex Real-World Benchmark for Evaluating Natural Language to SQL Systems7 Jun 2023
50 newest of 68 All 68 (JSON)
- 2023Dynamic Retrieval-Augmented Generationcited by 1
- 2023Dynamic Retrieval-Augmented Generation14 Dec 2023
- 2023DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-Correctioncited by 477
- 2023RESDSQL: Decoupling Schema Linking and Skeleton Parsing for Text-to-SQLcited by 195
- 2023Graphix-T5: Mixing Pre-Trained Transformers with Graph-Aware Layers for Text-to-SQL Parsingcited by 93
- 2022RASAT: Integrating Relational Structures into Pretrained Seq2Seq Model for Text-to-SQLcited by 85
- 2024A Survey on Employing Large Language Models for Text-to-SQL Taskscited by 67
- 2023How to Prompt LLMs for Text-to-SQL: A Study in Zero-shot, Single-domain, and Cross-domain Settingscited by 58
- 2024A Survey of Text-to-SQL in the Era of LLMs: Where are we, and where are we going?cited by 56
- 2024Before Generation, Align it! A Novel and Effective Strategy for Mitigating Hallucinations in Text-to-SQL Generationcited by 50
- 2022Recent Advances in Text-to-SQL: A Survey of What We Have and What We Expectcited by 47
- 2023ScienceBenchmark: A Complex Real-World Benchmark for Evaluating Natural Language to SQL Systemscited by 45
- 2024FinSQL: Model-Agnostic LLMs-based Text-to-SQL Framework for Financial Analysiscited by 36
- 2023Benchmarking and Improving Text-to-SQL Generation under Ambiguitycited by 34
12 most cited of 62 All 62 (JSON)
- 2026VeriPIE: Checkable Query Plans and Evidence-Guided Selection for Text-to-SQL12 Oct 2026
- 2026The Stochastic Shift: A New Evaluation Paradigm for Text-to-SQL with AI Operators17 Sep 2026
- 2026SQLMorph: Query Mutation and Fine-Grained Metrics for Text-to-SQL Evaluation8 Sep 2026
- 2026ProcArena: A Multi-Scenario Benchmark for LLMs on Direct and Interactive PL/SQL Development from Natural Language6 Sep 2026
- 2026The Nuts and Bolts of Natural Language to SQL Translation: A Systematic Analysis of Model Pipeline Optimisation Approaches and their Interactions12 Jul 2026
- 2026CHS-SQL: A Text-to-SQL approach based on Confidence-Guided Heuristic Search Schema Linking process17 Jun 2026
- 2026EvoSQL: Memory-Augmented Critic-Generator Co-Evolution for Text-to-SQL4 Jun 2026
- 2026SIRIUS-SQL: Anchoring Multi-Candidate Text-to-SQL in Execution Feedback31 May 2026
- 2026FlexSQL: Flexible Exploration and Execution Make Better Text-to-SQL Agents4 May 2026
- 2026NL2SQLBench: A Modular Benchmarking Framework for LLM-Enabled NL2SQL Solutions13 Apr 2026
- 2026Schema on the Inside: A Two-Phase Fine-Tuning Method for High-Efficiency Text-to-SQL at Scale25 Mar 2026
- 2025FINCH: Financial Intelligence using Natural language for Contextualized SQL Handling2 Oct 2025
12 newest of 62 All 62 (JSON)