Towards Complex Text-to-SQL in Cross-Domain Database with Intermediate Representation
Not on the map. Why?
Abstract (arXiv)
We present a neural approach called IRNet for complex and cross-domain Text-to-SQL. IRNet aims to address two challenges: 1) the mismatch between intents expressed in natural language (NL) and the implementation details in SQL; 2) the challenge in predicting columns caused by the large number of out-of-domain words. Instead of end-to-end synthesizing a SQL query, IRNet decomposes the synthesis process into three phases. In the first phase, IRNet performs a schema linking over a question and a database schema. Then, IRNet adopts a grammar-based neural model to synthesize a SemQL query which is an intermediate representation that we design to bridge NL and SQL. Finally, IRNet deterministically infers a SQL query from the synthesized SemQL query with domain knowledge. On the challenging Text-to-SQL benchmark Spider, IRNet achieves 46.7% accuracy, obtaining 19.5% absolute improvement over previous state-of-the-art approaches. At the time of writing, IRNet achieves the first position on the Spider leaderboard.
Key facts. Cited by 210 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 43; 2022: 27; 2023: 44; 2024: 37; 2025: 35; 2026: 24.
210 papers.
Sort:
By area:
- 2023Can LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLscited by 667
- 2023DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-Correctioncited by 465
- 2023Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluationcited by 378
- 2023RESDSQL: Decoupling Schema Linking and Skeleton Parsing for Text-to-SQLcited by 191
- 2024CodeS: Towards Building Open-source Language Models for Text-to-SQLcited by 183
- 2024CHESS: Contextual Harnessing for Efficient SQL Synthesiscited by 164
- 2023C3: Zero-shot Text-to-SQL with ChatGPTcited by 159
- 2023MAC-SQL: A Multi-Agent Collaborative Framework for Text-to-SQLcited by 158
- 2021LGESQL: Line Graph Enhanced Text-to-SQL Model with Mixed Local and Non-Local Relationscited by 119
- 2024Next-Generation Database Interfaces: A Survey of LLM-based Text-to-SQLcited by 118
- 2021Towards Robustness of Text-to-SQL Models against Synonym Substitutioncited by 110
- 2021KaggleDBQA: Realistic Evaluation of Text-to-SQL Parserscited by 105
38 more
- 2024MCS-SQL: Leveraging Multiple Prompts and Multiple-Choice Selection For Text-to-SQL Generationcited by 103
- 2023Graphix-T5: Mixing Pre-Trained Transformers with Graph-Aware Layers for Text-to-SQL Parsingcited by 93
- 2021Exploring Underexplored Limitations of Cross-Domain Text-to-SQL Generalizationcited by 92
- 2022RASAT: Integrating Relational Structures into Pretrained Seq2Seq Model for Text-to-SQLcited by 85
- 2023Is GPT-4 a Good Data Analyst?cited by 69
- 2024The Death of Schema Linking? Text-to-SQL in the Age of Well-Reasoned Language Modelscited by 67
- 2021Natural SQL: Making SQL Easier to Infer from Natural Language Specificationscited by 66
- 2025Reasoning-SQL: Reinforcement Learning with SQL Tailored Partial Rewards for Reasoning-Enhanced Text-to-SQLcited by 59
- 2023How to Prompt LLMs for Text-to-SQL: A Study in Zero-shot, Single-domain, and Cross-domain Settingscited by 57
- 2021Unlocking Compositional Generalization in Pre-trained Models Using Intermediate Representationscited by 55
- 2024A Survey of Text-to-SQL in the Era of LLMs: Where are we, and where are we going?cited by 54
- 2024Synthesizing Text-to-SQL Data from Weak and Strong LLMscited by 53
- 2022A Survey on Text-to-SQL Parsing: Concepts, Methods, and Future Directionscited by 51
- 2024RSL-SQL: Robust Schema Linking in Text-to-SQL Generationcited by 51
- 2025OpenSearch-SQL: Enhancing Text-to-SQL with Dynamic Few-shot and Consistency Alignmentcited by 51
- 2022Recent Advances in Text-to-SQL: A Survey of What We Have and What We Expectcited by 47
- 2023Skill-Based Few-Shot Selection for In-Context Learningcited by 46
- 2024DTS-SQL: Decomposed Text-to-SQL with Small Large Language Modelscited by 45
- 2021SADGA: Structure-Aware Dual Graph Aggregation Network for Text-to-SQLcited by 43
- 2023SQL-PaLM: Improved Large Language Model Adaptation for Text-to-SQL (extended)cited by 42
- 2023ScienceBenchmark: A Complex Real-World Benchmark for Evaluating Natural Language to SQL Systemscited by 42
- 2021Learning to Synthesize Data for Semantic Parsingcited by 41
- 2022S2SQL: Injecting Syntax to Question-Schema Interaction Graph Encoder for Text-to-SQL Parserscited by 41
- 2022Is a Question Decomposition Unit All We Need?cited by 37
- 2021ShadowGNN: Graph Projection Neural Network for Text-to-SQL Parsercited by 35
- 2025LLM-JEPA: Large Language Models Meet Joint Embedding Predictive Architecturescited by 35
- 2024PURPLE: Making a Large Language Model a Better SQL Writercited by 34
- 2024MAGIC: Generating Self-Correction Guideline for In-Context Text-to-SQLcited by 34
- 2021NL-EDIT: Correcting semantic parse errors through natural language interactioncited by 33
- 2021Data Augmentation with Hierarchical SQL-to-Question Generation for Cross-domain Text-to-SQL Parsingcited by 32
- 2024Decomposition for Enhancing Attention: Improving LLM-based Text-to-SQL through Workflow Paradigmcited by 31
- 2022Proton: Probing Schema Linking Information from Pre-trained Language Models for Text-to-SQL Parsingcited by 30
- 2024A Survey of Table Reasoning with Large Language Modelscited by 29
- 2021Awakening Latent Grounding from Pretrained Language Models for Semantic Parsingcited by 28
- 2022Importance of Synthesizing High-quality Data for Text-to-SQL Parsingcited by 27
- 2023Natural Language Interfaces for Tabular Data Querying and Visualization: A Surveycited by 27
- 2022HIE-SQL: History Information Enhanced Network for Context-Dependent Text-to-SQL Semantic Parsingcited by 26
- 2025LinkAlign: Scalable Schema Linking for Real-World Large-Scale Multi-Database Text-to-SQLcited by 26
50 most cited of 210 All 210 (JSON)
- 2026JoinGR: Learning to Traverse Join Graphs for Table Retrieval1 Oct 2026
- 2026Enterprise Representation Simplification (ERS): Reducing Representational Complexity for Enterprise AI30 Sep 2026
- 2026Closing the Cross-Dialect Gap: Query Plans as a Portable Interface in Text-to-SQL27 Sep 2026
- 2026ProcArena: A Multi-Scenario Benchmark for LLMs on Direct and Interactive PL/SQL Development from Natural Language6 Sep 2026
- 2026text2ql: Multi-Target Natural Language Querying via a Language-Agnostic Intermediate Representation2 Sep 2026
- 2026BIRD-History: A Benchmark for History-Driven Text-to-SQL with Fine-Grained Knowledge Annotations29 Aug 2026
- 2026Beyond the Harness: End-to-End Optimization of Context Artifacts for Enterprise Text-to-SQL24 Aug 2026
- 2026Bounded Semantic Planning and Deterministic Compilation for Reliable Enterprise Text-to-SQL17 Aug 2026
- 2026SemPlan: Benchmarking Structured Semantic Planning for LLM-Based Queries over Enterprise Data12 Aug 2026
- 2026AttnLink: Turning Attention into Schema Links for Text-to-SQL1 Aug 2026
- 2026DRL: A Deterministic Relational Middleware Layer for Transaction-Safe Enterprise NL2SQL Under Schema-Graph Scaling23 Jul 2026
- 2026SQuaD-SQL: Efficient Text-to-SQL with Small Language Models via LLM-Guided Knowledge Distillation9 Jul 2026
38 more
- 2026Database Context Compression for Text-to-SQL on Real-World Large Databases26 Jun 2026
- 2026CHS-SQL: A Text-to-SQL approach based on Confidence-Guided Heuristic Search Schema Linking process17 Jun 2026
- 2026EntSQL: A Benchmark for Grounding Text-to-SQL in Long-Context Enterprise Knowledge2 Jun 2026
- 2026CAPER: Clause-Aligned Process Supervision for Text-to-SQL2 Jun 2026
- 2026Knowledge Distillation for Low-Resource Open-source Text-to-SQL Model13 May 2026
- 2026FINER-SQL: Boosting Small Language Models for Text-to-SQL5 May 2026
- 2026FlexSQL: Flexible Exploration and Execution Make Better Text-to-SQL Agents4 May 2026
- 2026Agent-Agnostic Evaluation of SQL Accuracy in Production Text-to-SQL Systems30 Apr 2026
- 2026NL2SQLBench: A Modular Benchmarking Framework for LLM-Enabled NL2SQL Solutions13 Apr 2026
- 2026SQLStructEval: Structural Evaluation of LLM Text-to-SQL Generation8 Apr 2026
- 2026An Efficient and Effective Evaluator for Text2SQL Models on Unseen and Unlabeled Data8 Mar 2026
- 2026OptiSQL: Executable SQL Generation from Optical Tokens20 Jan 2026
- 2025Scaling Text2SQL via LLM-efficient Schema Filtering with Functional Dependency Graph Rerankers18 Dec 2025
- 2025Evidence-Guided Schema Normalization for Temporal Tabular Reasoning29 Nov 2025
- 2025Beyond Query-Level Comparison: Fine-Grained Reinforcement Learning for Text-to-SQL with Automated Interpretable Critiques27 Nov 2025
- 2025Beyond SELECT: A Comprehensive Taxonomy-Guided Benchmark for Real-World Text-to-SQL Translation17 Nov 2025
- 2025Text2SQL-Flow: A Robust SQL-Aware Data Augmentation Framework for Text-to-SQL13 Nov 2025
- 2025GEMMA-SQL: A Novel Text-to-SQL Model Based on Large Language Models5 Nov 2025
- 2025InteracSPARQL: An Interactive System for SPARQL Query Refinement Using Natural Language Explanations3 Nov 2025
- 2025K-DeCore: Facilitating Knowledge Transfer in Continual Structured Knowledge Reasoning via Knowledge Decoupling21 Sep 2025
- 2025DeKeyNLU: Enhancing Natural Language to SQL Generation through Task Decomposition and Keyword Extraction18 Sep 2025
- 2025GBV-SQL: Guided Generation and SQL2Text Back-Translation Validation for Multi-Agent Text2SQL16 Sep 2025
- 2025LLM-JEPA: Large Language Models Meet Joint Embedding Predictive Architectures11 Sep 2025
- 2025Evaluating NL2SQL via SQL2NL4 Sep 2025
- 2025Pandora: Leveraging Code-driven Knowledge Transfer for Unified Structured Knowledge Reasoning25 Aug 2025
- 2025CRED-SQL: Enhancing Real-world Large Scale Database Text-to-SQL Parsing through Cluster Retrieval and Execution Description18 Aug 2025
- 2025Confidence Estimation for Text-to-SQL in Large Language Models8 Aug 2025
- 2025End-to-End Text-to-SQL with Dataset Selection: Leveraging LLMs for Adaptive Query Generation8 Aug 2025
- 2025SLM-SQL: An Exploration of Small Language Models for Text-to-SQL30 Jul 2025
- 2025SKA-Bench: A Fine-Grained Benchmark for Evaluating Structured Knowledge Understanding of LLMs23 Jul 2025
- 2025HI-SQL: Optimizing Text-to-SQL Systems through Dynamic Hint Integration11 Jun 2025
- 2025SDE-SQL: Enhancing Text-to-SQL Generation in Large Language Models via Self-Driven Exploration with SQL Probes8 Jun 2025
- 2025DCG-SQL: Enhancing In-Context Learning for Text-to-SQL with Deep Contextual Schema Link Graph26 May 2025
- 2025Meta-aware Learning in text-to-SQL Large Language Model25 May 2025
- 2025UNJOIN: Enhancing Multi-Table Text-to-SQL Generation via Schema Simplification23 May 2025
- 2025Graph-Reward-SQL: Execution-Free Reinforcement Learning for Text-to-SQL via Graph Matching and Stepwise Reward18 May 2025
- 2025Enhancing Text2Cypher with Schema Filtering8 May 2025
- 2025Reasoning-SQL: Reinforcement Learning with SQL Tailored Partial Rewards for Reasoning-Enhanced Text-to-SQL29 Mar 2025
50 newest of 210 All 210 (JSON)
- 2024The Death of Schema Linking? Text-to-SQL in the Age of Well-Reasoned Language Modelscited by 67
- 2025Reasoning-SQL: Reinforcement Learning with SQL Tailored Partial Rewards for Reasoning-Enhanced Text-to-SQLcited by 59
- 2024Decomposition for Enhancing Attention: Improving LLM-based Text-to-SQL through Workflow Paradigmcited by 31
- 2024A Survey of Table Reasoning with Large Language Modelscited by 29
- 2025K-DeCore: Facilitating Knowledge Transfer in Continual Structured Knowledge Reasoning via Knowledge Decouplingcited by 2
- 2023Explainable Verbal Reasoner Plus (EVR+): A Natural Language Reasoning Framework that Supports Diverse Compositional Reasoningcited by 1
- 2025Pandora: Leveraging Code-driven Knowledge Transfer for Unified Structured Knowledge Reasoningcited by 1
- 2025Evidence-Guided Schema Normalization for Temporal Tabular Reasoningcited by 0
- 2025Evidence-Guided Schema Normalization for Temporal Tabular Reasoning29 Nov 2025
- 2025K-DeCore: Facilitating Knowledge Transfer in Continual Structured Knowledge Reasoning via Knowledge Decoupling21 Sep 2025
- 2025Pandora: Leveraging Code-driven Knowledge Transfer for Unified Structured Knowledge Reasoning25 Aug 2025
- 2025Reasoning-SQL: Reinforcement Learning with SQL Tailored Partial Rewards for Reasoning-Enhanced Text-to-SQL29 Mar 2025
- 2024The Death of Schema Linking? Text-to-SQL in the Age of Well-Reasoned Language Models14 Aug 2024
- 2024Decomposition for Enhancing Attention: Improving LLM-based Text-to-SQL through Workflow Paradigm16 Feb 2024
- 2024A Survey of Table Reasoning with Large Language Models13 Feb 2024
- 2023Explainable Verbal Reasoner Plus (EVR+): A Natural Language Reasoning Framework that Supports Diverse Compositional Reasoning28 Apr 2023
- 2023MAC-SQL: A Multi-Agent Collaborative Framework for Text-to-SQLcited by 158
- 2024MAG-SQL: Multi-Agent Generative Approach with Soft Schema Linking and Iterative Sub-SQL Refinement for Text-to-SQLcited by 22
- 2024SQLFixAgent: Towards Semantic-Accurate Text-to-SQL Parsing via Consistency-Enhanced Multi-Agent Collaborationcited by 10
- 2025Towards a Barrier-free GeoQA Portal: Natural Language Interaction with Geospatial Data Using Multi-Agent LLMs and Semantic Searchcited by 3
- 2024Cooperative SQL Generation for Segmented Databases By Using Multi-functional LLM Agentscited by 1
- 2025GBV-SQL: Guided Generation and SQL2Text Back-Translation Validation for Multi-Agent Text2SQLcited by 1
- 2025GBV-SQL: Guided Generation and SQL2Text Back-Translation Validation for Multi-Agent Text2SQL16 Sep 2025
- 2025Towards a Barrier-free GeoQA Portal: Natural Language Interaction with Geospatial Data Using Multi-Agent LLMs and Semantic Search18 Mar 2025
- 2024Cooperative SQL Generation for Segmented Databases By Using Multi-functional LLM Agents8 Dec 2024
- 2024MAG-SQL: Multi-Agent Generative Approach with Soft Schema Linking and Iterative Sub-SQL Refinement for Text-to-SQL15 Aug 2024
- 2024SQLFixAgent: Towards Semantic-Accurate Text-to-SQL Parsing via Consistency-Enhanced Multi-Agent Collaboration19 Jun 2024
- 2023MAC-SQL: A Multi-Agent Collaborative Framework for Text-to-SQL18 Dec 2023
- 2023Can LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLscited by 667
- 2023DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-Correctioncited by 465
- 2023Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluationcited by 378
- 2023RESDSQL: Decoupling Schema Linking and Skeleton Parsing for Text-to-SQLcited by 191
- 2024CodeS: Towards Building Open-source Language Models for Text-to-SQLcited by 183
- 2024CHESS: Contextual Harnessing for Efficient SQL Synthesiscited by 164
- 2023C3: Zero-shot Text-to-SQL with ChatGPTcited by 159
- 2021LGESQL: Line Graph Enhanced Text-to-SQL Model with Mixed Local and Non-Local Relationscited by 119
- 2024Next-Generation Database Interfaces: A Survey of LLM-based Text-to-SQLcited by 118
- 2021Towards Robustness of Text-to-SQL Models against Synonym Substitutioncited by 110
- 2021KaggleDBQA: Realistic Evaluation of Text-to-SQL Parserscited by 105
- 2024MCS-SQL: Leveraging Multiple Prompts and Multiple-Choice Selection For Text-to-SQL Generationcited by 103
12 most cited of 192 All 192 (JSON)
- 2026JoinGR: Learning to Traverse Join Graphs for Table Retrieval1 Oct 2026
- 2026Enterprise Representation Simplification (ERS): Reducing Representational Complexity for Enterprise AI30 Sep 2026
- 2026Closing the Cross-Dialect Gap: Query Plans as a Portable Interface in Text-to-SQL27 Sep 2026
- 2026ProcArena: A Multi-Scenario Benchmark for LLMs on Direct and Interactive PL/SQL Development from Natural Language6 Sep 2026
- 2026text2ql: Multi-Target Natural Language Querying via a Language-Agnostic Intermediate Representation2 Sep 2026
- 2026BIRD-History: A Benchmark for History-Driven Text-to-SQL with Fine-Grained Knowledge Annotations29 Aug 2026
- 2026Beyond the Harness: End-to-End Optimization of Context Artifacts for Enterprise Text-to-SQL24 Aug 2026
- 2026Bounded Semantic Planning and Deterministic Compilation for Reliable Enterprise Text-to-SQL17 Aug 2026
- 2026SemPlan: Benchmarking Structured Semantic Planning for LLM-Based Queries over Enterprise Data12 Aug 2026
- 2026AttnLink: Turning Attention into Schema Links for Text-to-SQL1 Aug 2026
- 2026DRL: A Deterministic Relational Middleware Layer for Transaction-Safe Enterprise NL2SQL Under Schema-Graph Scaling23 Jul 2026
- 2026SQuaD-SQL: Efficient Text-to-SQL with Small Language Models via LLM-Guided Knowledge Distillation9 Jul 2026
12 newest of 192 All 192 (JSON)