mlsanityData to 7 Oct 2026

Structure Guided Large Language Model for SQL Generation

arXiv 2402.13284 ↗First posted 19 Feb 2024cs.DB cs.AI cs.CLcited by 9

Not on the map. Why?

Abstract (arXiv)

Recent advancements in large language models (LLMs) have shown promise in bridging the gap between natural language queries and database management systems, enabling users to interact with databases without the background of SQL. However, LLMs often struggle to comprehend complex database structures and accurately interpret user intentions. Decomposition-based methods have been proposed to enhance the performance of LLMs on complex tasks, but decomposing SQL generation into subtasks is non-trivial due to the declarative structure of SQL syntax and the intricate connections between query concepts and database elements. In this paper, we propose a novel Structure GUided text-to-SQL framework~(SGU-SQL) that incorporates syntax-based prompting to enhance the SQL generation capabilities of LLMs. Specifically, SGU-SQL establishes structure-aware links between user queries and database schema and decomposes the complex generation task using syntax-based prompting to enable more accurate LLM-based SQL generation. Extensive experiments on two benchmark datasets demonstrate that SGU-SQL consistently outperforms state-of-the-art text-to-SQL models.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 36 of its 70 references that are in the map. First posted on arXiv 19 Feb 2024.

Builds on

36 of 70 references.

References · 36

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2023GPT-4 Technical Reportcited by 18,132
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  5. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  6. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  7. 2023Code Llama: Open Foundation Models for Codecited by 2,105
  8. 2021What Makes Good In-Context Examples for GPT-3?cited by 1,184
  9. 2023PaLM 2 Technical Reportcited by 1,154
  10. 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,120
  11. 2023Teaching Large Language Models to Self-Debugcited by 963
  12. 2017Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learningcited by 679
24 more
  1. 2023DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-Correctioncited by 465
  2. 2019RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parserscited by 420
  3. 2021PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Modelscited by 402
  4. 2023Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluationcited by 378
  5. 2023LEVER: Learning to Verify Language-to-Code Generation with Executioncited by 228
  6. 2019Towards Complex Text-to-SQL in Cross-Domain Database with Intermediate Representationcited by 210
  7. 2023RESDSQL: Decoupling Schema Linking and Skeleton Parsing for Text-to-SQLcited by 191
  8. 2020GraPPa: Grammar-Augmented Pre-Training for Table Semantic Parsingcited by 171
  9. 2023MAC-SQL: A Multi-Agent Collaborative Framework for Text-to-SQLcited by 158
  10. 2022Natural Language to Code Translation with Executioncited by 122
  11. 2021LGESQL: Line Graph Enhanced Text-to-SQL Model with Mixed Local and Non-Local Relationscited by 119
  12. 2023A comprehensive evaluation of ChatGPT's zero-shot Text-to-SQL capabilitycited by 118
  13. 2022Evaluating the Text-to-SQL Capabilities of Large Language Modelscited by 101
  14. 2023Graphix-T5: Mixing Pre-Trained Transformers with Graph-Aware Layers for Text-to-SQL Parsingcited by 93
  15. 2022RASAT: Integrating Relational Structures into Pretrained Seq2Seq Model for Text-to-SQLcited by 85
  16. 2019Relational Graph Attention Networkscited by 81
  17. 2020RYANSQL: Recursively Applying Sketch-based Slot Fillings for Complex Text-to-SQL in Cross-Domain Databasescited by 63
  18. 2023How to Prompt LLMs for Text-to-SQL: A Study in Zero-shot, Single-domain, and Cross-domain Settingscited by 57
  19. 2021Understanding the Properties of Minimum Bayes Risk Decoding in Neural Machine Translationcited by 56
  20. 2023Enhancing Few-shot Text-to-SQL Capabilities of Large Language Models: A Study on Prompt Design Strategiescited by 44
  21. 2023Symbol-LLM: Towards Foundational Symbol-centric Interface For Large Language Modelscited by 38
  22. 2024Knowledge-to-SQL: Enhancing SQL Generation with Data Expert LLMcited by 35
  23. 2023KnowGPT: Knowledge Graph based Prompting for Large Language Modelscited by 30
  24. 2023Towards Knowledge-Intensive Text-to-SQL Semantic Parsing with Formulaic Knowledgecited by 18

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 4; 2026: 3.

9 papers.

  1. 2025AnyEdit: Edit Any Knowledge Encoded in Language Modelscited by 74
  2. 2025Reinforced Lifelong Editing for Language Modelscited by 33
  3. 2024Neuron-Level Sequential Editing for Large Language Modelscited by 18
  4. 2024Neuro-Symbolic Entity Alignment via Variational Inferencecited by 8
  5. 2025LoSemB: Logic-Guided Semantic Bridging for Inductive Tool Retrievalcited by 3
  6. 2025GEMMA-SQL: A Novel Text-to-SQL Model Based on Large Language Modelscited by 0
  7. 2026SemanticAgent: A Semantics-Aware Framework for Text-to-SQL Data Synthesiscited by 0
  8. 2026Residual Skill Optimization for Text-to-SQL Ensemblescited by 0
  9. 2026ProcArena: A Multi-Scenario Benchmark for LLMs on Direct and Interactive PL/SQL Development from Natural Languagecited by 0