mlsanityData to 14 Oct 2026

Solid-SQL: Enhanced Schema-linking based In-context Learning for Robust Text-to-SQL

arXiv 2412.12522 ↗First posted 17 Dec 2024cs.CL cs.AIcited by 11

Not on the map. Why?

Abstract (arXiv)

Recently, large language models (LLMs) have significantly improved the performance of text-to-SQL systems. Nevertheless, many state-of-the-art (SOTA) approaches have overlooked the critical aspect of system robustness. Our experiments reveal that while LLM-driven methods excel on standard datasets, their accuracy is notably compromised when faced with adversarial perturbations. To address this challenge, we propose a robust text-to-SQL solution, called Solid-SQL, designed to integrate with various LLMs. We focus on the pre-processing stage, training a robust schema-linking model enhanced by LLM-based data augmentation. Additionally, we design a two-round, structural similarity-based example retrieval strategy for in-context learning. Our method achieves SOTA SQL execution accuracy levels of 82.1% and 58.9% on the general Spider and Bird benchmarks, respectively. Furthermore, experimental results show that Solid-SQL delivers an average improvement of 11.6% compared to baselines on the perturbed Spider-Syn, Spider-Realistic, and Dr. Spider benchmarks.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 22 of its 28 references that are in the map. First posted on arXiv 17 Dec 2024.

Builds on

22 of 28 references.

References · 22

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2013Intriguing properties of neural networkscited by 5,155
  3. 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,139
  4. 2023Can LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLscited by 688
  5. 2023DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-Correctioncited by 477
  6. 2019RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parserscited by 424
  7. 2021PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Modelscited by 411
  8. 2023Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluationcited by 385
  9. 2022UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Modelscited by 231
  10. 2019Towards Complex Text-to-SQL in Cross-Domain Database with Intermediate Representationcited by 210
  11. 2024CodeS: Towards Building Open-source Language Models for Text-to-SQLcited by 187
  12. 2024CHESS: Contextual Harnessing for Efficient SQL Synthesiscited by 169
10 more
  1. 2023C3: Zero-shot Text-to-SQL with ChatGPTcited by 164
  2. 2023MAC-SQL: A Multi-Agent Collaborative Framework for Text-to-SQLcited by 164
  3. 2017SQLNet: Generating Structured Queries From Natural Language Without Reinforcement Learningcited by 135
  4. 2020Structure-Grounded Pretraining for Text-to-SQLcited by 126
  5. 2021Towards Robustness of Text-to-SQL Models against Synonym Substitutioncited by 110
  6. 2023Dr.Spider: A Diagnostic Evaluation Benchmark towards Text-to-SQL Robustnesscited by 53
  7. 2022Towards Robustness of Text-to-SQL Models Against Natural and Realistic Adversarial Table Perturbationcited by 28
  8. 2023Selective Demonstrations for Cross-domain Text-to-SQLcited by 21
  9. 2023Prompting GPT-3.5 for Text-to-SQL with De-semanticization and Skeleton Retrievalcited by 16
  10. 2024Evaluating the Data Model Robustness of Text-to-SQL Systems Based on Real User Queriescited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 6; 2026: 5.

11 papers.

  1. 2025LinkAlign: Scalable Schema Linking for Real-World Large-Scale Multi-Database Text-to-SQLcited by 29
  2. 2025Knapsack Optimization-based Schema Linking for LLM-based Text-to-SQL Generationcited by 9
  3. 2025STRuCT-LLM: Unifying Tabular and Graph Reasoning with Reinforcement Learning for Semantic Parsingcited by 5
  4. 2025SING-SQL: A Synthetic Data Generation Framework for In-Domain Text-to-SQL Translationcited by 5
  5. 2025Rethinking Schema Linking: A Context-Aware Bidirectional Retrieval Approach for Text-to-SQLcited by 4
  6. 2026Memo-SQL: Structured Decomposition and Experience-Driven Self-Correction for Training-Free NL2SQLcited by 4
  7. 2025SchemaGraphSQL: Efficient Schema Linking with Pathfinding Graph Algorithms for Text-to-SQL on Large-Scale Databasescited by 3
  8. 2026EviLink: Multi-Path Schema Linking with Uncertainty-Guided Evidence Acquisition for Large-Scale Text-to-SQLcited by 1
  9. 2026Schema-First Retrieval: Embedding Catalogs for Natural Language Analyticscited by 1
  10. 2026LLM NL2SQL Robustness: Surface Noise vs. Linguistic Variation in Traditional and Agentic Settingscited by 0
  11. 2026An Agentic System for Schema Aware NL2SQL Generationcited by 0