EvolSQL: Structure-Aware Evolution for Scalable Text-to-SQL Data Synthesis
On the map: Synthetic data and self-improvement for LLMs → Synthetic reasoning data and bootstrapping
Abstract (arXiv)
Training effective Text-to-SQL models remains challenging due to the scarcity of high-quality, diverse, and structurally complex datasets. Existing methods either rely on limited human-annotated corpora, or synthesize datasets directly by simply prompting LLMs without explicit control over SQL structures, often resulting in limited structural diversity and complexity. To address this, we introduce EvolSQL, a structure-aware data synthesis framework that evolves SQL queries from seed data into richer and more semantically diverse forms. EvolSQL starts with an exploratory Query-SQL expansion to broaden question diversity and improve schema coverage, and then applies an adaptive directional evolution strategy using six atomic transformation operators derived from the SQL Abstract Syntax Tree to progressively increase query complexity across relational, predicate, aggregation, and nesting dimensions. An execution-grounded SQL refinement module and schema-aware deduplication further ensure the creation of high-quality, structurally diverse mapping pairs. Experimental results show that a 7B model fine-tuned on our data outperforms one trained on the much larger SynSQL dataset using only 1/18 of the data.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Synthetic reasoning data and bootstrapping, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 34 of its 46 references that are in the map. First posted on arXiv 8 Jan 2026.
Builds on
34 of 46 references.
References · 34
- 2023GPT-4 Technical Reportcited by 18,132
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2025Qwen3 Technical Reportcited by 8,195
- 2024Qwen2.5-Coder Technical Reportcited by 1,151
- 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,120
- 2023Can LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLscited by 667
- 2023DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-Correctioncited by 465
- 2019RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parserscited by 420
- 2023Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluationcited by 378
- 2024CHESS: Contextual Harnessing for Efficient SQL Synthesiscited by 164
- 2023C3: Zero-shot Text-to-SQL with ChatGPTcited by 159
22 more
- 2023MAC-SQL: A Multi-Agent Collaborative Framework for Text-to-SQLcited by 158
- 2024CHASE-SQL: Multi-Path Reasoning and Preference Optimized Candidate Selection in Text-to-SQLcited by 132
- 2020Structure-Grounded Pretraining for Text-to-SQLcited by 126
- 2020Semantic Evaluation for Text-to-SQL with Distilled Test Suitescited by 123
- 2023A comprehensive evaluation of ChatGPT's zero-shot Text-to-SQL capabilitycited by 118
- 2021Towards Robustness of Text-to-SQL Models against Synonym Substitutioncited by 110
- 2024MCS-SQL: Leveraging Multiple Prompts and Multiple-Choice Selection For Text-to-SQL Generationcited by 103
- 2021Exploring Underexplored Limitations of Cross-Domain Text-to-SQL Generalizationcited by 92
- 2025OmniSQL: Synthesizing High-quality Text-to-SQL Data at Scalecited by 90
- 2025Reasoning-SQL: Reinforcement Learning with SQL Tailored Partial Rewards for Reasoning-Enhanced Text-to-SQLcited by 59
- 2024Synthesizing Text-to-SQL Data from Weak and Strong LLMscited by 53
- 2023ScienceBenchmark: A Complex Real-World Benchmark for Evaluating Natural Language to SQL Systemscited by 42
- 2021Learning to Synthesize Data for Semantic Parsingcited by 41
- 2025Arctic-Text2SQL-R1: Simple Rewards, Strong Reasoning in Text-to-SQLcited by 38
- 2021Data Augmentation with Hierarchical SQL-to-Question Generation for Cross-domain Text-to-SQL Parsingcited by 32
- 2018Question Generation from SQL Queries Improves Neural Semantic Parsingcited by 29
- 2025ExCoT: Optimizing Reasoning for Text-to-SQL with Execution Feedbackcited by 23
- 2018Semantic Parsing with Syntax- and Table-Aware SQL Generationcited by 17
- 2025STaR-SQL: Self-Taught Reasoner for Text-to-SQLcited by 16
- 2021Hierarchical Neural Data Synthesis for Semantic Parsingcited by 11
- 2025Text2SQL-Flow: A Robust SQL-Aware Data Augmentation Framework for Text-to-SQLcited by 11
- 2025Uncovering the Impact of Chain-of-Thought Reasoning for Direct Preference Optimization: Lessons from Text-to-SQLcited by 9
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026LIMIT: Less Is More for Instruction Tuning in Text-to-SQL21 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2025SING-SQL: A Synthetic Data Generation Framework for In-Domain Text-to-SQL Translation
- 2022Diverse Parallel Data Synthesis for Cross-Database Adaptation of Text-to-SQL Parsers
- 2025ORANGE: An Online Reflection ANd GEneration framework with Domain Knowledge for Text-to-SQL
- 2025Thinkquel: A Model Dedicated to Text-to-dbt Using Synthetic Data and a Span-Aware Objective
- 2026Rose-SQL: Role-State Evolution Guided Structured Reasoning for Multi-Turn Text-to-SQL
- 2025DB-Explore: Automated Database Exploration and Instruction Synthesis for Text-to-SQL
- 2026Boundary-Aware NL2SQL: Integrating Reliability through Hybrid Reward and Data Synthesis
- 2026RoboPhD: Self-Improving Text-to-SQL Through Autonomous Agent Evolution