mlsanityData to 7 Oct 2026

OmniSQL: Synthesizing High-quality Text-to-SQL Data at Scale

arXiv 2503.02240 ↗First posted 4 Mar 2025cs.CL cs.DBcited by 90

Not on the map. Why?

Cited by 23 in LLM reasoning, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Text-to-SQL, the task of translating natural language questions into SQL queries, plays a crucial role in enabling non-experts to interact with databases. While recent advancements in large language models (LLMs) have significantly enhanced text-to-SQL performance, existing approaches face notable limitations in real-world text-to-SQL applications. Prompting-based methods often depend on closed-source LLMs, which are expensive, raise privacy concerns, and lack customization. Fine-tuning-based methods, on the other hand, suffer from poor generalizability due to the limited coverage of publicly available training data. To overcome these challenges, we propose a novel and scalable text-to-SQL data synthesis framework for automatically synthesizing large-scale, high-quality, and diverse datasets without extensive human intervention. Using this framework, we introduce SynSQL-2.5M, the first million-scale text-to-SQL dataset, containing 2.5 million samples spanning over 16,000 synthetic databases. Each sample includes a database, SQL query, natural language question, and chain-of-thought (CoT) solution. Leveraging SynSQL-2.5M, we develop OmniSQL, a powerful open-source text-to-SQL model available in three sizes: 7B, 14B, and 32B. Extensive evaluations across nine datasets demonstrate that OmniSQL achieves state-of-the-art performance, matching or surpassing leading closed-source and open-source LLMs, including GPT-4o and DeepSeek-V3, despite its smaller size. We release all code, datasets, and models to support further research.

Key facts. Cited by 90 papers in the map (data through 7 Oct 2026). Builds on 55 of its 86 references that are in the map. First posted on arXiv 4 Mar 2025.

Builds on

55 of 86 references.

References · 55

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  4. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  5. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  6. 2024Qwen2.5 Technical Reportcited by 4,713
  7. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  8. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  9. 2024A Survey on LLM-as-a-Judgecited by 1,384
  10. 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,278
  11. 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,154
  12. 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,120
38 more
  1. 2017Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learningcited by 679
  2. 2023Can LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLscited by 667
  3. 2024StarCoder 2 and The Stack v2: The Next Generationcited by 484
  4. 2023DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-Correctioncited by 465
  5. 2019RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parserscited by 420
  6. 2020TaBERT: Pretraining for Joint Understanding of Textual and Tabular Datacited by 395
  7. 2023Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluationcited by 378
  8. 2023JudgeLM: Fine-tuned Large Language Models are Scalable Judgescited by 351
  9. 2024DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligencecited by 325
  10. 2023RESDSQL: Decoupling Schema Linking and Skeleton Parsing for Text-to-SQLcited by 191
  11. 2024CodeS: Towards Building Open-source Language Models for Text-to-SQLcited by 183
  12. 2020GraPPa: Grammar-Augmented Pre-Training for Table Semantic Parsingcited by 171
  13. 2024CHESS: Contextual Harnessing for Efficient SQL Synthesiscited by 164
  14. 2023MAC-SQL: A Multi-Agent Collaborative Framework for Text-to-SQLcited by 158
  15. 2024CHASE-SQL: Multi-Path Reasoning and Preference Optimized Candidate Selection in Text-to-SQLcited by 132
  16. 2024OpenCoder: The Open Cookbook for Top-Tier Code Large Language Modelscited by 127
  17. 2020Structure-Grounded Pretraining for Text-to-SQLcited by 126
  18. 2020Semantic Evaluation for Text-to-SQL with Distilled Test Suitescited by 123
  19. 2021LGESQL: Line Graph Enhanced Text-to-SQL Model with Mixed Local and Non-Local Relationscited by 119
  20. 2024Granite Code Models: A Family of Open Foundation Models for Code Intelligencecited by 116
  21. 2021Towards Robustness of Text-to-SQL Models against Synonym Substitutioncited by 110
  22. 2024MCS-SQL: Leveraging Multiple Prompts and Multiple-Choice Selection For Text-to-SQL Generationcited by 103
  23. 2022Evaluating the Text-to-SQL Capabilities of Large Language Modelscited by 101
  24. 2023Graphix-T5: Mixing Pre-Trained Transformers with Graph-Aware Layers for Text-to-SQL Parsingcited by 93
  25. 2021Exploring Underexplored Limitations of Cross-Domain Text-to-SQL Generalizationcited by 92
  26. 2024The Dawn of Natural Language to SQL: Are We Fully Ready?cited by 78
  27. 2020Grounded Adaptation for Zero-shot Executable Semantic Parsingcited by 76
  28. 2018SyntaxSQLNet: Syntax Tree Networks for Complex and Cross-DomainText-to-SQL Taskcited by 74
  29. 2024The Death of Schema Linking? Text-to-SQL in the Age of Well-Reasoned Language Modelscited by 67
  30. 2018Robust Text-to-SQL Generation with Execution-Guided Decodingcited by 51
  31. 2023Dr.Spider: A Diagnostic Evaluation Benchmark towards Text-to-SQL Robustnesscited by 50
  32. 2021GitTables: A Large-Scale Corpus of Relational Tablescited by 44
  33. 2021SADGA: Structure-Aware Dual Graph Aggregation Network for Text-to-SQLcited by 43
  34. 2023ScienceBenchmark: A Complex Real-World Benchmark for Evaluating Natural Language to SQL Systemscited by 42
  35. 2021Learning to Synthesize Data for Semantic Parsingcited by 41
  36. 2021Data Augmentation with Hierarchical SQL-to-Question Generation for Cross-domain Text-to-SQL Parsingcited by 32
  37. 2018Question Generation from SQL Queries Improves Neural Semantic Parsingcited by 29
  38. 2022Importance of Synthesizing High-quality Data for Text-to-SQL Parsingcited by 27

50 most cited of 55 All 55 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 43; 2026: 47.

90 papers.

Sort:

By area:

  1. 2025VerlTool: Towards Holistic Agentic Reinforcement Learning with Tool Usecited by 92
  2. 2025Arctic-Text2SQL-R1: Simple Rewards, Strong Reasoning in Text-to-SQLcited by 38
  3. 2025Reward-SQL: Boosting Text-to-SQL via Stepwise Execution-Aware Reasoning and Process-Supervised Rewardscited by 25
  4. 2025DataFlow: An LLM-Driven Framework for Unified Data Preparation and Workflow Automation in the Era of Data-Centric AIcited by 22
  5. 2025Agentar-Scale-SQL: Advancing Text-to-SQL through Orchestrated Test-Time Scalingcited by 20
  6. 2025Reasoning-Table: Exploring Reinforcement Learning for Table Reasoningcited by 18
  7. 2025BIRD-INTERACT: Re-imagining Text-to-SQL Evaluation for Large Language Models via Lens of Dynamic Interactionscited by 17
  8. 2025CSC-SQL: Corrective Self-Consistency in Text-to-SQL via Reinforcement Learningcited by 15
  9. 2025SWE-SQL: Illuminating LLM Pathways to Solve User SQL Issues in Real-World Applicationscited by 15
  10. 2025MARS-SQL: A multi-agent reinforcement learning framework for Text-to-SQLcited by 14
  11. 2026Pervasive Annotation Errors Break Text-to-SQL Benchmarks and Leaderboardscited by 12
  12. 2025Scaling Generalist Data-Analytic Agentscited by 11
38 more
  1. 2025Text2SQL-Flow: A Robust SQL-Aware Data Augmentation Framework for Text-to-SQLcited by 11
  2. 2025SLM-SQL: An Exploration of Small Language Models for Text-to-SQLcited by 10
  3. 2025MTIR-SQL: Multi-turn Tool-Integrated Reasoning Reinforcement Learning for Text-to-SQLcited by 10
  4. 2025Sparks of Tabular Reasoning via Text2SQL Reinforcement Learningcited by 9
  5. 2025ReEx-SQL: Reasoning with Execution-Aware Reinforcement Learning for Text-to-SQLcited by 8
  6. 2025Text-to-SQL as Dual-State Reasoning: Integrating Adaptive Context and Progressive Generationcited by 8
  7. 2025LearNAT: Learning NL2SQL with AST-guided Task Decomposition for Large Language Modelscited by 7
  8. 2025LogicCat: A Chain-of-Thought Text-to-SQL Benchmark for Complex Reasoningcited by 7
  9. 2025DB-Explore: Automated Database Exploration and Instruction Synthesis for Text-to-SQLcited by 5
  10. 2025SPFT-SQL: Enhancing Large Language Model for Text-to-SQL Parsing by Self-Play Fine-Tuningcited by 5
  11. 2025SING-SQL: A Synthetic Data Generation Framework for In-Domain Text-to-SQL Translationcited by 5
  12. 2025A State-of-the-Art SQL Reasoning Model using RLVRcited by 4
  13. 2025SAFENLIDB: A Privacy-Preserving Safety Alignment Framework for LLM-based Natural Language Database Interfacescited by 4
  14. 2025Benchmarking AI Models in Software Engineering: A Review, Search Tool, and Unified Approach for Elevating Benchmark Qualitycited by 3
  15. 2025SpotIt: Evaluating Text-to-SQL Evaluation with Formal Verificationcited by 3
  16. 2026RoboPhD: Self-Improving Text-to-SQL Through Autonomous Agent Evolutioncited by 3
  17. 2025SQaLe: A Large Text-to-SQL Corpus Grounded in Real Schemascited by 3
  18. 2026SQL-ASTRA: Alleviating Sparse Feedback in Agentic SQL via Column-Set Matching and Trajectory Aggregationcited by 3
  19. 2026Closing the Reflection Gap: A Free Calibration Bonus for Agentic RLcited by 3
  20. 2025CogniSQL-R1-Zero: Lightweight Reinforced Reasoning for Efficient SQL Generationcited by 2
  21. 2025PaVeRL-SQL: Text-to-SQL via Partial-Match Rewards and Verbal Reinforcement Learningcited by 2
  22. 2025Node-Level Uncertainty Estimation in LLM-Generated SQLcited by 2
  23. 2025Beyond Query-Level Comparison: Fine-Grained Reinforcement Learning for Text-to-SQL with Automated Interpretable Critiquescited by 2
  24. 2025AGRO-SQL: Agentic Group-Relative Optimization with High-Fidelity Data Synthesiscited by 2
  25. 2026An Efficient and Effective Evaluator for Text2SQL Models on Unseen and Unlabeled Datacited by 2
  26. 2025SQL-Exchange: Transforming SQL Queries Across Domainscited by 1
  27. 2025SteinerSQL: Graph-Guided Mathematical Reasoning for Text-to-SQL Generationcited by 1
  28. 2025HES-SQL: Hybrid Reasoning for Efficient Text-to-SQL with Structural Skeleton Guidancecited by 1
  29. 2025LitE-SQL: A Lightweight and Efficient Text-to-SQL Framework with Vector-based Schema Linking and Execution-Guided Self-Correctioncited by 1
  30. 2025Rethinking Text-to-SQL: Dynamic Multi-turn SQL Interaction for Real-world Database Explorationcited by 1
  31. 2025Beyond SELECT: A Comprehensive Taxonomy-Guided Benchmark for Real-World Text-to-SQL Translationcited by 1
  32. 2026EvolSQL: Structure-Aware Evolution for Scalable Text-to-SQL Data Synthesiscited by 1
  33. 2026Beyond Static Pipelines: Learning Dynamic Workflows for Text-to-SQLcited by 1
  34. 2026Both Ends Count! Just How Good are LLM Agents at "Text-to-Big SQL"?cited by 1
  35. 2026ErrorLLM: Modeling SQL Errors for Text-to-SQL Refinementcited by 1
  36. 2026SpotIt+: Verification-based Text-to-SQL Evaluation with Database Constraintscited by 1
  37. 2026NL2SQLBench: A Modular Benchmarking Framework for LLM-Enabled NL2SQL Solutionscited by 1
  38. 2026Every Step Counts: Step-Level Credit Assignment for Tool-Integrated Text-to-SQLcited by 1

50 most cited of 90 All 90 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025LLMSQL: Upgrading WikiSQL for the LLM Era of Text-to-SQL
  2. 2024Open-SQL Framework: Enhancing Text-to-SQL on Open-source Large Language Models
  3. 2024SelECT-SQL: Self-correcting ensemble Chain-of-Thought for Text-to-SQL
  4. 2025SQLForge: Synthesizing Reliable and Diverse Data to Enhance Text-to-SQL Reasoning in LLMs
  5. 2025CoddLLM: Empowering Large Language Models for Data Analytics
  6. 2024ROUTE: Robust Multitask Tuning and Collaboration for Text-to-SQL
  7. 2024Lucy: Think and Reason to Solve Text-to-SQL
  8. 2025Agentic LLMs for Question Answering over Tabular Data