LIMIT: Less Is More for Instruction Tuning in Text-to-SQL
Not on the map. Why?
Abstract (arXiv)
Large language models have achieved remarkable progress on Text-to-SQL through reasoning-enhanced fine-tuning, yet existing approaches predominantly rely on massive instruction corpora under the assumption that scale drives performance. We challenge this paradigm by investigating a fundamental question: what is the minimal data requirement for effective Text-to-SQL instruction tuning? We propose LIMIT(Less Is More for Instruction Tuning in Text-to-SQL), a data-centric framework that demonstrates strong database reasoning can emerge from an extremely compact training set when examples are strategically selected. LIMIT operates through four stages: difficulty-aware filtering that identifies samples within the model's learning frontier, chain-of-thought synthesis with consistency-based selection, multi-dimensional quality scoring via LLM-as-judge, and genetic algorithm optimization that jointly maximizes schema coverage and sample quality. On the BIRD and Spider benchmark, LIMIT selects only 796 and 863 samples while achieving 100% table coverage, enabling Qwen3-8B to reach 69.1% and 88.9% execution accuracy.This result surpasses methods trained on 20 times more data and establishes a new state-of-the-art among open-source approaches. Our findings suggest that careful data curation, rather than scale, is the key to efficient Text-to-SQL learning.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 32 of its 42 references that are in the map. First posted on arXiv 21 Sep 2026.
Builds on
32 of 42 references.
References · 32
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
- 2025s1: Simple test-time scalingcited by 1,341
- 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,139
- 2023LIMA: Less Is More for Alignmentcited by 1,100
- 2023Can LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLscited by 688
- 2025LIMO: Less is More for Reasoningcited by 498
- 2023DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-Correctioncited by 477
- 2023RESDSQL: Decoupling Schema Linking and Skeleton Parsing for Text-to-SQLcited by 195
- 2024CodeS: Towards Building Open-source Language Models for Text-to-SQLcited by 187
- 2024CHESS: Contextual Harnessing for Efficient SQL Synthesiscited by 169
20 more
- 2023C3: Zero-shot Text-to-SQL with ChatGPTcited by 164
- 2023MAC-SQL: A Multi-Agent Collaborative Framework for Text-to-SQLcited by 164
- 2024MCS-SQL: Leveraging Multiple Prompts and Multiple-Choice Selection For Text-to-SQL Generationcited by 105
- 2025OmniSQL: Synthesizing High-quality Text-to-SQL Data at Scalecited by 91
- 2025SQL-R1: Training Natural Language to SQL Reasoning Model By Reinforcement Learningcited by 68
- 2025Reasoning-SQL: Reinforcement Learning with SQL Tailored Partial Rewards for Reasoning-Enhanced Text-to-SQLcited by 59
- 2024Synthesizing Text-to-SQL Data from Weak and Strong LLMscited by 54
- 2024RSL-SQL: Robust Schema Linking in Text-to-SQL Generationcited by 52
- 2024Before Generation, Align it! A Novel and Effective Strategy for Mitigating Hallucinations in Text-to-SQL Generationcited by 50
- 2023SQL-PaLM: Improved Large Language Model Adaptation for Text-to-SQL (extended)cited by 42
- 2024PET-SQL: A Prompt-Enhanced Two-Round Refinement of Text-to-SQL with Cross-consistencycited by 27
- 2025Agentar-Scale-SQL: Advancing Text-to-SQL through Orchestrated Test-Time Scalingcited by 24
- 2025SQL-o1: A Self-Reward Heuristic Dynamic Search Method for Text-to-SQLcited by 19
- 2024Metasql: A Generate-then-Rank Framework for Natural Language to SQL Translationcited by 17
- 2025LIMI: Less is More for Agencycited by 17
- 2025SLM-SQL: An Exploration of Small Language Models for Text-to-SQLcited by 10
- 2024EPI-SQL: Enhancing Text-to-SQL Translation with Error-Prevention Instructionscited by 8
- 2026SQL-Trail: Multi-Turn Reinforcement Learning with Interleaved Feedback for Text-to-SQLcited by 7
- 2025DB-Explore: Automated Database Exploration and Instruction Synthesis for Text-to-SQLcited by 5
- 2026EvolSQL: Structure-Aware Evolution for Scalable Text-to-SQL Data Synthesiscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Reinforcing Code Generation: Improving Text-to-SQL with Execution-Based Learning
- 2025SPFT-SQL: Enhancing Large Language Model for Text-to-SQL Parsing by Self-Play Fine-Tuning
- 2025SQLForge: Synthesizing Reliable and Diverse Data to Enhance Text-to-SQL Reasoning in LLMs
- 2025Arctic-Text2SQL-R1: Simple Rewards, Strong Reasoning in Text-to-SQL
- 2026TAHOE: Text-to-SQL with Automated Hint Optimization from Experience
- 2024LR-SQL: A Supervised Fine-Tuning Method for Text2SQL Tasks under Low-Resource Scenarios
- 2025Text2SQL-Flow: A Robust SQL-Aware Data Augmentation Framework for Text-to-SQL
- 2026FINER-SQL: Boosting Small Language Models for Text-to-SQL