mlsanityData to 7 Oct 2026

FINER-SQL: Boosting Small Language Models for Text-to-SQL

arXiv 2605.03465 ↗First posted 5 May 2026cs.DB cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models have driven major advances in Text-to-SQL generation. However, they suffer from high computational cost, long latency, and data privacy concerns, which make them impractical for many real-world applications. A natural alternative is to use small language models (SLMs), which enable efficient and private on-premise deployment. Yet, SLMs often struggle with weak reasoning and poor instruction following. Conventional reinforcement learning methods based on sparse binary rewards (0/1) provide little learning signal when the generated SQLs are incorrect, leading to unstable or collapsed training. To overcome these issues, we propose FINER-SQL, a scalable and reusable reinforcement learning framework that enhances SLMs through fine-grained execution feedback. Built on group relative policy optimization, FINER-SQL replaces sparse supervision with dense and interpretable rewards that offer continuous feedback even for incorrect SQLs. It introduces two key reward functions: a memory reward, which aligns reasoning with verified traces for semantic stability, and an atomic reward, which measures operation-level overlap to grant partial credit for structurally correct but incomplete SQLs. This approach transforms discrete correctness into continuous learning, enabling stable, critic-free optimization. Experiments on the BIRD and Spider benchmarks show that FINER-SQL achieves up to 67.73% and 85% execution accuracy with a 3B model -- matching much larger LLMs while reducing inference latency to 5.57~s/sample. These results highlight a cost-efficient and privacy-preserving path toward high-performance Text-to-SQL generation. Our code is available at https://github.com/thanhdath/finer-sql.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 58 of its 101 references that are in the map. First posted on arXiv 5 May 2026.

Builds on

58 of 101 references.

References · 58

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  5. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  6. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  7. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
  8. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
  9. 2023Let's Verify Step by Stepcited by 3,598
  10. 2023Mistral 7Bcited by 3,065
  11. 2017Billion-scale similarity search with GPUscited by 2,477
  12. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
38 more
  1. 2023Instruction-Following Evaluation for Large Language Modelscited by 1,143
  2. 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,120
  3. 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 895
  4. 2017Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learningcited by 679
  5. 2023Can LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLscited by 667
  6. 2024Self-Rewarding Language Modelscited by 654
  7. 2024ORPO: Monolithic Preference Optimization without Reference Modelcited by 556
  8. 2018Texygen: A Benchmarking Platform for Text Generation Modelscited by 484
  9. 2023DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-Correctioncited by 465
  10. 2019RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parserscited by 420
  11. 2021PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Modelscited by 402
  12. 2023Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluationcited by 378
  13. 2019Towards Complex Text-to-SQL in Cross-Domain Database with Intermediate Representationcited by 210
  14. 2024CodeS: Towards Building Open-source Language Models for Text-to-SQLcited by 183
  15. 2024CHESS: Contextual Harnessing for Efficient SQL Synthesiscited by 164
  16. 2017SQLNet: Generating Structured Queries From Natural Language Without Reinforcement Learningcited by 135
  17. 2024CHASE-SQL: Multi-Path Reasoning and Preference Optimized Candidate Selection in Text-to-SQLcited by 132
  18. 2024InFoBench: Evaluating Instruction Following Ability in Large Language Modelscited by 128
  19. 2024MCS-SQL: Leveraging Multiple Prompts and Multiple-Choice Selection For Text-to-SQL Generationcited by 103
  20. 2021Exploring Underexplored Limitations of Cross-Domain Text-to-SQL Generalizationcited by 92
  21. 2025OmniSQL: Synthesizing High-quality Text-to-SQL Data at Scalecited by 90
  22. 2024The Dawn of Natural Language to SQL: Are We Fully Ready?cited by 78
  23. 2018SyntaxSQLNet: Syntax Tree Networks for Complex and Cross-DomainText-to-SQL Taskcited by 74
  24. 2025SQL-R1: Training Natural Language to SQL Reasoning Model By Reinforcement Learningcited by 67
  25. 2025Reasoning-SQL: Reinforcement Learning with SQL Tailored Partial Rewards for Reasoning-Enhanced Text-to-SQLcited by 59
  26. 2023A Comprehensive Survey on Vector Database: Storage and Retrieval Technique, Challengecited by 55
  27. 2023Dr.Spider: A Diagnostic Evaluation Benchmark towards Text-to-SQL Robustnesscited by 50
  28. 2025Arctic-Text2SQL-R1: Simple Rewards, Strong Reasoning in Text-to-SQLcited by 38
  29. 2025Alpha-SQL: Zero-Shot Text-to-SQL using Monte Carlo Tree Searchcited by 33
  30. 2025NL2SQL-BUGs: A Benchmark for Detecting Semantic Errors in NL2SQL Translationcited by 31
  31. 2025Is Long Context All You Need? Leveraging LLM's Extended Context for NL2SQLcited by 30
  32. 2024AutoPSV: Automated Process-Supervised Verifiercited by 28
  33. 2025ExCoT: Optimizing Reasoning for Text-to-SQL with Execution Feedbackcited by 23
  34. 2021Prototype Learning for Interpretable Respiratory Sound Analysiscited by 21
  35. 2025SQL-o1: A Self-Reward Heuristic Dynamic Search Method for Text-to-SQLcited by 19
  36. 2022Efficient Integration of Multi-Order Dynamics and Internal Dynamics in Stock Movement Predictioncited by 18
  37. 2024Manipulating Recommender Systems: A Survey of Poisoning Attacks and Countermeasurescited by 14
  38. 2022Detecting Rumours with Latency Guarantees using Massive Streaming Datacited by 12

50 most cited of 58 All 58 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Progress-SQL: Improving Reinforcement Learning for Text-to-SQL via Progressive Rewards
  2. 2025CogniSQL-R1-Zero: Lightweight Reinforced Reasoning for Efficient SQL Generation
  3. 2025Graph-Reward-SQL: Execution-Free Reinforcement Learning for Text-to-SQL via Graph Matching and Stepwise Reward
  4. 2025CSC-SQL: Corrective Self-Consistency in Text-to-SQL via Reinforcement Learning
  5. 2025Reinforcing Code Generation: Improving Text-to-SQL with Execution-Based Learning
  6. 2025Sparks of Tabular Reasoning via Text2SQL Reinforcement Learning
  7. 2025PaVeRL-SQL: Text-to-SQL via Partial-Match Rewards and Verbal Reinforcement Learning
  8. 2025ReEx-SQL: Reasoning with Execution-Aware Reinforcement Learning for Text-to-SQL