Boundary-Aware NL2SQL: Integrating Reliability through Hybrid Reward and Data Synthesis
On the map: Synthetic data and self-improvement for LLMs → Synthetic reasoning data and bootstrapping
Abstract (arXiv)
In this paper, we present BAR-SQL (Boundary-Aware Reliable NL2SQL), a unified training framework that embeds reliability and boundary awareness directly into the generation process. We introduce a Seed Mutation data synthesis paradigm that constructs a representative enterprise corpus, explicitly encompassing multi-step analytical queries alongside boundary cases including ambiguity and schema limitations. To ensure interpretability, we employ Knowledge-Grounded Reasoning Synthesis, which produces Chain-of-Thought traces explicitly anchored in schema metadata and business rules. The model is trained through a two-stage process: Supervised Fine-Tuning (SFT) followed by Reinforcement Learning via Group Relative Policy Optimization. We design a Task-Conditioned Hybrid Reward mechanism that simultaneously optimizes SQL execution accuracy-leveraging Abstract Syntax Tree analysis and dense result matching-and semantic precision in abstention responses. To evaluate reliability alongside generation accuracy, we construct and release Ent-SQL-Bench, which jointly assesse SQL precision and boundary-aware abstention across ambiguous and unanswerable queries. Experimental results on this benchmark demonstrate that BAR-SQL achieves 91.48% average accuracy, outperforming leading proprietary models, including Claude 4.5 Sonnet and GPT-5, in both SQL generation quality and boundary-aware abstention capability. The source code and benchmark are available anonymously at: https://github.com/TianSongS/BAR-SQL.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Synthetic reasoning data and bootstrapping, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 24 of its 38 references that are in the map. First posted on arXiv 15 Jan 2026.
Builds on
24 of 38 references.
References · 24
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2017Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learningcited by 679
- 2023Can LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLscited by 667
- 2023Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluationcited by 378
- 2023LEVER: Learning to Verify Language-to-Code Generation with Executioncited by 228
- 2024Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflowscited by 223
- 2020GraPPa: Grammar-Augmented Pre-Training for Table Semantic Parsingcited by 171
- 2019A Comprehensive Exploration on WikiSQL with Table-Aware Word Contextualizationcited by 88
- 2025DeepSeekMath-V2: Towards Self-Verifiable Mathematical Reasoningcited by 84
- 2020Grounded Adaptation for Zero-shot Executable Semantic Parsingcited by 76
- 2025SQL-R1: Training Natural Language to SQL Reasoning Model By Reinforcement Learningcited by 67
- 2018Memory Augmented Policy Optimization for Program Synthesis and Semantic Parsingcited by 57
12 more
- 2025OpenSearch-SQL: Enhancing Text-to-SQL with Dynamic Few-shot and Consistency Alignmentcited by 51
- 2023Dr.Spider: A Diagnostic Evaluation Benchmark towards Text-to-SQL Robustnesscited by 50
- 2023RCOT: Detecting and Rectifying Factual Inconsistency in Reasoning by Reversing Chain-of-Thoughtcited by 47
- 2021SADGA: Structure-Aware Dual Graph Aggregation Network for Text-to-SQLcited by 43
- 2022Importance of Synthesizing High-quality Data for Text-to-SQL Parsingcited by 27
- 2025ExCoT: Optimizing Reasoning for Text-to-SQL with Execution Feedbackcited by 23
- 2025Reliable Text-to-SQL with Adaptive Abstentioncited by 19
- 2024PRACTIQ: A Practical Conversational Text-to-SQL dataset with Ambiguous and Unanswerable Queriescited by 17
- 2024You Only Read Once (YORO): Learning to Internalize Database Knowledge for Text-to-SQLcited by 11
- 2025AmbiSQL: Interactive Ambiguity Detection and Resolution for Text-to-SQLcited by 10
- 2025RetrySQL: text-to-SQL training with retry data for self-correcting query generationcited by 2
- 2025HES-SQL: Hybrid Reasoning for Efficient Text-to-SQL with Structural Skeleton Guidancecited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Arctic-Text2SQL-R1: Simple Rewards, Strong Reasoning in Text-to-SQL
- 2025Thinkquel: A Model Dedicated to Text-to-dbt Using Synthetic Data and a Span-Aware Objective
- 2025JudgeSQL: Reasoning over SQL Candidates with Weighted Consensus Tournament
- 2026Progress-SQL: Improving Reinforcement Learning for Text-to-SQL via Progressive Rewards
- 2025CogniSQL-R1-Zero: Lightweight Reinforced Reasoning for Efficient SQL Generation
- 2025GradeSQL: Test-Time Inference with Outcome Reward Models for Text-to-SQL Generation from Large Language Models
- 2026EvolSQL: Structure-Aware Evolution for Scalable Text-to-SQL Data Synthesis
- 2025Text-to-SQL as Dual-State Reasoning: Integrating Adaptive Context and Progressive Generation