SQL-Trail: Multi-Turn Reinforcement Learning with Interleaved Feedback for Text-to-SQL
Not on the map. Why?
Abstract (arXiv)
While large language models (LLMs) have substantially improved Text-to-SQL generation, a pronounced gap remains between AI systems and human experts on challenging benchmarks such as BIRD-SQL. We argue this gap stems largely from the prevailing single-pass paradigm, which lacks the iterative reasoning, schema exploration, and error-correction behaviors that humans naturally employ. To address this limitation, we introduce SQL-Trail, a multi-turn reinforcement learning (RL) agentic framework for Text-to-SQL. Rather than producing a query in one shot, SQL-Trail interacts with the database environment and uses execution feedback to iteratively refine its predictions. Our approach centers on two key ideas: (i) an adaptive turn-budget allocation mechanism that scales the agent's interaction depth to match question difficulty, and (ii) a composite reward panel that jointly incentivizes SQL correctness and efficient exploration. Across benchmarks, SQL-Trail sets a new state of the art and delivers strong data efficiency--up to 18x higher than prior single-pass RL state-of-the-art methods. Notably, our 7B and 14B models outperform substantially larger proprietary systems by 5% on average, underscoring the effectiveness of interactive, agentic workflows for robust Text-to-SQL generation.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 25 of its 42 references that are in the map. First posted on arXiv 25 Jan 2026.
Builds on
25 of 42 references.
References · 25
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,371
- 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,120
- 2017Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learningcited by 679
- 2023Can LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLscited by 667
- 2023DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-Correctioncited by 465
- 2021PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Modelscited by 402
- 2025SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolutioncited by 246
- 2023RESDSQL: Decoupling Schema Linking and Skeleton Parsing for Text-to-SQLcited by 191
- 2025WebAgent-R1: Training Web Agents via End-to-End Multi-Turn Reinforcement Learningcited by 162
13 more
- 2023MAC-SQL: A Multi-Agent Collaborative Framework for Text-to-SQLcited by 158
- 2017SQLNet: Generating Structured Queries From Natural Language Without Reinforcement Learningcited by 135
- 2024CHASE-SQL: Multi-Path Reasoning and Preference Optimized Candidate Selection in Text-to-SQLcited by 132
- 2020Structure-Grounded Pretraining for Text-to-SQLcited by 126
- 2021Towards Robustness of Text-to-SQL Models against Synonym Substitutioncited by 110
- 2021Exploring Underexplored Limitations of Cross-Domain Text-to-SQL Generalizationcited by 92
- 2025SQL-R1: Training Natural Language to SQL Reasoning Model By Reinforcement Learningcited by 67
- 2025In-the-Flow Agentic System Optimization for Effective Planning and Tool Usecited by 67
- 2023ACT-SQL: In-Context Learning for Text-to-SQL with Automatically-Generated Chain-of-Thoughtcited by 65
- 2020Speak to your Parser: Interactive Text-to-SQL with Natural Language Feedbackcited by 44
- 2023SQLPrompt: In-Context Text-to-SQL with Minimal Labeled Datacited by 16
- 2023Semantic Decomposition of Question and SQL for Text-to-SQL Parsingcited by 13
- 2021Unbiased Methods for Multi-Goal Reinforcement Learningcited by 7
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026ReSkill: Reconciling Skill Creation with Policy Optimization in Agentic RLcited by 13
- 2026DataSTORM: Deep Research on Large-Scale Databases using Exploratory Data Analysis and Data Storytellingcited by 7
- 2026TRUST-SQL: Tool-Integrated Multi-Turn Reinforcement Learning for Text-to-SQL over Unknown Schemascited by 2
- 2026BAP-SQL: Budget-Aware Observation Planning for Agentic Text-to-SQLcited by 1
- 2026COAL-SQL: Coverage-Guided Augmentation and Failure-Driven Learning for Text-to-SQL Post-Trainingcited by 0
- 2026LIMIT: Less Is More for Instruction Tuning in Text-to-SQLcited by 0
- 2026Towards Reliable AI Data Scientists: Data Agents with Workflow Harnessescited by 0
- 2026Towards Reliable AI Data Scientists: Data Agents with Workflow Harnesses28 Sep 2026
- 2026LIMIT: Less Is More for Instruction Tuning in Text-to-SQL21 Sep 2026
- 2026COAL-SQL: Coverage-Guided Augmentation and Failure-Driven Learning for Text-to-SQL Post-Training4 Aug 2026
- 2026BAP-SQL: Budget-Aware Observation Planning for Agentic Text-to-SQL3 Aug 2026
- 2026ReSkill: Reconciling Skill Creation with Policy Optimization in Agentic RL1 Jun 2026
- 2026DataSTORM: Deep Research on Large-Scale Databases using Exploratory Data Analysis and Data Storytelling7 Apr 2026
- 2026TRUST-SQL: Tool-Integrated Multi-Turn Reinforcement Learning for Text-to-SQL over Unknown Schemas17 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026Progress-SQL: Improving Reinforcement Learning for Text-to-SQL via Progressive Rewards
- 2025MARS-SQL: A multi-agent reinforcement learning framework for Text-to-SQL
- 2025Reasoning-SQL: Reinforcement Learning with SQL Tailored Partial Rewards for Reasoning-Enhanced Text-to-SQL
- 2025MTIR-SQL: Multi-turn Tool-Integrated Reasoning Reinforcement Learning for Text-to-SQL
- 2026ReToolSQL: Agentic Reinforcement Learning for Robust Text-to-SQL
- 2026DualSQL: Text-to-SQL with Multi-Agent Reinforcement Learning
- 2026SERL-SQL: Selective Hindsight Distillation for Text-to-SQL Reinforcement Agentic Learning
- 2025Arctic-Text2SQL-R1: Simple Rewards, Strong Reasoning in Text-to-SQL