JudgeSQL: Reasoning over SQL Candidates with Weighted Consensus Tournament
On the map: LLM reasoning → Knowledge- and tool-augmented reasoning
Abstract (arXiv)
Text-to-SQL is a pivotal task that bridges natural language understanding and structured data access, yet it remains fundamentally challenging due to semantic ambiguity and complex compositional reasoning. While large language models (LLMs) have greatly advanced SQL generation though prompting, supervised finetuning and reinforced tuning, the shift toward test-time scaling exposes a new bottleneck: selecting the correct query from a diverse candidate pool. Existing selection approaches, such as self-consistency or best-of-N decoding, provide only shallow signals, making them prone to inconsistent scoring, fragile reasoning chains, and a failure to capture fine-grained semantic distinctions between closely related SQL candidates. To this end, we introduce JudgeSQL, a principled framework that redefines SQL candidate selection through structured reasoning and weighted consensus tournament mechanism. JudgeSQL develops a reasoning-based SQL judge model that distills reasoning traces with reinforcement learning guided by verifiable rewards, enabling accurate and interpretable judgments. Building on this, a weighted consensus tournament integrates explicit reasoning preferences with implicit generator confidence, yielding selections that are both more reliable and more efficient. Extensive experiments on the BIRD benchmark demonstrate that JudgeSQL exhibits superior SQL judgment capabilities and good cross-scale generalization and robustness to generator capacity.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 6 of its 54 references that are in the map. First posted on arXiv 17 Oct 2025.
Builds on
6 of 54 references.
References · 6
- 2024GPT-4o System Cardcited by 4,588
- 2024Qwen2.5-Coder Technical Reportcited by 1,203
- 2024CHESS: Contextual Harnessing for Efficient SQL Synthesiscited by 169
- 2025J1: Incentivizing Thinking in LLM-as-a-Judge via Reinforcement Learningcited by 75
- 2018Semantic Parsing with Syntax- and Table-Aware SQL Generationcited by 17
- 2025Pi-SQL: Enhancing Text-to-SQL with Fine-Grained Guidance from Pivot Programming Languagescited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Arctic-Text2SQL-R1: Simple Rewards, Strong Reasoning in Text-to-SQL
- 2025CogniSQL-R1-Zero: Lightweight Reinforced Reasoning for Efficient SQL Generation
- 2025Reasoning-SQL: Reinforcement Learning with SQL Tailored Partial Rewards for Reasoning-Enhanced Text-to-SQL
- 2025RAISE: Reasoning Agent for Interactive SQL Exploration
- 2026Test-Time Verification for Text-to-SQL via Outcome Reward Models
- 2025STaR-SQL: Self-Taught Reasoner for Text-to-SQL
- 2025PaVeRL-SQL: Text-to-SQL via Partial-Match Rewards and Verbal Reinforcement Learning
- 2025GradeSQL: Test-Time Inference with Outcome Reward Models for Text-to-SQL Generation from Large Language Models