LinkAlign: Scalable Schema Linking for Real-World Large-Scale Multi-Database Text-to-SQL
Not on the map. Why?
Abstract (arXiv)
Schema linking is a critical bottleneck in applying existing Text-to-SQL models to real-world, large-scale, multi-database environments. Through error analysis, we identify two major challenges in schema linking: (1) Database Retrieval: accurately selecting the target database from a large schema pool, while effectively filtering out irrelevant ones; and (2) Schema Item Grounding: precisely identifying the relevant tables and columns within complex and often redundant schemas for SQL generation. Based on these, we introduce LinkAlign, a novel framework tailored for large-scale databases with thousands of fields. LinkAlign comprises three key steps: multi-round semantic enhanced retrieval and irrelevant information isolation for Challenge 1, and schema extraction enhancement for Challenge 2. Each stage supports both Agent and Pipeline execution modes, enabling balancing efficiency and performance via modular design. To enable more realistic evaluation, we construct AmbiDB, a synthetic dataset designed to reflect the ambiguity of real-world schema linking. Experiments on widely-used Text-to-SQL benchmarks demonstrate that LinkAlign consistently outperforms existing baselines on all schema linking metrics. Notably, it improves the overall Text-to-SQL pipeline and achieves a new state-of-the-art score of 33.09% on the Spider 2.0-Lite benchmark using only open-source LLMs, ranking first on the leaderboard at the time of submission. The codes are available at https://github.com/Satissss/LinkAlign
Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). Builds on 40 of its 65 references that are in the map. First posted on arXiv 24 Mar 2025.
Builds on
40 of 65 references.
References · 40
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
- 2023AWQ: Activation-aware Weight Quantization for LLM Compression and Accelerationcited by 1,234
- 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,120
- 2023ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debatecited by 724
- 2023Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizescited by 710
- 2017Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learningcited by 679
- 2023Can LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLscited by 667
28 more
- 2023DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-Correctioncited by 465
- 2019RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parserscited by 420
- 2023Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruningcited by 408
- 2021PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Modelscited by 402
- 2024Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflowscited by 223
- 2019Towards Complex Text-to-SQL in Cross-Domain Database with Intermediate Representationcited by 210
- 2024CHESS: Contextual Harnessing for Efficient SQL Synthesiscited by 164
- 2023C3: Zero-shot Text-to-SQL with ChatGPTcited by 159
- 2023MAC-SQL: A Multi-Agent Collaborative Framework for Text-to-SQLcited by 158
- 2024CHASE-SQL: Multi-Path Reasoning and Preference Optimized Candidate Selection in Text-to-SQLcited by 132
- 2021LGESQL: Line Graph Enhanced Text-to-SQL Model with Mixed Local and Non-Local Relationscited by 119
- 2023A comprehensive evaluation of ChatGPT's zero-shot Text-to-SQL capabilitycited by 118
- 2024MCS-SQL: Leveraging Multiple Prompts and Multiple-Choice Selection For Text-to-SQL Generationcited by 103
- 2022RASAT: Integrating Relational Structures into Pretrained Seq2Seq Model for Text-to-SQLcited by 85
- 2024The Death of Schema Linking? Text-to-SQL in the Age of Well-Reasoned Language Modelscited by 67
- 2020RYANSQL: Recursively Applying Sketch-based Slot Fillings for Complex Text-to-SQL in Cross-Domain Databasescited by 63
- 2024RSL-SQL: Robust Schema Linking in Text-to-SQL Generationcited by 51
- 2024Before Generation, Align it! A Novel and Effective Strategy for Mitigating Hallucinations in Text-to-SQL Generationcited by 49
- 2019Global Reasoning over Database Structures for Text-to-SQL Parsingcited by 43
- 2021SADGA: Structure-Aware Dual Graph Aggregation Network for Text-to-SQLcited by 43
- 2023Do Emergent Abilities Exist in Quantized Large Language Models: An Empirical Studycited by 43
- 2023SQL-PaLM: Improved Large Language Model Adaptation for Text-to-SQL (extended)cited by 42
- 2021Enabling Lightweight Fine-tuning for Pre-trained Language Model Compression based on Matrix Product Operatorscited by 28
- 2024PET-SQL: A Prompt-Enhanced Two-Round Refinement of Text-to-SQL with Cross-consistencycited by 26
- 2017An Encoder-Decoder Framework Translating Natural Language to Database Queriescited by 23
- 2023Prompting GPT-3.5 for Text-to-SQL with De-semanticization and Skeleton Retrievalcited by 16
- 2024Solid-SQL: Enhanced Schema-linking based In-context Learning for Robust Text-to-SQLcited by 11
- 2024Unlocking Data-free Low-bit Quantization with Matrix Decomposition for KV Cache Compressioncited by 7
Built on by
Citing papers per year: 2025: 8; 2026: 18.
26 papers.
Sort:
By area:
- 2025AutoLink: Autonomous Schema Exploration and Expansion for Scalable Schema Linking in Text-to-SQL at Scalecited by 15
- 2026AgentSM: Semantic Memory for Agentic Text-to-SQLcited by 14
- 2025SchemaGraphSQL: Efficient Schema Linking with Pathfinding Graph Algorithms for Text-to-SQL on Large-Scale Databasescited by 3
- 2025DataSage: Multi-agent Collaboration for Insight Discovery with External Knowledge Retrieval, Multi-role Debating, and Multi-path Reasoningcited by 2
- 2025AGRO-SQL: Agentic Group-Relative Optimization with High-Fidelity Data Synthesiscited by 2
- 2025GBV-SQL: Guided Generation and SQL2Text Back-Translation Validation for Multi-Agent Text2SQLcited by 1
- 2025SteinerSQL: Graph-Guided Mathematical Reasoning for Text-to-SQL Generationcited by 1
- 2025Squrve: A Unified and Modular Framework for Complex Real-World Text-to-SQL Taskscited by 1
- 2026Beyond Static Pipelines: Learning Dynamic Workflows for Text-to-SQLcited by 1
- 2026Fine-Grained Table Retrieval Through the Lens of Complex Queriescited by 1
- 2026EviLink: Multi-Path Schema Linking with Uncertainty-Guided Evidence Acquisition for Large-Scale Text-to-SQLcited by 1
- 2026EXPO-SQL: Execution-based Clause-level Policy Optimization for Text-to-SQLcited by 1
14 more
- 2026Schema-First Retrieval: Embedding Catalogs for Natural Language Analyticscited by 1
- 2025AskDB: An LLM Agent for Natural Language Interaction with Relational Databasescited by 0
- 2026IESR:Efficient MCTS-Based Modular Reasoning for Text-to-SQL with Large Language Modelscited by 0
- 2026SemanticAgent: A Semantics-Aware Framework for Text-to-SQL Data Synthesiscited by 0
- 2026Toward Multi-Database Query Reasoning for Text2Cyphercited by 0
- 2026SIRIUS-SQL: Anchoring Multi-Candidate Text-to-SQL in Execution Feedbackcited by 0
- 2026CAPER: Clause-Aligned Process Supervision for Text-to-SQLcited by 0
- 2026ProSPy: A Profiling-Driven SQL-Python Agentic Framework for Enterprise Text-to-SQLcited by 0
- 2026Database Context Compression for Text-to-SQL on Real-World Large Databasescited by 0
- 2026AttnLink: Turning Attention into Schema Links for Text-to-SQLcited by 0
- 2026Factorized Hypothesis Search for Evidence-to-Taxonomy Retrievalcited by 0
- 2026MDB-Link: Hierarchical Schema Linking for Multi-Database Text-to-SQLcited by 0
- 2026Are These Modules Worth Their Cost? A Paradigm-Level Accuracy-Cost Analysis of In-context Learning Text-to-SQLcited by 0
- 2026BudgetSchemaBench: A Budget-Swept Diagnostic for Schema Context in Text-to-SQLcited by 0
- 2026BudgetSchemaBench: A Budget-Swept Diagnostic for Schema Context in Text-to-SQL8 Sep 2026
- 2026Are These Modules Worth Their Cost? A Paradigm-Level Accuracy-Cost Analysis of In-context Learning Text-to-SQL28 Aug 2026
- 2026MDB-Link: Hierarchical Schema Linking for Multi-Database Text-to-SQL10 Aug 2026
- 2026Factorized Hypothesis Search for Evidence-to-Taxonomy Retrieval6 Aug 2026
- 2026AttnLink: Turning Attention into Schema Links for Text-to-SQL1 Aug 2026
- 2026Database Context Compression for Text-to-SQL on Real-World Large Databases26 Jun 2026
- 2026Schema-First Retrieval: Embedding Catalogs for Natural Language Analytics23 Jun 2026
- 2026ProSPy: A Profiling-Driven SQL-Python Agentic Framework for Enterprise Text-to-SQL4 Jun 2026
- 2026CAPER: Clause-Aligned Process Supervision for Text-to-SQL2 Jun 2026
- 2026SIRIUS-SQL: Anchoring Multi-Candidate Text-to-SQL in Execution Feedback31 May 2026
- 2026EviLink: Multi-Path Schema Linking with Uncertainty-Guided Evidence Acquisition for Large-Scale Text-to-SQL28 May 2026
- 2026Toward Multi-Database Query Reasoning for Text2Cypher11 May 2026
14 more
- 2026EXPO-SQL: Execution-based Clause-level Policy Optimization for Text-to-SQL29 Apr 2026
- 2026SemanticAgent: A Semantics-Aware Framework for Text-to-SQL Data Synthesis23 Apr 2026
- 2026Fine-Grained Table Retrieval Through the Lens of Complex Queries7 Mar 2026
- 2026Beyond Static Pipelines: Learning Dynamic Workflows for Text-to-SQL17 Feb 2026
- 2026IESR:Efficient MCTS-Based Modular Reasoning for Text-to-SQL with Large Language Models5 Feb 2026
- 2026AgentSM: Semantic Memory for Agentic Text-to-SQL22 Jan 2026
- 2025AGRO-SQL: Agentic Group-Relative Optimization with High-Fidelity Data Synthesis29 Dec 2025
- 2025AutoLink: Autonomous Schema Exploration and Expansion for Scalable Schema Linking in Text-to-SQL at Scale21 Nov 2025
- 2025AskDB: An LLM Agent for Natural Language Interaction with Relational Databases20 Nov 2025
- 2025DataSage: Multi-agent Collaboration for Insight Discovery with External Knowledge Retrieval, Multi-role Debating, and Multi-path Reasoning18 Nov 2025
- 2025Squrve: A Unified and Modular Framework for Complex Real-World Text-to-SQL Tasks28 Oct 2025
- 2025SteinerSQL: Graph-Guided Mathematical Reasoning for Text-to-SQL Generation23 Sep 2025
- 2025GBV-SQL: Guided Generation and SQL2Text Back-Translation Validation for Multi-Agent Text2SQL16 Sep 2025
- 2025SchemaGraphSQL: Efficient Schema Linking with Pathfinding Graph Algorithms for Text-to-SQL on Large-Scale Databases23 May 2025
- 2025DataSage: Multi-agent Collaboration for Insight Discovery with External Knowledge Retrieval, Multi-role Debating, and Multi-path Reasoningcited by 2
- 2025AGRO-SQL: Agentic Group-Relative Optimization with High-Fidelity Data Synthesiscited by 2
- 2025SteinerSQL: Graph-Guided Mathematical Reasoning for Text-to-SQL Generationcited by 1
- 2026IESR:Efficient MCTS-Based Modular Reasoning for Text-to-SQL with Large Language Modelscited by 0
- 2026Toward Multi-Database Query Reasoning for Text2Cyphercited by 0
- 2026Toward Multi-Database Query Reasoning for Text2Cypher11 May 2026
- 2026IESR:Efficient MCTS-Based Modular Reasoning for Text-to-SQL with Large Language Models5 Feb 2026
- 2025AGRO-SQL: Agentic Group-Relative Optimization with High-Fidelity Data Synthesis29 Dec 2025
- 2025DataSage: Multi-agent Collaboration for Insight Discovery with External Knowledge Retrieval, Multi-role Debating, and Multi-path Reasoning18 Nov 2025
- 2025SteinerSQL: Graph-Guided Mathematical Reasoning for Text-to-SQL Generation23 Sep 2025
- 2026AgentSM: Semantic Memory for Agentic Text-to-SQLcited by 14
- 2025GBV-SQL: Guided Generation and SQL2Text Back-Translation Validation for Multi-Agent Text2SQLcited by 1
- 2025AskDB: An LLM Agent for Natural Language Interaction with Relational Databasescited by 0
- 2026ProSPy: A Profiling-Driven SQL-Python Agentic Framework for Enterprise Text-to-SQLcited by 0
- 2026ProSPy: A Profiling-Driven SQL-Python Agentic Framework for Enterprise Text-to-SQL4 Jun 2026
- 2026AgentSM: Semantic Memory for Agentic Text-to-SQL22 Jan 2026
- 2025AskDB: An LLM Agent for Natural Language Interaction with Relational Databases20 Nov 2025
- 2025GBV-SQL: Guided Generation and SQL2Text Back-Translation Validation for Multi-Agent Text2SQL16 Sep 2025
- 2025AutoLink: Autonomous Schema Exploration and Expansion for Scalable Schema Linking in Text-to-SQL at Scalecited by 15
- 2025SchemaGraphSQL: Efficient Schema Linking with Pathfinding Graph Algorithms for Text-to-SQL on Large-Scale Databasescited by 3
- 2025Squrve: A Unified and Modular Framework for Complex Real-World Text-to-SQL Taskscited by 1
- 2026Beyond Static Pipelines: Learning Dynamic Workflows for Text-to-SQLcited by 1
- 2026Fine-Grained Table Retrieval Through the Lens of Complex Queriescited by 1
- 2026EviLink: Multi-Path Schema Linking with Uncertainty-Guided Evidence Acquisition for Large-Scale Text-to-SQLcited by 1
- 2026EXPO-SQL: Execution-based Clause-level Policy Optimization for Text-to-SQLcited by 1
- 2026Schema-First Retrieval: Embedding Catalogs for Natural Language Analyticscited by 1
- 2026SemanticAgent: A Semantics-Aware Framework for Text-to-SQL Data Synthesiscited by 0
- 2026SIRIUS-SQL: Anchoring Multi-Candidate Text-to-SQL in Execution Feedbackcited by 0
- 2026Database Context Compression for Text-to-SQL on Real-World Large Databasescited by 0
- 2026AttnLink: Turning Attention into Schema Links for Text-to-SQLcited by 0
12 most cited of 16 All 16 (JSON)
- 2026BudgetSchemaBench: A Budget-Swept Diagnostic for Schema Context in Text-to-SQL8 Sep 2026
- 2026Are These Modules Worth Their Cost? A Paradigm-Level Accuracy-Cost Analysis of In-context Learning Text-to-SQL28 Aug 2026
- 2026MDB-Link: Hierarchical Schema Linking for Multi-Database Text-to-SQL10 Aug 2026
- 2026Factorized Hypothesis Search for Evidence-to-Taxonomy Retrieval6 Aug 2026
- 2026AttnLink: Turning Attention into Schema Links for Text-to-SQL1 Aug 2026
- 2026Database Context Compression for Text-to-SQL on Real-World Large Databases26 Jun 2026
- 2026Schema-First Retrieval: Embedding Catalogs for Natural Language Analytics23 Jun 2026
- 2026SIRIUS-SQL: Anchoring Multi-Candidate Text-to-SQL in Execution Feedback31 May 2026
- 2026EviLink: Multi-Path Schema Linking with Uncertainty-Guided Evidence Acquisition for Large-Scale Text-to-SQL28 May 2026
- 2026EXPO-SQL: Execution-based Clause-level Policy Optimization for Text-to-SQL29 Apr 2026
- 2026SemanticAgent: A Semantics-Aware Framework for Text-to-SQL Data Synthesis23 Apr 2026
- 2026Fine-Grained Table Retrieval Through the Lens of Complex Queries7 Mar 2026
12 newest of 16 All 16 (JSON)