mlsanityData to 7 Oct 2026

LinkAlign: Scalable Schema Linking for Real-World Large-Scale Multi-Database Text-to-SQL

arXiv 2503.18596 ↗First posted 24 Mar 2025cs.CLcited by 26

Not on the map. Why?

Abstract (arXiv)

Schema linking is a critical bottleneck in applying existing Text-to-SQL models to real-world, large-scale, multi-database environments. Through error analysis, we identify two major challenges in schema linking: (1) Database Retrieval: accurately selecting the target database from a large schema pool, while effectively filtering out irrelevant ones; and (2) Schema Item Grounding: precisely identifying the relevant tables and columns within complex and often redundant schemas for SQL generation. Based on these, we introduce LinkAlign, a novel framework tailored for large-scale databases with thousands of fields. LinkAlign comprises three key steps: multi-round semantic enhanced retrieval and irrelevant information isolation for Challenge 1, and schema extraction enhancement for Challenge 2. Each stage supports both Agent and Pipeline execution modes, enabling balancing efficiency and performance via modular design. To enable more realistic evaluation, we construct AmbiDB, a synthetic dataset designed to reflect the ambiguity of real-world schema linking. Experiments on widely-used Text-to-SQL benchmarks demonstrate that LinkAlign consistently outperforms existing baselines on all schema linking metrics. Notably, it improves the overall Text-to-SQL pipeline and achieves a new state-of-the-art score of 33.09% on the Spider 2.0-Lite benchmark using only open-source LLMs, ranking first on the leaderboard at the time of submission. The codes are available at https://github.com/Satissss/LinkAlign

Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). Builds on 40 of its 65 references that are in the map. First posted on arXiv 24 Mar 2025.

Builds on

40 of 65 references.

References · 40

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  5. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  6. 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
  7. 2023AWQ: Activation-aware Weight Quantization for LLM Compression and Accelerationcited by 1,234
  8. 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,120
  9. 2023ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debatecited by 724
  10. 2023Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizescited by 710
  11. 2017Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learningcited by 679
  12. 2023Can LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLscited by 667
28 more
  1. 2023DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-Correctioncited by 465
  2. 2019RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parserscited by 420
  3. 2023Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruningcited by 408
  4. 2021PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Modelscited by 402
  5. 2024Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflowscited by 223
  6. 2019Towards Complex Text-to-SQL in Cross-Domain Database with Intermediate Representationcited by 210
  7. 2024CHESS: Contextual Harnessing for Efficient SQL Synthesiscited by 164
  8. 2023C3: Zero-shot Text-to-SQL with ChatGPTcited by 159
  9. 2023MAC-SQL: A Multi-Agent Collaborative Framework for Text-to-SQLcited by 158
  10. 2024CHASE-SQL: Multi-Path Reasoning and Preference Optimized Candidate Selection in Text-to-SQLcited by 132
  11. 2021LGESQL: Line Graph Enhanced Text-to-SQL Model with Mixed Local and Non-Local Relationscited by 119
  12. 2023A comprehensive evaluation of ChatGPT's zero-shot Text-to-SQL capabilitycited by 118
  13. 2024MCS-SQL: Leveraging Multiple Prompts and Multiple-Choice Selection For Text-to-SQL Generationcited by 103
  14. 2022RASAT: Integrating Relational Structures into Pretrained Seq2Seq Model for Text-to-SQLcited by 85
  15. 2024The Death of Schema Linking? Text-to-SQL in the Age of Well-Reasoned Language Modelscited by 67
  16. 2020RYANSQL: Recursively Applying Sketch-based Slot Fillings for Complex Text-to-SQL in Cross-Domain Databasescited by 63
  17. 2024RSL-SQL: Robust Schema Linking in Text-to-SQL Generationcited by 51
  18. 2024Before Generation, Align it! A Novel and Effective Strategy for Mitigating Hallucinations in Text-to-SQL Generationcited by 49
  19. 2019Global Reasoning over Database Structures for Text-to-SQL Parsingcited by 43
  20. 2021SADGA: Structure-Aware Dual Graph Aggregation Network for Text-to-SQLcited by 43
  21. 2023Do Emergent Abilities Exist in Quantized Large Language Models: An Empirical Studycited by 43
  22. 2023SQL-PaLM: Improved Large Language Model Adaptation for Text-to-SQL (extended)cited by 42
  23. 2021Enabling Lightweight Fine-tuning for Pre-trained Language Model Compression based on Matrix Product Operatorscited by 28
  24. 2024PET-SQL: A Prompt-Enhanced Two-Round Refinement of Text-to-SQL with Cross-consistencycited by 26
  25. 2017An Encoder-Decoder Framework Translating Natural Language to Database Queriescited by 23
  26. 2023Prompting GPT-3.5 for Text-to-SQL with De-semanticization and Skeleton Retrievalcited by 16
  27. 2024Solid-SQL: Enhanced Schema-linking based In-context Learning for Robust Text-to-SQLcited by 11
  28. 2024Unlocking Data-free Low-bit Quantization with Matrix Decomposition for KV Cache Compressioncited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 8; 2026: 18.

26 papers.

Sort:

By area:

  1. 2025AutoLink: Autonomous Schema Exploration and Expansion for Scalable Schema Linking in Text-to-SQL at Scalecited by 15
  2. 2026AgentSM: Semantic Memory for Agentic Text-to-SQLcited by 14
  3. 2025SchemaGraphSQL: Efficient Schema Linking with Pathfinding Graph Algorithms for Text-to-SQL on Large-Scale Databasescited by 3
  4. 2025DataSage: Multi-agent Collaboration for Insight Discovery with External Knowledge Retrieval, Multi-role Debating, and Multi-path Reasoningcited by 2
  5. 2025AGRO-SQL: Agentic Group-Relative Optimization with High-Fidelity Data Synthesiscited by 2
  6. 2025GBV-SQL: Guided Generation and SQL2Text Back-Translation Validation for Multi-Agent Text2SQLcited by 1
  7. 2025SteinerSQL: Graph-Guided Mathematical Reasoning for Text-to-SQL Generationcited by 1
  8. 2025Squrve: A Unified and Modular Framework for Complex Real-World Text-to-SQL Taskscited by 1
  9. 2026Beyond Static Pipelines: Learning Dynamic Workflows for Text-to-SQLcited by 1
  10. 2026Fine-Grained Table Retrieval Through the Lens of Complex Queriescited by 1
  11. 2026EviLink: Multi-Path Schema Linking with Uncertainty-Guided Evidence Acquisition for Large-Scale Text-to-SQLcited by 1
  12. 2026EXPO-SQL: Execution-based Clause-level Policy Optimization for Text-to-SQLcited by 1
14 more
  1. 2026Schema-First Retrieval: Embedding Catalogs for Natural Language Analyticscited by 1
  2. 2025AskDB: An LLM Agent for Natural Language Interaction with Relational Databasescited by 0
  3. 2026IESR:Efficient MCTS-Based Modular Reasoning for Text-to-SQL with Large Language Modelscited by 0
  4. 2026SemanticAgent: A Semantics-Aware Framework for Text-to-SQL Data Synthesiscited by 0
  5. 2026Toward Multi-Database Query Reasoning for Text2Cyphercited by 0
  6. 2026SIRIUS-SQL: Anchoring Multi-Candidate Text-to-SQL in Execution Feedbackcited by 0
  7. 2026CAPER: Clause-Aligned Process Supervision for Text-to-SQLcited by 0
  8. 2026ProSPy: A Profiling-Driven SQL-Python Agentic Framework for Enterprise Text-to-SQLcited by 0
  9. 2026Database Context Compression for Text-to-SQL on Real-World Large Databasescited by 0
  10. 2026AttnLink: Turning Attention into Schema Links for Text-to-SQLcited by 0
  11. 2026Factorized Hypothesis Search for Evidence-to-Taxonomy Retrievalcited by 0
  12. 2026MDB-Link: Hierarchical Schema Linking for Multi-Database Text-to-SQLcited by 0
  13. 2026Are These Modules Worth Their Cost? A Paradigm-Level Accuracy-Cost Analysis of In-context Learning Text-to-SQLcited by 0
  14. 2026BudgetSchemaBench: A Budget-Swept Diagnostic for Schema Context in Text-to-SQLcited by 0