A Comprehensive Exploration on WikiSQL with Table-Aware Word Contextualization
Not on the map. Why?
Abstract (arXiv)
We present SQLova, the first Natural-language-to-SQL (NL2SQL) model to achieve human performance in WikiSQL dataset. We revisit and discuss diverse popular methods in NL2SQL literature, take a full advantage of BERT {Devlin et al., 2018) through an effective table contextualization method, and coherently combine them, outperforming the previous state of the art by 8.2% and 2.5% in logical form and execution accuracy, respectively. We particularly note that BERT with a seq2seq decoder leads to a poor performance in the task, indicating the importance of a careful design when using such large pretrained models. We also provide a comprehensive analysis on the dataset and our model, which can be helpful for designing future NL2SQL datsets and models. We especially show that our model's performance is near the upper bound in WikiSQL, where we observe that a large portion of the evaluation errors are due to wrong annotations, and our model is already exceeding human performance by 1.3% in execution accuracy.
Key facts. Cited by 88 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Feb 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 20; 2023: 15; 2024: 16; 2025: 13; 2026: 7.
88 papers.
Sort:
By area:
- 2023DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-Correctioncited by 465
- 2022UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Modelscited by 231
- 2024CHASE-SQL: Multi-Path Reasoning and Preference Optimized Candidate Selection in Text-to-SQLcited by 132
- 2021Case-based Reasoning for Natural Language Queries over Knowledge Basescited by 107
- 2022RASAT: Integrating Relational Structures into Pretrained Seq2Seq Model for Text-to-SQLcited by 85
- 2023Unifying the Perspectives of NLP and Software Engineering: A Survey on Language Models for Codecited by 62
- 2022Don't Generate, Discriminate: A Proposal for Grounding Language Models to Real-World Environmentscited by 57
- 2022A Survey on Text-to-SQL Parsing: Concepts, Methods, and Future Directionscited by 51
- 2022ArcaneQA: Dynamic Program Induction and Contextualized Encoding for Knowledge Base Question Answeringcited by 48
- 2022Recent Advances in Text-to-SQL: A Survey of What We Have and What We Expectcited by 47
- 2021SADGA: Structure-Aware Dual Graph Aggregation Network for Text-to-SQLcited by 43
- 2023ScienceBenchmark: A Complex Real-World Benchmark for Evaluating Natural Language to SQL Systemscited by 42
38 more
- 2022A Survey on Table Question Answering: Recent Advancescited by 41
- 2024Tables as Texts or Images: Evaluating the Table Reasoning Ability of LLMs and MLLMscited by 40
- 2024Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environmentscited by 39
- 2021Data Augmentation with Hierarchical SQL-to-Question Generation for Cross-domain Text-to-SQL Parsingcited by 32
- 2024SQLBench: A Comprehensive Evaluation for Text-to-SQL Capabilities of Large Language Modelscited by 32
- 2021Awakening Latent Grounding from Pretrained Language Models for Semantic Parsingcited by 28
- 2022Towards Robustness of Text-to-SQL Models Against Natural and Realistic Adversarial Table Perturbationcited by 28
- 2021SeaD: End-to-end Text-to-SQL Generation with Schema-aware Denoisingcited by 27
- 2023Natural Language Interfaces for Tabular Data Querying and Visualization: A Surveycited by 27
- 2021Improving Text-to-SQL with Schema Dependency Learningcited by 25
- 2021Dual Reader-Parser on Hybrid Textual and Tabular Evidence for Open Domain Question Answeringcited by 25
- 2022Knowledge Base Question Answering: A Semantic Parsing Perspectivecited by 22
- 2024MAG-SQL: Multi-Agent Generative Approach with Soft Schema Linking and Iterative Sub-SQL Refinement for Text-to-SQLcited by 22
- 2021Representations for Question Answering from Documents with Tables and Textcited by 21
- 2022UniSAr: A Unified Structure-Aware Autoregressive Language Model for Text-to-SQLcited by 20
- 2023Interactive Text-to-SQL Generation via Editable Step-by-Step Explanationscited by 19
- 2022Uni-Parser: Unified Semantic Parser for Question Answering on Knowledge Base and Databasecited by 16
- 2025STaR-SQL: Self-Taught Reasoner for Text-to-SQLcited by 16
- 2021Dynamic Hybrid Relation Network for Cross-Domain Context-Dependent Semantic Parsingcited by 15
- 2025Understanding, Detecting, and Repairing Real-World In-Context-Learning-Based Text-to-SQL Errorscited by 14
- 2022GraphQ IR: Unifying the Semantic Parsing of Graph Query Languages with One Intermediate Representationcited by 13
- 2023Semantic Decomposition of Question and SQL for Text-to-SQL Parsingcited by 13
- 2021Structured Context and High-Coverage Grammar for Conversational Question Answering over Knowledge Graphscited by 10
- 2024SQLucid: Grounding Natural Language Database Queries with Interactive Explanationscited by 10
- 2021Question Answering for Complex Electronic Health Records Database using Unified Encoder-Decoder Architecturecited by 9
- 2024A Survey of Large Language Model-Based Generative AI for Text-to-SQL: Benchmarks, Applications, Use Cases, and Challengescited by 9
- 2021Reading StackOverflow Encourages Cheating: Adding Question Text Improves Extractive Code Generationcited by 8
- 2022Learn from Yesterday: A Semi-Supervised Continual Learning Method for Supervision-Limited Text-to-SQL Task Streamscited by 7
- 2024MFORT-QA: Multi-hop Few-shot Open Rich Table Question Answeringcited by 7
- 2024LG AI Research & KAIST at EHRSQL 2024: Self-Training Large Language Models with Pseudo-Labeled Unanswerable Questions for a Reliable Text-to-SQL System on EHRscited by 7
- 2022Optimization Techniques for Unsupervised Complex Table Reasoning via Self-Training Frameworkcited by 6
- 2024Unmasking Database Vulnerabilities: Zero-Knowledge Schema Inference Attacks in Text-to-SQL Systemscited by 6
- 2025Text-to-SQL Domain Adaptation via Human-LLM Collaborative Data Annotationcited by 6
- 2021Pay More Attention to History: A Context Modelling Strategy for Conversational Text-to-SQLcited by 5
- 2022Unveiling the Black Box of PLMs with Semantic Anchors: Towards Interpretable Neural Semantic Parsingcited by 5
- 2023Parameterizing Context: Unleashing the Power of Parameter-Efficient Fine-Tuning and In-Context Tuning for Continual Table Semantic Parsingcited by 5
- 2022From Examples to Rules: Neural Guided Rule Synthesis for Information Extractioncited by 4
- 2024Redefining Information Retrieval of Structured Database via Large Language Modelscited by 4
50 most cited of 88 All 88 (JSON)
- 2026Agentic-SQL Revisited: Autonomy-Based Taxonomy and Empirical Benchmark Analysis for LLM Text-to-SQL15 Aug 2026
- 2026The Nuts and Bolts of Natural Language to SQL Translation: A Systematic Analysis of Model Pipeline Optimisation Approaches and their Interactions12 Jul 2026
- 2026CHS-SQL: A Text-to-SQL approach based on Confidence-Guided Heuristic Search Schema Linking process17 Jun 2026
- 2026Natural Language Interfaces for Spatial and Temporal Databases: A Comprehensive Overview of Methods, Taxonomy, and Future Directions24 Mar 2026
- 2026OmniZip: Learning a Unified and Lightweight Lossless Compressor for Multi-Modal Data25 Feb 2026
- 2026Boundary-Aware NL2SQL: Integrating Reliability through Hybrid Reward and Data Synthesis15 Jan 2026
- 2026Cluster Workload Allocation: Semantic Soft Affinity Using Natural Language Processing14 Jan 2026
- 2025Prompt Tuning for Natural Language to SQL with Embedding Fine-Tuning and RAG11 Nov 2025
- 2025GeoSQL-Eval: First Evaluation of LLMs on PostGIS-Based NL2GeoSQL Queries28 Sep 2025
- 2025LLMSQL: Upgrading WikiSQL for the LLM Era of Text-to-SQL27 Sep 2025
- 2025A State-of-the-Art SQL Reasoning Model using RLVR25 Sep 2025
- 2025MRT at IberLEF-2025 PRESTA Task: Maximizing Recovery from Tables with Multiple Steps17 Jul 2025
38 more
- 2025RetrySQL: text-to-SQL training with retry data for self-correcting query generation3 Jul 2025
- 2025HI-SQL: Optimizing Text-to-SQL Systems through Dynamic Hint Integration11 Jun 2025
- 2025SDE-SQL: Enhancing Text-to-SQL Generation in Large Language Models via Self-Driven Exploration with SQL Probes8 Jun 2025
- 2025MRT at SemEval-2025 Task 8: Maximizing Recovery from Tables with Multiple Steps28 May 2025
- 2025Text-to-SQL Domain Adaptation via Human-LLM Collaborative Data Annotation21 Feb 2025
- 2025STaR-SQL: Self-Taught Reasoner for Text-to-SQL19 Feb 2025
- 2025What Really Matters for Table LLMs? A Meta-Evaluation of Model and Data Effects24 Jan 2025
- 2025Understanding, Detecting, and Repairing Real-World In-Context-Learning-Based Text-to-SQL Errors16 Jan 2025
- 2024Evaluating and Enhancing LLMs for Multi-turn Text-to-SQL with Multiple Question Types21 Dec 2024
- 2024A Survey of Large Language Model-Based Generative AI for Text-to-SQL: Benchmarks, Applications, Use Cases, and Challenges6 Dec 2024
- 2024FathomGPT: A Natural Language Interface for Interactively Exploring Ocean Science Data3 Dec 2024
- 2024CHASE-SQL: Multi-Path Reasoning and Preference Optimized Candidate Selection in Text-to-SQL2 Oct 2024
- 2024Contextual Breach: Assessing the Robustness of Transformer-based QA Models17 Sep 2024
- 2024SQLucid: Grounding Natural Language Database Queries with Interactive Explanations10 Sep 2024
- 2024MAG-SQL: Multi-Agent Generative Approach with Soft Schema Linking and Iterative Sub-SQL Refinement for Text-to-SQL15 Aug 2024
- 2024AnnotatedTables: A Large Tabular Dataset with Language Model Annotations24 Jun 2024
- 2024Unmasking Database Vulnerabilities: Zero-Knowledge Schema Inference Attacks in Text-to-SQL Systems20 Jun 2024
- 2024LG AI Research & KAIST at EHRSQL 2024: Self-Training Large Language Models with Pseudo-Labeled Unanswerable Questions for a Reliable Text-to-SQL System on EHRs18 May 2024
- 2024Redefining Information Retrieval of Structured Database via Large Language Models9 May 2024
- 2024MFORT-QA: Multi-hop Few-shot Open Rich Table Question Answering28 Mar 2024
- 2024SQLBench: A Comprehensive Evaluation for Text-to-SQL Capabilities of Large Language Models5 Mar 2024
- 2024Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments22 Feb 2024
- 2024Tables as Texts or Images: Evaluating the Table Reasoning Ability of LLMs and MLLMs19 Feb 2024
- 2024BERTologyNavigator: Advanced Question Answering with BERT-based Semantics17 Jan 2024
- 2023Semantic Parsing for Complex Data Retrieval: Targeting Query Plans vs. SQL for No-Code Access to Relational Databases22 Dec 2023
- 2023Translating Natural Language Queries to SQL Using the T5 Model12 Dec 2023
- 2023Decoupling SQL Query Hardness Parsing for Text-to-SQL11 Dec 2023
- 2023Unifying the Perspectives of NLP and Software Engineering: A Survey on Language Models for Code14 Nov 2023
- 2023Perturbation-based Active Learning for Question Answering4 Nov 2023
- 2023SQLformer: Deep Auto-Regressive Query Graph Generation for Text-to-SQL Translation27 Oct 2023
- 2023Natural Language Interfaces for Tabular Data Querying and Visualization: A Survey27 Oct 2023
- 2023Semantic Decomposition of Question and SQL for Text-to-SQL Parsing20 Oct 2023
- 2023Parameterizing Context: Unleashing the Power of Parameter-Efficient Fine-Tuning and In-Context Tuning for Continual Table Semantic Parsing7 Oct 2023
- 2023Feature Representation Learning for NL2SQL Generation Based on Coupling and Decoupling30 Jun 2023
- 2023ScienceBenchmark: A Complex Real-World Benchmark for Evaluating Natural Language to SQL Systems7 Jun 2023
- 2023Interactive Text-to-SQL Generation via Editable Step-by-Step Explanations12 May 2023
- 2023DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-Correction21 Apr 2023
- 2023Conversational Text-to-SQL: An Odyssey into State-of-the-Art and Challenges Ahead21 Feb 2023
50 newest of 88 All 88 (JSON)
- 2024CHASE-SQL: Multi-Path Reasoning and Preference Optimized Candidate Selection in Text-to-SQLcited by 132
- 2024Tables as Texts or Images: Evaluating the Table Reasoning Ability of LLMs and MLLMscited by 40
- 2025STaR-SQL: Self-Taught Reasoner for Text-to-SQLcited by 16
- 2025A State-of-the-Art SQL Reasoning Model using RLVRcited by 4
- 2025A State-of-the-Art SQL Reasoning Model using RLVR25 Sep 2025
- 2025STaR-SQL: Self-Taught Reasoner for Text-to-SQL19 Feb 2025
- 2024CHASE-SQL: Multi-Path Reasoning and Preference Optimized Candidate Selection in Text-to-SQL2 Oct 2024
- 2024Tables as Texts or Images: Evaluating the Table Reasoning Ability of LLMs and MLLMs19 Feb 2024
- 2024Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environmentscited by 39
- 2024MAG-SQL: Multi-Agent Generative Approach with Soft Schema Linking and Iterative Sub-SQL Refinement for Text-to-SQLcited by 22
- 2026Agentic-SQL Revisited: Autonomy-Based Taxonomy and Empirical Benchmark Analysis for LLM Text-to-SQLcited by 1
- 2026Agentic-SQL Revisited: Autonomy-Based Taxonomy and Empirical Benchmark Analysis for LLM Text-to-SQL15 Aug 2026
- 2024MAG-SQL: Multi-Agent Generative Approach with Soft Schema Linking and Iterative Sub-SQL Refinement for Text-to-SQL15 Aug 2024
- 2024Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments22 Feb 2024
- 2023DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-Correctioncited by 465
- 2022UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Modelscited by 231
- 2021Case-based Reasoning for Natural Language Queries over Knowledge Basescited by 107
- 2022RASAT: Integrating Relational Structures into Pretrained Seq2Seq Model for Text-to-SQLcited by 85
- 2023Unifying the Perspectives of NLP and Software Engineering: A Survey on Language Models for Codecited by 62
- 2022Don't Generate, Discriminate: A Proposal for Grounding Language Models to Real-World Environmentscited by 57
- 2022A Survey on Text-to-SQL Parsing: Concepts, Methods, and Future Directionscited by 51
- 2022ArcaneQA: Dynamic Program Induction and Contextualized Encoding for Knowledge Base Question Answeringcited by 48
- 2022Recent Advances in Text-to-SQL: A Survey of What We Have and What We Expectcited by 47
- 2021SADGA: Structure-Aware Dual Graph Aggregation Network for Text-to-SQLcited by 43
- 2023ScienceBenchmark: A Complex Real-World Benchmark for Evaluating Natural Language to SQL Systemscited by 42
- 2022A Survey on Table Question Answering: Recent Advancescited by 41
12 most cited of 79 All 79 (JSON)
- 2026The Nuts and Bolts of Natural Language to SQL Translation: A Systematic Analysis of Model Pipeline Optimisation Approaches and their Interactions12 Jul 2026
- 2026CHS-SQL: A Text-to-SQL approach based on Confidence-Guided Heuristic Search Schema Linking process17 Jun 2026
- 2026Natural Language Interfaces for Spatial and Temporal Databases: A Comprehensive Overview of Methods, Taxonomy, and Future Directions24 Mar 2026
- 2026OmniZip: Learning a Unified and Lightweight Lossless Compressor for Multi-Modal Data25 Feb 2026
- 2026Cluster Workload Allocation: Semantic Soft Affinity Using Natural Language Processing14 Jan 2026
- 2025Prompt Tuning for Natural Language to SQL with Embedding Fine-Tuning and RAG11 Nov 2025
- 2025GeoSQL-Eval: First Evaluation of LLMs on PostGIS-Based NL2GeoSQL Queries28 Sep 2025
- 2025LLMSQL: Upgrading WikiSQL for the LLM Era of Text-to-SQL27 Sep 2025
- 2025MRT at IberLEF-2025 PRESTA Task: Maximizing Recovery from Tables with Multiple Steps17 Jul 2025
- 2025RetrySQL: text-to-SQL training with retry data for self-correcting query generation3 Jul 2025
- 2025HI-SQL: Optimizing Text-to-SQL Systems through Dynamic Hint Integration11 Jun 2025
- 2025SDE-SQL: Enhancing Text-to-SQL Generation in Large Language Models via Self-Driven Exploration with SQL Probes8 Jun 2025
12 newest of 79 All 79 (JSON)