Searching for Better Database Queries in the Outputs of Semantic Parsers
Not on the map. Why?
Abstract (arXiv)
The task of generating a database query from a question in natural language suffers from ambiguity and insufficiently precise description of the goal. The problem is amplified when the system needs to generalize to databases unseen at training. In this paper, we consider the case when, at the test time, the system has access to an external criterion that evaluates the generated queries. The criterion can vary from checking that a query executes without errors to verifying the query on a set of tests. In this setting, we augment neural autoregressive models with a search algorithm that looks for a query satisfying the criterion. We apply our approach to the state-of-the-art semantic parsers and report that it allows us to find many queries passing all the tests on different datasets.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 51 references that are in the map. First posted on arXiv 13 Oct 2022.
Builds on
36 of 51 references.
References · 36
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2019The Curious Case of Neural Text Degenerationcited by 2,881
- 2018Hierarchical Neural Story Generationcited by 1,182
- 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,120
- 2018Adafactor: Adaptive Learning Rates with Sublinear Memory Costcited by 896
- 2021CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generationcited by 732
- 2020CodeBLEU: a Method for Automatic Evaluation of Code Synthesiscited by 468
- 2019RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parserscited by 420
- 2021PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Modelscited by 402
24 more
- 2019Towards Complex Text-to-SQL in Cross-Domain Database with Intermediate Representationcited by 210
- 2019CoSQL: A Conversational Text-to-SQL Challenge Towards Cross-Domain Natural Language Interfaces to Databasescited by 180
- 2019SPoC: Search-based Pseudocode to Codecited by 176
- 2020GraPPa: Grammar-Augmented Pre-Training for Table Semantic Parsingcited by 171
- 2016Language to Logical Form with Neural Attentioncited by 158
- 2020Compositional Generalization and Natural Language Variation: Can a Semantic Parsing Approach Handle Both?cited by 147
- 2019SParC: Cross-Domain Semantic Parsing in Contextcited by 141
- 2018Improving Text-to-SQL Evaluation Methodologycited by 133
- 2020Bridging Textual and Tabular Data for Cross-Domain Text-to-SQL Semantic Parsingcited by 133
- 2020Break It Down: A Question Understanding Benchmarkcited by 131
- 2020Structure-Grounded Pretraining for Text-to-SQLcited by 126
- 2020Semantic Evaluation for Text-to-SQL with Distilled Test Suitescited by 123
- 2021LGESQL: Line Graph Enhanced Text-to-SQL Model with Mixed Local and Non-Local Relationscited by 119
- 2021KaggleDBQA: Realistic Evaluation of Text-to-SQL Parserscited by 105
- 2017Learning a Neural Semantic Parser from User Feedbackcited by 98
- 2020SmBoP: Semi-autoregressive Bottom-up Semantic Parsingcited by 97
- 2018Robust Text-to-SQL Generation with Execution-Guided Decodingcited by 51
- 2021SADGA: Structure-Aware Dual Graph Aggregation Network for Text-to-SQLcited by 43
- 2018Automatic Program Synthesis of Long Programs with a Learned Garbage Collectorcited by 24
- 2019Grammar-based Neural Text-to-SQL Generationcited by 23
- 2020Incremental Sampling Without Replacement for Sequence Modelscited by 23
- 2021Weakly Supervised Text-to-SQL Parsing through Question Decompositioncited by 15
- 2021Learning to Combine Per-Example Solutions for Neural Program Synthesiscited by 8
- 2021SPARQLing Database Queries from Intermediate Question Decompositionscited by 7
Built on by
Not cited yet.