Hierarchical Neural Data Synthesis for Semantic Parsing
On the map: Synthetic data and self-improvement for LLMs → LLM synthetic data generation
Abstract (arXiv)
Semantic parsing datasets are expensive to collect. Moreover, even the questions pertinent to a given domain, which are the input of a semantic parsing system, might not be readily available, especially in cross-domain semantic parsing. This makes data augmentation even more challenging. Existing methods to synthesize new data use hand-crafted or induced rules, requiring substantial engineering effort and linguistic expertise to achieve good coverage and precision, which limits the scalability. In this work, we propose a purely neural approach of data augmentation for semantic parsing that completely removes the need for grammar engineering while achieving higher semantic parsing accuracy. Furthermore, our method can synthesize in the zero-shot setting, where only a new domain schema is available without any input-output examples of the new domain. On the Spider cross-domain text-to-SQL semantic parsing benchmark, we achieve the state-of-the-art performance on the development set (77.2% accuracy) using our zero-shot augmentation.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in LLM synthetic data generation, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 17 of its 21 references that are in the map. First posted on arXiv 4 Dec 2021.
Builds on
17 of 21 references.
References · 17
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,120
- 2019EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Taskscited by 800
- 2019RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parserscited by 420
- 2021PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Modelscited by 402
- 2020GraPPa: Grammar-Augmented Pre-Training for Table Semantic Parsingcited by 171
- 2019Good-Enough Compositional Data Augmentationcited by 158
- 2021LGESQL: Line Graph Enhanced Text-to-SQL Model with Mixed Local and Non-Local Relationscited by 119
- 2016Data Recombination for Neural Semantic Parsingcited by 111
- 2019Tagged Back-Translationcited by 76
- 2020Grounded Adaptation for Zero-shot Executable Semantic Parsingcited by 76
- 2020Learning Contextual Representations for Semantic Parsing with Generation-Augmented Pre-Trainingcited by 65
5 more
- 2020Speak to your Parser: Interactive Text-to-SQL with Natural Language Feedbackcited by 44
- 2020Optimizing Deeper Transformers on Small Datasetscited by 41
- 2021Learning to Synthesize Data for Semantic Parsingcited by 41
- 2021GP: Context-free Grammar Pre-training for Text-to-SQL Parserscited by 5
- 2021Turing: an Accurate and Interpretable Multi-Hypothesis Cross-Domain Natural Language Database Interfacecited by 1
Built on by
Citing papers per year: 2022: 3; 2023: 2; 2024: 0; 2025: 3; 2026: 3.
11 papers.
- 2025OmniSQL: Synthesizing High-quality Text-to-SQL Data at Scalecited by 90
- 2023Unifying the Perspectives of NLP and Software Engineering: A Survey on Language Models for Codecited by 62
- 2022A Survey on Text-to-SQL Parsing: Concepts, Methods, and Future Directionscited by 51
- 2022Importance of Synthesizing High-quality Data for Text-to-SQL Parsingcited by 27
- 2023Selective Demonstrations for Cross-domain Text-to-SQLcited by 21
- 2025Text2SQL-Flow: A Robust SQL-Aware Data Augmentation Framework for Text-to-SQLcited by 11
- 2022Diverse Parallel Data Synthesis for Cross-Database Adaptation of Text-to-SQL Parserscited by 7
- 2025REFORMER: A ChatGPT-Driven Data Synthesis Framework Elevating Text-to-SQL Modelscited by 1
- 2026EvolSQL: Structure-Aware Evolution for Scalable Text-to-SQL Data Synthesiscited by 1
- 2026SemanticAgent: A Semantics-Aware Framework for Text-to-SQL Data Synthesiscited by 0
- 2026Knowledge Distillation for Low-Resource Open-source Text-to-SQL Modelcited by 0
- 2026Knowledge Distillation for Low-Resource Open-source Text-to-SQL Model13 May 2026
- 2026SemanticAgent: A Semantics-Aware Framework for Text-to-SQL Data Synthesis23 Apr 2026
- 2026EvolSQL: Structure-Aware Evolution for Scalable Text-to-SQL Data Synthesis8 Jan 2026
- 2025Text2SQL-Flow: A Robust SQL-Aware Data Augmentation Framework for Text-to-SQL13 Nov 2025
- 2025REFORMER: A ChatGPT-Driven Data Synthesis Framework Elevating Text-to-SQL Models6 Apr 2025
- 2025OmniSQL: Synthesizing High-quality Text-to-SQL Data at Scale4 Mar 2025
- 2023Unifying the Perspectives of NLP and Software Engineering: A Survey on Language Models for Code14 Nov 2023
- 2023Selective Demonstrations for Cross-domain Text-to-SQL10 Oct 2023
- 2022Importance of Synthesizing High-quality Data for Text-to-SQL Parsing17 Dec 2022
- 2022Diverse Parallel Data Synthesis for Cross-Database Adaptation of Text-to-SQL Parsers29 Oct 2022
- 2022A Survey on Text-to-SQL Parsing: Concepts, Methods, and Future Directions29 Aug 2022
Similar, not cited
Close in wording, no citation either way
- 2021Translate & Fill: Improving Zero-Shot Multilingual Semantic Parsing with Synthetic Data
- 2019Model-based Interactive Semantic Parsing: A Unified Framework and A Text-to-SQL Case Study
- 2024Improving Retrieval-augmented Text-to-SQL with AST-based Ranking and Schema Pruning
- 2020An Imitation Game for Learning Semantic Parsers from User Interaction
- 2022Translate First Reorder Later: Leveraging Monotonicity in Semantic Parsing
- 2022XRICL: Cross-lingual Retrieval-Augmented In-Context Learning for Cross-lingual Text-to-SQL Semantic Parsing
- 2024Retrieval-Augmented Semantic Parsing: Improving Generalization with Lexical Knowledge
- 2024A synthetic data approach for domain generalization of NLI models