mlsanityData to 7 Oct 2026

Semantic Parsing in Limited Resource Conditions

arXiv 2309.07429 ↗First posted 14 Sep 2023cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

This thesis explores challenges in semantic parsing, specifically focusing on scenarios with limited data and computational resources. It offers solutions using techniques like automatic data curation, knowledge transfer, active learning, and continual learning. For tasks with no parallel training data, the thesis proposes generating synthetic training examples from structured database schemas. When there is abundant data in a source domain but limited parallel data in a target domain, knowledge from the source is leveraged to improve parsing in the target domain. For multilingual situations with limited data in the target languages, the thesis introduces a method to adapt parsers using a limited human translation budget. Active learning is applied to select source-language samples for manual translation, maximizing parser performance in the target language. In addition, an alternative method is also proposed to utilize machine translation services, supplemented by human-translated data, to train a more effective parser. When computational resources are limited, a continual learning approach is introduced to minimize training time and computational memory. This maintains the parser's efficiency in previously learned tasks while adapting it to new tasks, mitigating the problem of catastrophic forgetting. Overall, the thesis provides a comprehensive set of methods to improve semantic parsing in resource-constrained conditions.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 56 of its 219 references that are in the map. First posted on arXiv 14 Sep 2023.

Builds on

56 of 219 references.

References · 56

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  5. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  6. 2019Invariant Risk Minimizationcited by 1,832
  7. 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
  8. 2016Progressive Neural Networkscited by 1,332
  9. 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,120
  10. 2021An Explanation of In-context Learning as Implicit Bayesian Inferencecited by 915
  11. 2019EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Taskscited by 800
  12. 2015Improving Neural Machine Translation Models with Monolingual Datacited by 784
38 more
  1. 2020K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapterscited by 318
  2. 2019On Tiny Episodic Memories in Continual Learningcited by 299
  3. 2019Measuring Compositional Generalization: A Comprehensive Method on Realistic Datacited by 280
  4. 2020Inductive Biases for Deep Learning of Higher-Level Cognitioncited by 273
  5. 2019Towards Complex Text-to-SQL in Cross-Domain Database with Intermediate Representationcited by 210
  6. 2020GraPPa: Grammar-Augmented Pre-Training for Table Semantic Parsingcited by 171
  7. 2021Constrained Language Models Yield Few-Shot Semantic Parserscited by 162
  8. 2019SParC: Cross-Domain Semantic Parsing in Contextcited by 141
  9. 2018Improving Text-to-SQL Evaluation Methodologycited by 133
  10. 2018Style Transfer Through Back-Translationcited by 124
  11. 2018Sharp Nearby, Fuzzy Far Away: How Neural Language Models Use Contextcited by 113
  12. 2016Data Recombination for Neural Semantic Parsingcited by 111
  13. 2018Mapping Language to Code in Programmatic Contextcited by 104
  14. 2016Neural Symbolic Machines: Learning Semantic Parsers on Freebase with Weak Supervisioncited by 101
  15. 2018Semantic Parsing for Task Oriented Dialog using Hierarchical Representationscited by 101
  16. 2022Compositional Semantic Parsing with Large Language Modelscited by 95
  17. 2019Diverse mini-batch Active Learningcited by 88
  18. 2016Learning to Compose Neural Networks for Question Answeringcited by 85
  19. 2019Editing-Based SQL Query Generation for Cross-Domain Context-Dependent Questionscited by 80
  20. 2018A Survey on Semantic Parsingcited by 62
  21. 2020How Far are We from Effective Context Modeling? An Exploratory Study on Semantic Parsing in Contextcited by 53
  22. 2021Few-Shot Semantic Parsing with Language Models Trained On Codecited by 50
  23. 2021Improving Compositional Generalization with Latent Structure and Data Augmentationcited by 46
  24. 2015Transition-Based Dependency Parsing with Stack Long Short-Term Memorycited by 45
  25. 2020Speak to your Parser: Interactive Text-to-SQL with Natural Language Feedbackcited by 44
  26. 2022SeqZero: Few-shot Compositional Semantic Parsing with Sequential Prompts and Zero-shot Modelscited by 38
  27. 2013Lambda Dependency-Based Compositional Semanticscited by 26
  28. 2019Don't paraphrase, detect! Rapid and Effective Data Collection for Semantic Parsingcited by 24
  29. 2018Learning to Map Context-Dependent Sentences to Executable Formal Queriescited by 23
  30. 2021The Power of Prompt Tuning for Low-Resource Semantic Parsingcited by 21
  31. 2021Translate & Fill: Improving Zero-Shot Multilingual Semantic Parsing with Synthetic Datacited by 17
  32. 2022SUBS: Subtree Substitution for Compositional Semantic Parsingcited by 16
  33. 2021On The Ingredients of an Effective Zero-shot Semantic Parsercited by 13
  34. 2018Situated Mapping of Sequential Instructions to Actions with Single-step Reward Observationcited by 12
  35. 2022Meta-Learning a Cross-lingual Manifold for Semantic Parsingcited by 11
  36. 2020BET: A Backtranslation Approach for Easy Data Augmentation in Transformer-based Paraphrase Identification Contextcited by 8
  37. 2020LSCALE: Latent Space Clustering-Based Active Learning for Node Classificationcited by 8
  38. 2022Paraphrasing Techniques for Maritime QA systemcited by 7

50 most cited of 56 All 56 (JSON)

Built on by

Not cited yet.