mlsanityData to 7 Oct 2026

Meta-Learning a Cross-lingual Manifold for Semantic Parsing

arXiv 2209.12577 ↗First posted 26 Sep 2022cs.CLcited by 11

Not on the map. Why?

Abstract (arXiv)

Localizing a semantic parser to support new languages requires effective cross-lingual generalization. Recent work has found success with machine-translation or zero-shot methods although these approaches can struggle to model how native speakers ask questions. We consider how to effectively leverage minimal annotated examples in new languages for few-shot cross-lingual semantic parsing. We introduce a first-order meta-learning algorithm to train a semantic parser with maximal sample efficiency during cross-lingual transfer. Our algorithm uses high-resource languages to train the parser and simultaneously optimizes for cross-lingual generalization for lower-resource languages. Results across six languages on ATIS demonstrate that our combination of generalization steps yields accurate semantic parsers sampling ≤10% of source training data in each new language. Our approach also trains a competitive model on Spider using English with generalization to Chinese similarly sampling ≤10% of training data.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 46 of its 74 references that are in the map. First posted on arXiv 26 Sep 2022.

Builds on

46 of 74 references.

References · 46

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  4. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
  5. 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
  6. 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,120
  7. 2018On First-Order Meta-Learning Algorithmscited by 1,003
  8. 2020Meta-Learning in Neural Networks: A Surveycited by 944
  9. 2018XNLI: Evaluating Cross-lingual Sentence Representationscited by 913
  10. 2017Learning to Generalize: Meta-Learning for Domain Generalizationcited by 762
  11. 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 762
  12. 2020XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalizationcited by 738
34 more
  1. 2020Stanza: A Python Natural Language Processing Toolkit for Many Human Languagescited by 719
  2. 2019Generalizing from a Few Examples: A Survey on Few-Shot Learningcited by 462
  3. 2019RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parserscited by 420
  4. 2021PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Modelscited by 402
  5. 2020XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generationcited by 221
  6. 2020A Survey on Recent Approaches for Natural Language Processing in Low-Resource Scenarioscited by 170
  7. 2020MTOP: A Comprehensive Multilingual Task-Oriented Semantic Parsing Benchmarkcited by 156
  8. 2018Meta-Learning for Low-Resource Neural Machine Translationcited by 105
  9. 2020End-to-End Slot Alignment and Recognition for Cross-Lingual NLUcited by 82
  10. 2020Span-based Semantic Parsing for Compositional Generalizationcited by 77
  11. 2020Grounded Adaptation for Zero-shot Executable Semantic Parsingcited by 76
  12. 2020Low-Resource Domain Adaptation for Compositional Task-Oriented Semantic Parsingcited by 72
  13. 2020Zero-Shot Cross-Lingual Transfer with Meta Learningcited by 66
  14. 2020A Closer Look at Few-Shot Crosslingual Transfer: The Choice of Shots Matterscited by 45
  15. 2021From Masked Language Modeling to Translation: Non-English Auxiliary Tasks Improve Zero-shot Spoken Language Understandingcited by 43
  16. 2020Meta-Learning for Domain Generalization in Semantic Parsingcited by 41
  17. 2019Bilingual Lexicon Induction with Semi-supervision in Non-Isometric Embedding Spacescited by 35
  18. 2018Natural Language to Structured Query Generation via Meta-Learningcited by 33
  19. 2019A Pilot Study for Chinese SQL Semantic Parsingcited by 33
  20. 2020AutoQA: From Databases To QA Semantic Parsers With Only Synthetic Training Datacited by 29
  21. 2021MetaXL: Meta Representation Transformation for Low-resource Cross-lingual Learningcited by 21
  22. 2017Cross-domain Semantic Parsing via Paraphrasingcited by 19
  23. 2021Zero-Shot Cross-lingual Semantic Parsingcited by 19
  24. 2019Coupling Retrieval and Meta-Learning for Context-Dependent Semantic Parsingcited by 18
  25. 2021Translate & Fill: Improving Zero-Shot Multilingual Semantic Parsing with Synthetic Datacited by 17
  26. 2020Bootstrapping a Crosslingual Semantic Parsercited by 13
  27. 2020Don't Parse, Insert: Multilingual Semantic Parsing with Insertion Based Decodingcited by 13
  28. 2019Neural Semantic Parsing in Low-Resource Settings with Back-Translation and Meta-Learningcited by 10
  29. 2017Neural Semantic Parsing over Multiple Knowledge-basescited by 8
  30. 2019One-Shot Learning for Text-to-SQL Generationcited by 5
  31. 2021Soft Layer Selection with Meta-Learning for Zero-Shot Cross-Lingual Transfercited by 5
  32. 2019Zero-Shot Semantic Parsing for Instructionscited by 4
  33. 2018Polyglot Semantic Parsing in APIscited by 1
  34. 2020Localizing Open-Ontology QA Semantic Parsers in a Day Using Machine Translationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 3; 2023: 5; 2024: 2; 2025: 0; 2026: 1.

11 papers.

  1. 2022XRICL: Cross-lingual Retrieval-Augmented In-Context Learning for Cross-lingual Text-to-SQL Semantic Parsingcited by 32
  2. 2022QAmeleon: Multilingual QA with Only 5 Examplescited by 25
  3. 2022Extrinsic Evaluation of Machine Translation Metricscited by 14
  4. 2023An Automatic Learning Rate Schedule Algorithm for Achieving Faster Convergence and Steeper Descentcited by 9
  5. 2023Are Structural Concepts Universal in Transformer Language Models? Towards Interpretable Cross-Lingual Generalizationcited by 6
  6. 2024Towards Incremental Learning in Large Language Models: A Critical Reviewcited by 6
  7. 2023XSemPLR: Cross-Lingual Semantic Parsing in Multiple Natural Languages and Meaning Representationscited by 5
  8. 2023Optimal Transport Posterior Alignment for Cross-lingual Semantic Parsingcited by 2
  9. 2024Should Cross-Lingual AMR Parsing go Meta? An Empirical Assessment of Meta-Learning and Joint Learning AMR Parsingcited by 2
  10. 2023Semantic Parsing in Limited Resource Conditionscited by 0
  11. 2026Relation Geometry in Semantic Space of Language Modelscited by 0