mlsanityData to 14 Oct 2026

Zero-Shot Cross-lingual Semantic Parsing

arXiv 2104.07554 ↗First posted 15 Apr 2021cs.CLcited by 19

Not on the map. Why?

Abstract (arXiv)

Recent work in cross-lingual semantic parsing has successfully applied machine translation to localize parsers to new languages. However, these advances assume access to high-quality machine translation systems and word alignment tools. We remove these assumptions and study cross-lingual semantic parsing as a zero-shot problem, without parallel data (i.e., utterance-logical form pairs) for new languages. We propose a multi-task encoder-decoder model to transfer parsing knowledge to additional languages using only English-logical form paired data and in-domain natural language corpora in each new language. Our model encourages language-agnostic encodings by jointly optimizing for logical-form generation with auxiliary objectives designed for cross-lingual latent representation alignment. Our parser performs significantly above translation-based baselines and, in some cases, competes with the supervised upper-bound.

Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Builds on 61 of its 111 references that are in the map. First posted on arXiv 15 Apr 2021.

Builds on

61 of 111 references.

References · 61

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  4. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  5. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  6. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  7. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  8. 2016Gaussian Error Linear Units (GELUs)cited by 3,502
  9. 2015Domain-Adversarial Training of Neural Networkscited by 3,044
  10. 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
  11. 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,218
  12. 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,565
38 more
  1. 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,475
  2. 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,292
  3. 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,139
  4. 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,035
  5. 2020XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalizationcited by 742
  6. 2017Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learningcited by 687
  7. 2019How multilingual is Multilingual BERT?cited by 645
  8. 2017Word Translation Without Parallel Datacited by 487
  9. 2018Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyondcited by 434
  10. 2019RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parserscited by 424
  11. 2018AllenNLP: A Deep Semantic Natural Language Processing Platformcited by 347
  12. 2020Multilingual Translation with Extensible Multilingual Pretraining and Finetuningcited by 287
  13. 2017Unsupervised Machine Translation Using Monolingual Corpora Onlycited by 273
  14. 2020XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generationcited by 222
  15. 2019Towards Complex Text-to-SQL in Cross-Domain Database with Intermediate Representationcited by 210
  16. 2021Word Alignment by Fine-tuning Embeddings on Parallel Corporacited by 186
  17. 2019Emerging Cross-lingual Structure in Pretrained Language Modelscited by 181
  18. 2016Language to Logical Form with Neural Attentioncited by 158
  19. 2020MTOP: A Comprehensive Multilingual Task-Oriented Semantic Parsing Benchmarkcited by 158
  20. 2020SimAlign: High Quality Word Alignments without Parallel Training Data using Static and Contextualized Embeddingscited by 156
  21. 2020MKQA: A Linguistically Diverse Benchmark for Multilingual Open Domain Question Answeringcited by 153
  22. 2019Neural Machine Translation with Byte-Level Subwordscited by 115
  23. 2016Data Recombination for Neural Semantic Parsingcited by 111
  24. 2018Coarse-to-Fine Decoding for Neural Semantic Parsingcited by 110
  25. 2017Learning a Neural Semantic Parser from User Feedbackcited by 99
  26. 2020Translation Artifacts in Cross-lingual Transfer Learningcited by 96
  27. 2015Multi-task Sequence to Sequence Learningcited by 94
  28. 2020End-to-End Slot Alignment and Recognition for Cross-Lingual NLUcited by 83
  29. 2020Grounded Adaptation for Zero-shot Executable Semantic Parsingcited by 76
  30. 2019Cross-Lingual Alignment of Contextual Word Embeddings, with Applications to Zero-shot Dependency Parsingcited by 70
  31. 2020Zero-Shot Cross-Lingual Transfer with Meta Learningcited by 66
  32. 2019The Missing Ingredient in Zero-Shot Neural Machine Translationcited by 59
  33. 2020Explicit Alignment Objectives for Multilingual Bidirectional Encoderscited by 50
  34. 2016Zero-Resource Translation with Multi-Lingual Neural Machine Translationcited by 46
  35. 2019Translationese as a Language in "Multilingual" NMTcited by 36
  36. 2021Multilingual Code-Switching for Zero-Shot Cross-Lingual Intent Prediction and Slot Fillingcited by 25
  37. 2019Grammar-based Neural Text-to-SQL Generationcited by 23
  38. 2016Learning Executable Semantic Parsers for Natural Language Understandingcited by 21

50 most cited of 61 All 61 (JSON)

Built on by

Cited by year

Citing papers per year: 2021: 2; 2022: 6; 2023: 6; 2024: 5.

19 papers.

Sort:

By area:

  1. 2022MCoNaLa: A Benchmark for Code Generation from Multiple Natural Languagescited by 41
  2. 2022XRICL: Cross-lingual Retrieval-Augmented In-Context Learning for Cross-lingual Text-to-SQL Semantic Parsingcited by 33
  3. 2024Unveiling Linguistic Regions in Large Language Modelscited by 22
  4. 2021Translate, then Parse! A strong baseline for Cross-Lingual AMR Parsingcited by 15
  5. 2022Extrinsic Evaluation of Machine Translation Metricscited by 14
  6. 2022Meta-Learning a Cross-lingual Manifold for Semantic Parsingcited by 11
  7. 2021Compositional Generalization in Multilingual Semantic Parsing over Wikidatacited by 9
  8. 2023Contextual Label Projection for Cross-Lingual Structured Predictioncited by 9
  9. 2023On Evaluating Multilingual Compositional Generalization with Translated Datasetscited by 6
  10. 2023Are Structural Concepts Universal in Transformer Language Models? Towards Interpretable Cross-Lingual Generalizationcited by 6
  11. 2023XSemPLR: Cross-Lingual Semantic Parsing in Multiple Natural Languages and Meaning Representationscited by 5
  12. 2024MACT: Model-Agnostic Cross-Lingual Training for Discourse Representation Structure Parsingcited by 3
7 more
  1. 2023Optimal Transport Posterior Alignment for Cross-lingual Semantic Parsingcited by 2
  2. 2022DAMP: Doubly Aligned Multilingual Parser for Task-Oriented Dialoguecited by 1
  3. 2023Evaluating Inter-Bilingual Semantic Parsing for Indian Languagescited by 1
  4. 2024Cross-lingual Transfer for Automatic Question Generation by Learning Interrogative Structures in Target Languagescited by 1
  5. 2022Zero-shot Cross-lingual Conversational Semantic Role Labelingcited by 0
  6. 2024DA-Net: A Disentangled and Adaptive Network for Multi-Source Cross-Lingual Transfer Learningcited by 0
  7. 2024Cross-lingual Back-Parsing: Utterance Synthesis from Meaning Representation for Zero-Resource Semantic Parsingcited by 0