mlsanityData to 7 Oct 2026

Optimal Transport Posterior Alignment for Cross-lingual Semantic Parsing

arXiv 2307.04096 ↗First posted 9 Jul 2023cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

Cross-lingual semantic parsing transfers parsing capability from a high-resource language (e.g., English) to low-resource languages with scarce training data. Previous work has primarily considered silver-standard data augmentation or zero-shot methods, however, exploiting few-shot gold data is comparatively unexplored. We propose a new approach to cross-lingual semantic parsing by explicitly minimizing cross-lingual divergence between probabilistic latent variables using Optimal Transport. We demonstrate how this direct guidance improves parsing from natural languages using fewer examples and less training. We evaluate our method on two datasets, MTOP and MultiATIS++SQL, establishing state-of-the-art results under a few-shot cross-lingual regime. Ablation studies further reveal that our method improves performance even without parallel input translations. In addition, we show that our model better captures cross-lingual structure in the latent space to improve semantic representation similarity.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 54 of its 81 references that are in the map. First posted on arXiv 9 Jul 2023.

Builds on

54 of 81 references.

References · 54

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  4. 2013Auto-Encoding Variational Bayescited by 3,980
  5. 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
  6. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
  7. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
  8. 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
  9. 2020XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalizationcited by 738
  10. 2019How multilingual is Multilingual BERT?cited by 642
  11. 2021PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Modelscited by 402
  12. 2017Wasserstein Auto-Encoderscited by 371
38 more
  1. 2018AllenNLP: A Deep Semantic Natural Language Processing Platformcited by 347
  2. 2020XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generationcited by 221
  3. 2023RESDSQL: Decoupling Schema Linking and Skeleton Parsing for Text-to-SQLcited by 191
  4. 2020MTOP: A Comprehensive Multilingual Task-Oriented Semantic Parsing Benchmarkcited by 156
  5. 2020SimAlign: High Quality Word Alignments without Parallel Training Data using Static and Contextualized Embeddingscited by 155
  6. 2022Lifting the Curse of Multilinguality by Pre-training Modular Transformerscited by 145
  7. 2019Hierarchical Transformers for Multi-Document Summarizationcited by 132
  8. 2018Gromov-Wasserstein Alignment of Word Embedding Spacescited by 119
  9. 2020End-to-End Slot Alignment and Recognition for Cross-Lingual NLUcited by 82
  10. 2020Low-Resource Domain Adaptation for Compositional Task-Oriented Semantic Parsingcited by 72
  11. 2018A Survey on Semantic Parsingcited by 62
  12. 2022A Survey on Text-to-SQL Parsing: Concepts, Methods, and Future Directionscited by 51
  13. 2020A Closer Look at Few-Shot Crosslingual Transfer: The Choice of Shots Matterscited by 45
  14. 2021From Masked Language Modeling to Translation: Non-English Auxiliary Tasks Improve Zero-shot Spoken Language Understandingcited by 43
  15. 2022MCoNaLa: A Benchmark for Code Generation from Multiple Natural Languagescited by 41
  16. 2023XTREME-UP: A User-Centric Scarce-Data Benchmark for Under-Represented Languagescited by 34
  17. 2022XRICL: Cross-lingual Retrieval-Augmented In-Context Learning for Cross-lingual Text-to-SQL Semantic Parsingcited by 32
  18. 2018StructVAE: Tree-structured Latent Variable Models for Semi-supervised Semantic Parsingcited by 22
  19. 2021Improving Neural Cross-Lingual Summarization via Employing Optimal Transport Distance for Knowledge Distillationcited by 22
  20. 2016Learning Executable Semantic Parsers for Natural Language Understandingcited by 21
  21. 2017Universal Semantic Parsingcited by 21
  22. 2022CLASP: Few-Shot Cross-Lingual Data Augmentation for Semantic Parsingcited by 21
  23. 2021Zero-Shot Cross-lingual Semantic Parsingcited by 19
  24. 2021Using Optimal Transport as Alignment Objective for fine-tuning Multilingual Contextualized Embeddingscited by 19
  25. 2021Translate & Fill: Improving Zero-Shot Multilingual Semantic Parsing with Synthetic Datacited by 17
  26. 2022Transforming Sequence Tagging Into A Seq2Seq Taskcited by 15
  27. 2022Alexa Teacher Model: Pretraining and Distilling Multi-Billion-Parameter Encoders for Natural Language Understanding Systemscited by 15
  28. 2023Improving Cross-lingual Information Retrieval on Low-Resource Languages via Optimal Transport Distillationcited by 15
  29. 2017Learning an Executable Neural Semantic Parsercited by 14
  30. 2022GL-CLeF: A Global-Local Contrastive Learning Framework for Cross-lingual Spoken Language Understandingcited by 14
  31. 2020Bootstrapping a Crosslingual Semantic Parsercited by 13
  32. 2016Semantic Parsing with Semi-Supervised Sequential Autoencoderscited by 11
  33. 2022Meta-Learning a Cross-lingual Manifold for Semantic Parsingcited by 11
  34. 2019Riemannian Normalizing Flow on Variational Wasserstein Autoencoder for Text Modelingcited by 8
  35. 2021Sub-Character Tokenization for Chinese Pretrained Language Modelscited by 7
  36. 2021Multilingual Neural Semantic Parsing for Low-Resourced Languagescited by 7
  37. 2022CrossAligner & Co: Zero-Shot Transfer Methods for Task-Oriented Cross-lingual Natural Language Understandingcited by 7
  38. 2022Bilingual Lexicon Induction for Low-Resource Languages using Graph Matching via Optimal Transportcited by 6

50 most cited of 54 All 54 (JSON)

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 1.

2 papers.