Optimal Transport Posterior Alignment for Cross-lingual Semantic Parsing
Not on the map. Why?
Abstract (arXiv)
Cross-lingual semantic parsing transfers parsing capability from a high-resource language (e.g., English) to low-resource languages with scarce training data. Previous work has primarily considered silver-standard data augmentation or zero-shot methods, however, exploiting few-shot gold data is comparatively unexplored. We propose a new approach to cross-lingual semantic parsing by explicitly minimizing cross-lingual divergence between probabilistic latent variables using Optimal Transport. We demonstrate how this direct guidance improves parsing from natural languages using fewer examples and less training. We evaluate our method on two datasets, MTOP and MultiATIS++SQL, establishing state-of-the-art results under a few-shot cross-lingual regime. Ablation studies further reveal that our method improves performance even without parallel input translations. In addition, we show that our model better captures cross-lingual structure in the latent space to improve semantic representation similarity.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 54 of its 81 references that are in the map. First posted on arXiv 9 Jul 2023.
Builds on
54 of 81 references.
References · 54
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
- 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
- 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
- 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
- 2020XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalizationcited by 738
- 2019How multilingual is Multilingual BERT?cited by 642
- 2021PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Modelscited by 402
- 2017Wasserstein Auto-Encoderscited by 371
38 more
- 2018AllenNLP: A Deep Semantic Natural Language Processing Platformcited by 347
- 2020XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generationcited by 221
- 2023RESDSQL: Decoupling Schema Linking and Skeleton Parsing for Text-to-SQLcited by 191
- 2020MTOP: A Comprehensive Multilingual Task-Oriented Semantic Parsing Benchmarkcited by 156
- 2020SimAlign: High Quality Word Alignments without Parallel Training Data using Static and Contextualized Embeddingscited by 155
- 2022Lifting the Curse of Multilinguality by Pre-training Modular Transformerscited by 145
- 2019Hierarchical Transformers for Multi-Document Summarizationcited by 132
- 2018Gromov-Wasserstein Alignment of Word Embedding Spacescited by 119
- 2020End-to-End Slot Alignment and Recognition for Cross-Lingual NLUcited by 82
- 2020Low-Resource Domain Adaptation for Compositional Task-Oriented Semantic Parsingcited by 72
- 2018A Survey on Semantic Parsingcited by 62
- 2022A Survey on Text-to-SQL Parsing: Concepts, Methods, and Future Directionscited by 51
- 2020A Closer Look at Few-Shot Crosslingual Transfer: The Choice of Shots Matterscited by 45
- 2021From Masked Language Modeling to Translation: Non-English Auxiliary Tasks Improve Zero-shot Spoken Language Understandingcited by 43
- 2022MCoNaLa: A Benchmark for Code Generation from Multiple Natural Languagescited by 41
- 2023XTREME-UP: A User-Centric Scarce-Data Benchmark for Under-Represented Languagescited by 34
- 2022XRICL: Cross-lingual Retrieval-Augmented In-Context Learning for Cross-lingual Text-to-SQL Semantic Parsingcited by 32
- 2018StructVAE: Tree-structured Latent Variable Models for Semi-supervised Semantic Parsingcited by 22
- 2021Improving Neural Cross-Lingual Summarization via Employing Optimal Transport Distance for Knowledge Distillationcited by 22
- 2016Learning Executable Semantic Parsers for Natural Language Understandingcited by 21
- 2017Universal Semantic Parsingcited by 21
- 2022CLASP: Few-Shot Cross-Lingual Data Augmentation for Semantic Parsingcited by 21
- 2021Zero-Shot Cross-lingual Semantic Parsingcited by 19
- 2021Using Optimal Transport as Alignment Objective for fine-tuning Multilingual Contextualized Embeddingscited by 19
- 2021Translate & Fill: Improving Zero-Shot Multilingual Semantic Parsing with Synthetic Datacited by 17
- 2022Transforming Sequence Tagging Into A Seq2Seq Taskcited by 15
- 2022Alexa Teacher Model: Pretraining and Distilling Multi-Billion-Parameter Encoders for Natural Language Understanding Systemscited by 15
- 2023Improving Cross-lingual Information Retrieval on Low-Resource Languages via Optimal Transport Distillationcited by 15
- 2017Learning an Executable Neural Semantic Parsercited by 14
- 2022GL-CLeF: A Global-Local Contrastive Learning Framework for Cross-lingual Spoken Language Understandingcited by 14
- 2020Bootstrapping a Crosslingual Semantic Parsercited by 13
- 2016Semantic Parsing with Semi-Supervised Sequential Autoencoderscited by 11
- 2022Meta-Learning a Cross-lingual Manifold for Semantic Parsingcited by 11
- 2019Riemannian Normalizing Flow on Variational Wasserstein Autoencoder for Text Modelingcited by 8
- 2021Sub-Character Tokenization for Chinese Pretrained Language Modelscited by 7
- 2021Multilingual Neural Semantic Parsing for Low-Resourced Languagescited by 7
- 2022CrossAligner & Co: Zero-Shot Transfer Methods for Task-Oriented Cross-lingual Natural Language Understandingcited by 7
- 2022Bilingual Lexicon Induction for Low-Resource Languages using Graph Matching via Optimal Transportcited by 6
50 most cited of 54 All 54 (JSON)
Built on by
Citing papers per year: 2023: 1; 2024: 1.
2 papers.