mlsanityData to 7 Oct 2026

EdinSaar@WMT21: North-Germanic Low-Resource Multilingual NMT

arXiv 2109.14368 ↗First posted 29 Sep 2021cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

We describe the EdinSaar submission to the shared task of Multilingual Low-Resource Translation for North Germanic Languages at the Sixth Conference on Machine Translation (WMT2021). We submit multilingual translation models for translations to/from Icelandic (is), Norwegian-Bokmal (nb), and Swedish (sv). We employ various experimental approaches, including multilingual pre-training, back-translation, fine-tuning, and ensembling. In most translation directions, our models outperform other submitted systems.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 27 of its 41 references that are in the map. First posted on arXiv 29 Sep 2021.

Builds on

27 of 41 references.

References · 27

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
  4. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
  5. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
  6. 2016Bag of Tricks for Efficient Text Classificationcited by 869
  7. 2015Improving Neural Machine Translation Models with Monolingual Datacited by 784
  8. 2020Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillationcited by 591
  9. 2020Beyond English-Centric Multilingual Machine Translationcited by 559
  10. 2016Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translationcited by 467
  11. 2018Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyondcited by 434
  12. 2016FastText.zip: Compressing text classification modelscited by 331
15 more
  1. 2019Massively Multilingual Neural Machine Translation in the Wild: Findings and Challengescited by 253
  2. 2019Massively Multilingual Neural Machine Translationcited by 246
  3. 2019WikiMatrix: Mining 135M Parallel Sentences in 1620 Language Pairs from Wikipediacited by 221
  4. 2018Marian: Fast Neural Machine Translation in C++cited by 202
  5. 2019BPE-Dropout: Simple and Effective Subword Regularizationcited by 189
  6. 2016Transfer Learning for Low-Resource Neural Machine Translationcited by 188
  7. 2019CCAligned: A Massive Collection of Cross-Lingual Web-Document Pairscited by 136
  8. 2016Multi-Way, Multilingual Neural Machine Translation with a Shared Attention Mechanismcited by 117
  9. 2018Rapid Adaptation of Neural Machine Translation to New Languagescited by 82
  10. 2016Toward Multilingual Neural Machine Translation with Universal Encoder and Decodercited by 76
  11. 2018Trivial Transfer Learning for Low-Resource Neural Machine Translationcited by 47
  12. 2019Pivot-based Transfer Learning for Neural Machine Translation between Non-English Languagescited by 36
  13. 2019On the use of BERT for Neural Machine Translationcited by 23
  14. 2017The University of Edinburgh's Neural MT Systems for WMT17cited by 16
  15. 2019Adapting Multilingual Neural Machine Translation to Unseen Languagescited by 12

Built on by

Cited by year

Citing papers per year: 2022: 1; 2023: 0; 2024: 1.

2 papers.

  1. 2022Separating Grains from the Chaff: Using Data Filtering to Improve Multilingual Translation for Low-Resourced African Languagescited by 6
  2. 2024Generative-Adversarial Networks for Low-Resource Language Data Augmentation in Machine Translationcited by 0