mlsanityData to 7 Oct 2026

Multi-Way, Multilingual Neural Machine Translation with a Shared Attention Mechanism

arXiv 1601.01073 ↗First posted 6 Jan 2016cs.CL stat.MLcited by 117

Not on the map. Why?

Abstract (arXiv)

We propose multi-way, multilingual neural machine translation. The proposed approach enables a single neural translation model to translate between multiple languages, with a number of parameters that grows only linearly with the number of languages. This is made possible by having a single attention mechanism that is shared across all language pairs. We train the proposed multi-way, multilingual model on ten language pairs from WMT'15 simultaneously and observe clear performance improvements over models trained on only one language pair. In particular, we observe that the proposed model significantly improves the translation quality of low-resource language pairs.

Key facts. Cited by 117 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Jan 2016.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2020: 1; 2021: 45; 2022: 30; 2023: 25; 2024: 9; 2025: 5; 2026: 2.

117 papers.

Sort:

By area:

  1. 2020GShard: Scaling Giant Models with Conditional Computation and Automatic Shardingcited by 1,601
  2. 2021Samanantar: The Largest Publicly Available Parallel Corpora Collection for 11 Indic Languagescited by 133
  3. 2021Neural Machine Translation for Low-Resource Languages: A Surveycited by 108
  4. 2022A Few Thousand Translations Go a Long Way! Leveraging Pre-trained Models for African News Translationcited by 97
  5. 2021Survey of Low-Resource Machine Translationcited by 92
  6. 2023A Benchmark for Learning to Translate a New Language from One Grammar Bookcited by 74
  7. 2022Building Machine Translation Systems for the Next Thousand Languagescited by 69
  8. 2023Investigating the Translation Performance of a Large Multilingual Language Model: the Case of BLOOMcited by 58
  9. 2021Facebook AI WMT21 News Translation Task Submissioncited by 57
  10. 2021A Survey on Green Deep Learningcited by 52
  11. 2021Attention, please! A survey of Neural Attention Models in Deep Learningcited by 50
  12. 2021Learning Language Specific Sub-network for Multilingual Machine Translationcited by 48
38 more
  1. 2023Mitigating Hallucinations and Off-target Machine Translation with Source-Contrastive and Language-Contrastive Decodingcited by 42
  2. 2021Counter-Interference Adapter for Multilingual Machine Translationcited by 39
  3. 2021Towards Continual Learning for Multilingual Machine Translation via Vocabulary Substitutioncited by 31
  4. 2021Improving Multilingual Translation by Representation and Gradient Regularizationcited by 31
  5. 2021Language Tags Matter for Zero-Shot Neural Machine Translationcited by 29
  6. 2022Using natural language prompts for machine translationcited by 27
  7. 2022Examining Scaling and Transfer of Language Model Architectures for Machine Translationcited by 26
  8. 2021Importance-based Neuron Allocation for Multilingual Neural Machine Translationcited by 23
  9. 2022Causes and Cures for Interference in Multilingual Translationcited by 23
  10. 2021Multilingual Unsupervised Neural Machine Translation with Denoising Adapterscited by 22
  11. 2021Can You Traducir This? Machine Translation for Code-Switched Inputcited by 21
  12. 2022Lego-MT: Learning Detachable Models for Massively Multilingual Machine Translationcited by 21
  13. 2022How Robust is Neural Machine Translation to Language Imbalance in Multilingual Tokenizer Training?cited by 20
  14. 2022Towards the Next 1000 Languages in Multilingual Machine Translation: Exploring the Synergy Between Supervised and Self-Supervised Learningcited by 19
  15. 2021Distributionally Robust Multilingual Machine Translationcited by 18
  16. 2021Tricks for Training Sparse Translation Modelscited by 17
  17. 2021A Survey on Low-Resource Neural Machine Translationcited by 16
  18. 2021Bandits Don't Follow Rules: Balancing Multi-Facet Machine Translation with Multi-Armed Banditscited by 16
  19. 2022SMaLL-100: Introducing Shallow Multilingual Machine Translation Model for Low-Resource Languagescited by 16
  20. 2021Rethinking Zero-shot Neural Machine Translation: From a Perspective of Latent Variablescited by 14
  21. 2022Language-Family Adapters for Low-Resource Multilingual Neural Machine Translationcited by 14
  22. 2021Efficient Weight factorization for Multilingual Speech Recognitioncited by 12
  23. 2021Continual Learning in Multilingual NMT via Language-Specific Embeddingscited by 12
  24. 2022Universal Conditional Masked Language Pre-training for Neural Machine Translationcited by 12
  25. 2022Multilingual Neural Machine Translation with Deep Encoder and Multiple Shallow Decoderscited by 12
  26. 2022MMTAfrica: Multilingual Machine Translation for African Languagescited by 11
  27. 2023Unmasking Transformers: A Theoretical Approach to Data Recovery via Attention Weightscited by 11
  28. 2021Multilingual Translation via Grafting Pre-trained Language Modelscited by 10
  29. 2023Improving Zero-shot Multilingual Neural Machine Translation by Leveraging Cross-lingual Consistency Regularizationcited by 10
  30. 2023Towards Higher Pareto Frontier in Multilingual Machine Translationcited by 9
  31. 2021Breaking Down Multilingual Machine Translationcited by 8
  32. 2023Communication Efficient Federated Learning for Multilingual Neural Machine Translation with Adaptercited by 8
  33. 2024AnyTrans: Translate AnyText in the Image with Large Scale Modelscited by 8
  34. 2021Low-Resource Neural Machine Translation for Southern African Languagescited by 7
  35. 2021Multilingual Document-Level Translation Enables Zero-Shot Transfer From Sentences to Documentscited by 7
  36. 2022Multilingual Mix: Example Interpolation Improves Multilingual Neural Machine Translationcited by 7
  37. 2023Bilex Rx: Lexical Data Augmentation for Massively Multilingual Machine Translationcited by 7
  38. 2023Order Matters in the Presence of Dataset Imbalance for Multilingual Learningcited by 7

50 most cited of 117 All 117 (JSON)