Toward Multilingual Neural Machine Translation with Universal Encoder and Decoder
Not on the map. Why?
Abstract (arXiv)
In this paper, we present our first attempts in building a multilingual Neural Machine Translation framework under a unified approach. We are then able to employ attention-based NMT for many-to-many multilingual translation tasks. Our approach does not require any special treatment on the network architecture and it allows us to learn minimal number of free parameters in a standard way of training. Our approach has shown its effectiveness in an under-resourced translation scenario with considerable improvements up to 2.6 BLEU points. In addition, the approach has achieved interesting and promising results when applied in the translation task that there is no direct parallel corpus between source and target languages.
Key facts. Cited by 76 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Nov 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 36; 2022: 18; 2023: 15; 2024: 5; 2025: 1; 2026: 1.
76 papers.
Sort:
- 2021WARP: Word-level Adversarial ReProgrammingcited by 220
- 2021Neural Machine Translation for Low-Resource Languages: A Surveycited by 108
- 2021The Multilingual TEDx Corpus for Speech Recognition and Translationcited by 101
- 2021Survey of Low-Resource Machine Translationcited by 92
- 2021A Survey on Green Deep Learningcited by 52
- 2021Multilingual training for Software Engineeringcited by 43
- 2021Improving Multilingual Translation by Representation and Gradient Regularizationcited by 31
- 2022CUNI-KIT System for Simultaneous Speech Translation Task at IWSLT 2022cited by 30
- 2021Language Tags Matter for Zero-Shot Neural Machine Translationcited by 29
- 2025Middle-Layer Representation Alignment for Cross-Lingual Transfer in Fine-Tuned LLMscited by 26
- 2021Importance-based Neuron Allocation for Multilingual Neural Machine Translationcited by 23
- 2022Causes and Cures for Interference in Multilingual Translationcited by 23
38 more
- 2021Multilingual Unsupervised Neural Machine Translation with Denoising Adapterscited by 22
- 2022Lego-MT: Learning Detachable Models for Massively Multilingual Machine Translationcited by 21
- 2022Towards the Next 1000 Languages in Multilingual Machine Translation: Exploring the Synergy Between Supervised and Self-Supervised Learningcited by 19
- 2021Distributionally Robust Multilingual Machine Translationcited by 18
- 2021Improving Neural Machine Translation by Bidirectional Trainingcited by 17
- 2021A Survey on Low-Resource Neural Machine Translationcited by 16
- 2023One Adapter for All Programming Languages? Adapter Tuning for Code Search and Summarizationcited by 16
- 2022Multilingual Machine Translation with Hyper-Adapterscited by 15
- 2023Viewing Knowledge Transfer in Multilingual Machine Translation Through a Representational Lenscited by 15
- 2021Rethinking Zero-shot Neural Machine Translation: From a Perspective of Latent Variablescited by 14
- 2022Language-Family Adapters for Low-Resource Multilingual Neural Machine Translationcited by 14
- 2021Efficient Weight factorization for Multilingual Speech Recognitioncited by 12
- 2022Multilingual Neural Machine Translation with Deep Encoder and Multiple Shallow Decoderscited by 12
- 2022MMTAfrica: Multilingual Machine Translation for African Languagescited by 11
- 2021Assessing Evaluation Metrics for Speech-to-Speech Translationcited by 10
- 2023Improving Zero-shot Multilingual Neural Machine Translation by Leveraging Cross-lingual Consistency Regularizationcited by 10
- 2023Beyond Shared Vocabulary: Increasing Representational Word Similarities across Languages for Multilingual Machine Translationcited by 9
- 2023Towards Higher Pareto Frontier in Multilingual Machine Translationcited by 9
- 2021Evaluating Multiway Multilingual NMT in the Turkic Languagescited by 8
- 2021Breaking Down Multilingual Machine Translationcited by 8
- 2021Towards Making the Most of Multilingual Pretraining for Zero-Shot Neural Machine Translationcited by 8
- 2021Prose2Poem: The Blessing of Transformers in Translating Prose to Persian Poetrycited by 7
- 2023Code-Switched Text Synthesis in Unseen Language Pairscited by 7
- 2021Zero-shot Speech Translationcited by 5
- 2021English2Gbe: A multilingual machine translation model for {Fon/Ewe}Gbecited by 5
- 2022Dodging the Data Bottleneck: Automatic Subtitling with Automatically Segmented ST Corporacited by 5
- 2021Family of Origin and Family of Choice: Massively Parallel Lexiconized Iterative Pretraining for Severely Low Resource Machine Translationcited by 4
- 2021Active Learning for Massively Parallel Translation of Constrained Text into Low Resource Languagescited by 4
- 2021Attentive fine-tuning of Transformers for Translation of low-resourced languages @LoResMT 2021cited by 4
- 2022Improving Zero-Shot Multilingual Translation with Universal Representations and Cross-Mappingscited by 4
- 2022Learning an Artificial Language for Knowledge-Sharing in Multilingual Translationcited by 4
- 2023Leveraging Timestamp Information for Serialized Joint Streaming Recognition and Translationcited by 4
- 2021BERTGEN: Multi-task Generation through BERTcited by 3
- 2023On the Off-Target Problem of Zero-Shot Multilingual Neural Machine Translationcited by 3
- 2024A Systematic Analysis of Subwords and Cross-Lingual Transfer in Multilingual Translationcited by 3
- 2021One Source, Two Targets: Challenges and Rewards of Dual Decodingcited by 2
- 2021EdinSaar@WMT21: North-Germanic Low-Resource Multilingual NMTcited by 2
- 2021Multilingual Neural Machine Translation:Can Linguistic Hierarchies Help?cited by 2
50 most cited of 76 All 76 (JSON)
- 2026The Impact of Vocabulary Overlaps on Knowledge Transfer in Multilingual Machine Translation5 May 2026
- 2025Middle-Layer Representation Alignment for Cross-Lingual Transfer in Fine-Tuned LLMs20 Feb 2025
- 2024On the Shortcut Learning in Multilingual Neural Machine Translation15 Nov 2024
- 2024Exploring Intrinsic Language-specific Subspaces in Fine-tuning Multilingual Neural Machine Translation8 Sep 2024
- 2024Decoupled Vocabulary Learning Enables Zero-Shot Translation from Unseen Languages5 Aug 2024
- 2024A Systematic Analysis of Subwords and Cross-Lingual Transfer in Multilingual Translation29 Mar 2024
- 2024Massively Multilingual Text Translation For Low-Resource Languages29 Jan 2024
- 2023Is Robustness Transferable across Languages in Multilingual Neural Machine Translation?31 Oct 2023
- 2023How To Build Competitive Multi-gender Speech Translation Models For Controlling Speaker Gender Translation23 Oct 2023
- 2023Leveraging Timestamp Information for Serialized Joint Streaming Recognition and Translation23 Oct 2023
- 2023Code-Switched Text Synthesis in Unseen Language Pairs26 May 2023
- 2023Towards Higher Pareto Frontier in Multilingual Machine Translation25 May 2023
38 more
- 2023Exploring Representational Disparities Between Multilingual and Bilingual Translation Models23 May 2023
- 2023Beyond Shared Vocabulary: Increasing Representational Word Similarities across Languages for Multilingual Machine Translation23 May 2023
- 2023Viewing Knowledge Transfer in Multilingual Machine Translation Through a Representational Lens19 May 2023
- 2023On the Off-Target Problem of Zero-Shot Multilingual Neural Machine Translation18 May 2023
- 2023Variable-length Neural Interlingua Representations for Zero-shot Neural Machine Translation17 May 2023
- 2023Improving Zero-shot Multilingual Neural Machine Translation by Leveraging Cross-lingual Consistency Regularization12 May 2023
- 2023Train Global, Tailor Local: Minimalist Multilingual Translation into Endangered Languages5 May 2023
- 2023Investigating Lexical Sharing in Multilingual Machine Translation for Indian Languages4 May 2023
- 2023One Adapter for All Programming Languages? Adapter Tuning for Code Search and Summarization28 Mar 2023
- 2023Efficiently Upgrading Multilingual Machine Translation Models to Support More Languages7 Feb 2023
- 2022Lego-MT: Learning Detachable Models for Massively Multilingual Machine Translation20 Dec 2022
- 2022Causes and Cures for Interference in Multilingual Translation14 Dec 2022
- 2022Efficient Speech Translation with Pre-trained Models9 Nov 2022
- 2022Learning an Artificial Language for Knowledge-Sharing in Multilingual Translation2 Nov 2022
- 2022Improving Zero-Shot Multilingual Translation with Universal Representations and Cross-Mappings28 Oct 2022
- 2022Can Domains Be Transferred Across Languages in Multi-Domain Multilingual Neural Machine Translation?20 Oct 2022
- 2022Language-Family Adapters for Low-Resource Multilingual Neural Machine Translation30 Sep 2022
- 2022Dodging the Data Bottleneck: Automatic Subtitling with Automatically Segmented ST Corpora21 Sep 2022
- 2022Informative Language Representation Learning for Massively Multilingual Neural Machine Translation4 Sep 2022
- 2022Language Tokens: A Frustratingly Simple Approach Improves Zero-Shot Performance of Multilingual Translation11 Aug 2022
- 2022Multilingual Neural Machine Translation with Deep Encoder and Multiple Shallow Decoders5 Jun 2022
- 2022Multilingual Machine Translation with Hyper-Adapters22 May 2022
- 2022Unifying the Convergences in Multilingual Neural Machine Translation3 May 2022
- 2022CUNI-KIT System for Simultaneous Speech Translation Task at IWSLT 202212 Apr 2022
- 2022MMTAfrica: Multilingual Machine Translation for African Languages8 Apr 2022
- 2022EAG: Extract and Generate Multi-way Aligned Corpus for Complete Multi-lingual Neural Machine Translation4 Mar 2022
- 2022Towards the Next 1000 Languages in Multilingual Machine Translation: Exploring the Synergy Between Supervised and Self-Supervised Learning9 Jan 2022
- 2022PAEG: Phrase-level Adversarial Example Generation for Neural Machine Translation6 Jan 2022
- 2021ViNMT: Neural Machine Translation Toolkit31 Dec 2021
- 2021English2Gbe: A multilingual machine translation model for {Fon/Ewe}Gbe13 Dec 2021
- 2021Multilingual training for Software Engineering3 Dec 2021
- 2021Ensembling of Distilled Models from Multi-task Teachers for Constrained Resource Language Pairs26 Nov 2021
- 2021A Survey on Green Deep Learning8 Nov 2021
- 2021Assessing Evaluation Metrics for Speech-to-Speech Translation26 Oct 2021
- 2021Multilingual Unsupervised Neural Machine Translation with Denoising Adapters20 Oct 2021
- 2021Towards Making the Most of Multilingual Pretraining for Zero-Shot Neural Machine Translation16 Oct 2021
- 2021Multilingual unsupervised sequence segmentation transfers to extremely low-resource languages16 Oct 2021
- 2021Breaking Down Multilingual Machine Translation15 Oct 2021
50 newest of 76 All 76 (JSON)
- 2021WARP: Word-level Adversarial ReProgrammingcited by 220
- 2021Neural Machine Translation for Low-Resource Languages: A Surveycited by 108
- 2021The Multilingual TEDx Corpus for Speech Recognition and Translationcited by 101
- 2021Survey of Low-Resource Machine Translationcited by 92
- 2021A Survey on Green Deep Learningcited by 52
- 2021Multilingual training for Software Engineeringcited by 43
- 2021Improving Multilingual Translation by Representation and Gradient Regularizationcited by 31
- 2022CUNI-KIT System for Simultaneous Speech Translation Task at IWSLT 2022cited by 30
- 2021Language Tags Matter for Zero-Shot Neural Machine Translationcited by 29
- 2025Middle-Layer Representation Alignment for Cross-Lingual Transfer in Fine-Tuned LLMscited by 26
- 2021Importance-based Neuron Allocation for Multilingual Neural Machine Translationcited by 23
- 2022Causes and Cures for Interference in Multilingual Translationcited by 23
12 most cited of 76 All 76 (JSON)
- 2026The Impact of Vocabulary Overlaps on Knowledge Transfer in Multilingual Machine Translation5 May 2026
- 2025Middle-Layer Representation Alignment for Cross-Lingual Transfer in Fine-Tuned LLMs20 Feb 2025
- 2024On the Shortcut Learning in Multilingual Neural Machine Translation15 Nov 2024
- 2024Exploring Intrinsic Language-specific Subspaces in Fine-tuning Multilingual Neural Machine Translation8 Sep 2024
- 2024Decoupled Vocabulary Learning Enables Zero-Shot Translation from Unseen Languages5 Aug 2024
- 2024A Systematic Analysis of Subwords and Cross-Lingual Transfer in Multilingual Translation29 Mar 2024
- 2024Massively Multilingual Text Translation For Low-Resource Languages29 Jan 2024
- 2023Is Robustness Transferable across Languages in Multilingual Neural Machine Translation?31 Oct 2023
- 2023How To Build Competitive Multi-gender Speech Translation Models For Controlling Speaker Gender Translation23 Oct 2023
- 2023Leveraging Timestamp Information for Serialized Joint Streaming Recognition and Translation23 Oct 2023
- 2023Code-Switched Text Synthesis in Unseen Language Pairs26 May 2023
- 2023Towards Higher Pareto Frontier in Multilingual Machine Translation25 May 2023
12 newest of 76 All 76 (JSON)