Zero-Resource Translation with Multi-Lingual Neural Machine Translation
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose a novel finetuning algorithm for the recently introduced multi-way, mulitlingual neural machine translate that enables zero-resource machine translation. When used together with novel many-to-one translation strategies, we empirically show that this finetuning algorithm allows the multi-way, multilingual model to translate a zero-resource language pair (1) as well as a single-pair neural translation model trained with up to 1M direct parallel sentences of the same language pair and (2) better than pivot-based translation strategy, while keeping only one additional copy of attention-related parameters.
Key facts. Cited by 46 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Jun 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 15; 2022: 10; 2023: 7; 2024: 8; 2025: 4; 2026: 2.
46 papers.
Sort:
By area:
- 2022Two-Stream Network for Sign Language Recognition and Translationcited by 122
- 2021Neural Machine Translation for Low-Resource Languages: A Surveycited by 108
- 2022Building Machine Translation Systems for the Next Thousand Languagescited by 69
- 2021Task Aligned Generative Meta-learning for Zero-shot Learningcited by 19
- 2021Zero-Shot Cross-lingual Semantic Parsingcited by 19
- 2022Towards the Next 1000 Languages in Multilingual Machine Translation: Exploring the Synergy Between Supervised and Self-Supervised Learningcited by 19
- 2021A Survey on Low-Resource Neural Machine Translationcited by 16
- 2023One Adapter for All Programming Languages? Adapter Tuning for Code Search and Summarizationcited by 16
- 2021Alternative Input Signals Ease Transfer in Multilingual Machine Translationcited by 14
- 2022MMTAfrica: Multilingual Machine Translation for African Languagescited by 11
- 2021Multilingual Translation via Grafting Pre-trained Language Modelscited by 10
- 2022UM4: Unified Multilingual Multiple Teacher-Student Model for Zero-Resource Neural Machine Translationcited by 10
34 more
- 2024Revealing the Parallel Multilingual Learning within Large Language Modelscited by 8
- 2025Bridging the Linguistic Divide: A Survey on Leveraging Large Language Models for Machine Translationcited by 8
- 2021Low-Resource Neural Machine Translation for Southern African Languagescited by 7
- 2022Multilingual Mix: Example Interpolation Improves Multilingual Neural Machine Translationcited by 7
- 2021Simultaneous Multi-Pivot Neural Machine Translationcited by 6
- 2022Modality-Balanced Embedding for Video Retrievalcited by 6
- 2023Investigating Multi-Pivot Ensembling with Massively Multilingual Machine Translation Modelscited by 5
- 2021AUGVIC: Exploiting BiText Vicinity for Low-Resource NMTcited by 4
- 2022Twist Decoding: Diverse Generators Guide Each Othercited by 4
- 2022Building Multilingual Machine Translation Systems That Serve Arbitrary X-Y Translationscited by 4
- 2021ParCourE: A Parallel Corpus Explorer for a Massively Multilingual Corpuscited by 3
- 2024Languages Transferred Within the Encoder: On Representation Transfer in Zero-Shot Multilingual Translationcited by 3
- 2024CharED: Character-wise Ensemble Decoding for Large Language Modelscited by 3
- 2021Revisiting Language Encoding in Learning Multilingual Representationscited by 2
- 2023Robustness of Multi-Source MT to Transcription Errorscited by 2
- 2023ZRIGF: An Innovative Multimodal Framework for Zero-Resource Image-Grounded Dialogue Generationcited by 2
- 2023Unlikelihood Tuning on Negative Samples Amazingly Improves Zero-Shot Translationcited by 2
- 2023How To Build Competitive Multi-gender Speech Translation Models For Controlling Speaker Gender Translationcited by 2
- 2021Self-Learning for Zero Shot Neural Machine Translationcited by 1
- 2021CUNI systems for WMT21: Multilingual Low-Resource Translation for Indo-European Languages Shared Taskcited by 1
- 2022Informative Language Representation Learning for Massively Multilingual Neural Machine Translationcited by 1
- 2024LCS: A Language Converter Strategy for Zero-Shot Neural Machine Translationcited by 1
- 2024How effective is Multi-source pivoting for Translation of Low Resource Indian Languages?cited by 1
- 2026Sheaf-Laplacian Obstruction and Projection Hardness for Cross-Modal Compatibility on a Modality-Independent Sitecited by 1
- 2021Zero-Shot Language Transfer vs Iterative Back Translation for Unsupervised Machine Translationcited by 0
- 2021Improving Zero-shot Multilingual Neural Machine Translation for Low-Resource Languagescited by 0
- 2023Direct Neural Machine Translation with Task-level Mixture of Experts modelscited by 0
- 2024Defining Boundaries: The Impact of Domain Specification on Cross-Language and Cross-Domain Transfer in Machine Translationcited by 0
- 2024Parallel Corpus Augmentation using Masked Language Modelscited by 0
- 2024Improving Language Transfer Capability of Decoder-only Architecture in Multilingual Neural Machine Translationcited by 0
- 2025Registering Source Tokens to Target Language Spaces in Multilingual Neural Machine Translationcited by 0
- 2025A Single Model Ensemble Framework for Neural Machine Translation using Pivot Translationcited by 0
- 2025Scaling Laws for Conditional Emergence of Multilingual Image Captioning via Generalization from Translationcited by 0
- 2026Data Kernel Perspective Space Performance Guarantees for Synthetic Data from Transformer Modelscited by 0
- 2026Sheaf-Laplacian Obstruction and Projection Hardness for Cross-Modal Compatibility on a Modality-Independent Site8 Apr 2026
- 2026Data Kernel Perspective Space Performance Guarantees for Synthetic Data from Transformer Models4 Feb 2026
- 2025Bridging the Linguistic Divide: A Survey on Leveraging Large Language Models for Machine Translation2 Apr 2025
- 2025Scaling Laws for Conditional Emergence of Multilingual Image Captioning via Generalization from Translation12 Mar 2025
- 2025A Single Model Ensemble Framework for Neural Machine Translation using Pivot Translation3 Feb 2025
- 2025Registering Source Tokens to Target Language Spaces in Multilingual Neural Machine Translation6 Jan 2025
- 2024Improving Language Transfer Capability of Decoder-only Architecture in Multilingual Neural Machine Translation3 Dec 2024
- 2024Parallel Corpus Augmentation using Masked Language Models4 Oct 2024
- 2024Defining Boundaries: The Impact of Domain Specification on Cross-Language and Cross-Domain Transfer in Machine Translation21 Aug 2024
- 2024CharED: Character-wise Ensemble Decoding for Large Language Models25 Jun 2024
- 2024How effective is Multi-source pivoting for Translation of Low Resource Indian Languages?19 Jun 2024
- 2024Languages Transferred Within the Encoder: On Representation Transfer in Zero-Shot Multilingual Translation12 Jun 2024
34 more
- 2024LCS: A Language Converter Strategy for Zero-Shot Neural Machine Translation5 Jun 2024
- 2024Revealing the Parallel Multilingual Learning within Large Language Models14 Mar 2024
- 2023Investigating Multi-Pivot Ensembling with Massively Multilingual Machine Translation Models13 Nov 2023
- 2023How To Build Competitive Multi-gender Speech Translation Models For Controlling Speaker Gender Translation23 Oct 2023
- 2023Direct Neural Machine Translation with Task-level Mixture of Experts models18 Oct 2023
- 2023Unlikelihood Tuning on Negative Samples Amazingly Improves Zero-Shot Translation28 Sep 2023
- 2023ZRIGF: An Innovative Multimodal Framework for Zero-Resource Image-Grounded Dialogue Generation1 Aug 2023
- 2023Robustness of Multi-Source MT to Transcription Errors26 May 2023
- 2023One Adapter for All Programming Languages? Adapter Tuning for Code Search and Summarization28 Mar 2023
- 2022Two-Stream Network for Sign Language Recognition and Translation2 Nov 2022
- 2022Informative Language Representation Learning for Massively Multilingual Neural Machine Translation4 Sep 2022
- 2022UM4: Unified Multilingual Multiple Teacher-Student Model for Zero-Resource Neural Machine Translation11 Jul 2022
- 2022Building Multilingual Machine Translation Systems That Serve Arbitrary X-Y Translations30 Jun 2022
- 2022Twist Decoding: Diverse Generators Guide Each Other19 May 2022
- 2022Building Machine Translation Systems for the Next Thousand Languages9 May 2022
- 2022Modality-Balanced Embedding for Video Retrieval18 Apr 2022
- 2022MMTAfrica: Multilingual Machine Translation for African Languages8 Apr 2022
- 2022Multilingual Mix: Example Interpolation Improves Multilingual Neural Machine Translation15 Mar 2022
- 2022Towards the Next 1000 Languages in Multilingual Machine Translation: Exploring the Synergy Between Supervised and Self-Supervised Learning9 Jan 2022
- 2021Alternative Input Signals Ease Transfer in Multilingual Machine Translation15 Oct 2021
- 2021Improving Zero-shot Multilingual Neural Machine Translation for Low-Resource Languages2 Oct 2021
- 2021CUNI systems for WMT21: Multilingual Low-Resource Translation for Indo-European Languages Shared Task20 Sep 2021
- 2021Multilingual Translation via Grafting Pre-trained Language Models11 Sep 2021
- 2021ParCourE: A Parallel Corpus Explorer for a Massively Multilingual Corpus14 Jul 2021
- 2021A Survey on Low-Resource Neural Machine Translation9 Jul 2021
- 2021Neural Machine Translation for Low-Resource Languages: A Survey29 Jun 2021
- 2021AUGVIC: Exploiting BiText Vicinity for Low-Resource NMT9 Jun 2021
- 2021Zero-Shot Cross-lingual Semantic Parsing15 Apr 2021
- 2021Simultaneous Multi-Pivot Neural Machine Translation15 Apr 2021
- 2021Low-Resource Neural Machine Translation for Southern African Languages1 Apr 2021
- 2021Zero-Shot Language Transfer vs Iterative Back Translation for Unsupervised Machine Translation31 Mar 2021
- 2021Self-Learning for Zero Shot Neural Machine Translation10 Mar 2021
- 2021Task Aligned Generative Meta-learning for Zero-shot Learning3 Mar 2021
- 2021Revisiting Language Encoding in Learning Multilingual Representations16 Feb 2021
- 2022Two-Stream Network for Sign Language Recognition and Translationcited by 122
- 2021Neural Machine Translation for Low-Resource Languages: A Surveycited by 108
- 2022Building Machine Translation Systems for the Next Thousand Languagescited by 69
- 2021Task Aligned Generative Meta-learning for Zero-shot Learningcited by 19
- 2021Zero-Shot Cross-lingual Semantic Parsingcited by 19
- 2022Towards the Next 1000 Languages in Multilingual Machine Translation: Exploring the Synergy Between Supervised and Self-Supervised Learningcited by 19
- 2021A Survey on Low-Resource Neural Machine Translationcited by 16
- 2023One Adapter for All Programming Languages? Adapter Tuning for Code Search and Summarizationcited by 16
- 2021Alternative Input Signals Ease Transfer in Multilingual Machine Translationcited by 14
- 2022MMTAfrica: Multilingual Machine Translation for African Languagescited by 11
- 2021Multilingual Translation via Grafting Pre-trained Language Modelscited by 10
- 2022UM4: Unified Multilingual Multiple Teacher-Student Model for Zero-Resource Neural Machine Translationcited by 10
12 most cited of 42 All 42 (JSON)
- 2026Sheaf-Laplacian Obstruction and Projection Hardness for Cross-Modal Compatibility on a Modality-Independent Site8 Apr 2026
- 2025Bridging the Linguistic Divide: A Survey on Leveraging Large Language Models for Machine Translation2 Apr 2025
- 2025A Single Model Ensemble Framework for Neural Machine Translation using Pivot Translation3 Feb 2025
- 2025Registering Source Tokens to Target Language Spaces in Multilingual Neural Machine Translation6 Jan 2025
- 2024Improving Language Transfer Capability of Decoder-only Architecture in Multilingual Neural Machine Translation3 Dec 2024
- 2024Parallel Corpus Augmentation using Masked Language Models4 Oct 2024
- 2024Defining Boundaries: The Impact of Domain Specification on Cross-Language and Cross-Domain Transfer in Machine Translation21 Aug 2024
- 2024How effective is Multi-source pivoting for Translation of Low Resource Indian Languages?19 Jun 2024
- 2024Languages Transferred Within the Encoder: On Representation Transfer in Zero-Shot Multilingual Translation12 Jun 2024
- 2024LCS: A Language Converter Strategy for Zero-Shot Neural Machine Translation5 Jun 2024
- 2024Revealing the Parallel Multilingual Learning within Large Language Models14 Mar 2024
- 2023Investigating Multi-Pivot Ensembling with Massively Multilingual Machine Translation Models13 Nov 2023
12 newest of 42 All 42 (JSON)