mlsanityData to 7 Oct 2026

An Empirical study of Unsupervised Neural Machine Translation: analyzing NMT output, model's behavior and sentences' contribution

arXiv 2312.12588 ↗First posted 19 Dec 2023cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Unsupervised Neural Machine Translation (UNMT) focuses on improving NMT results under the assumption there is no human translated parallel data, yet little work has been done so far in highlighting its advantages compared to supervised methods and analyzing its output in aspects other than translation accuracy. We focus on three very diverse languages, French, Gujarati, and Kazakh, and train bilingual NMT models, to and from English, with various levels of supervision, in high- and low- resource setups, measure quality of the NMT output and compare the generated sequences' word order and semantic similarity to source and reference sentences. We also use Layer-wise Relevance Propagation to evaluate the source and target sentences' contribution to the result, expanding the findings of previous works to the UNMT paradigm.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 44 references that are in the map. First posted on arXiv 19 Dec 2023.

Builds on

25 of 44 references.

References · 25

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  3. 2019Cross-lingual Language Model Pretrainingcited by 1,088
  4. 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,028
  5. 2015Improving Neural Machine Translation Models with Monolingual Datacited by 784
  6. 2017Word Translation Without Parallel Datacited by 480
  7. 2019MASS: Masked Sequence to Sequence Pre-training for Language Generationcited by 345
  8. 2017Unsupervised Machine Translation Using Monolingual Corpora Onlycited by 272
  9. 2017Unsupervised Neural Machine Translationcited by 148
  10. 2018Phrase-Based & Neural Unsupervised Machine Translationcited by 138
  11. 2021Measure and Improve Robustness in NLP Models: A Surveycited by 107
  12. 2018Margin-based Parallel Corpus Mining with Multilingual Sentence Embeddingscited by 83
13 more
  1. 2020Analyzing the Source and Target Contributions to Predictions in Neural Machine Translationcited by 71
  2. 2020When Does Unsupervised Machine Translation Work?cited by 38
  3. 2019An Effective Approach to Unsupervised Machine Translationcited by 37
  4. 2020Evaluating Robustness to Input Perturbations for Neural Machine Translationcited by 36
  5. 2020When and Why is Unsupervised Neural Machine Translation Useless?cited by 34
  6. 2020A Multilingual View of Unsupervised Machine Translationcited by 23
  7. 2020Harnessing Multilinguality in Unsupervised Machine Translation for Rare Languagescited by 22
  8. 2021On Explaining Your Explanations of BERT: An Empirical Study with Sequence Classificationcited by 21
  9. 2021Language Modeling, Lexical Translation, Reordering: The Training Process of NMT through the Lens of Classical SMTcited by 21
  10. 2020Unsupervised Bitext Mining and Translation via Self-trained Contextual Embeddingscited by 16
  11. 2018Unsupervised Multi-modal Neural Machine Translationcited by 15
  12. 2021On Systematic Style Differences between Unsupervised and Supervised MT and an Application for High-Resource Machine Translationcited by 4
  13. 2022Flow-Adapter Architecture for Unsupervised Machine Translationcited by 4

Built on by

Not cited yet.