mlsanityData to 14 Oct 2026

Unsupervised Machine Translation Using Monolingual Corpora Only

arXiv 1711.00043 ↗First posted 31 Oct 2017cs.CL cs.AIcited by 273

Not on the map. Why?

Abstract (arXiv)

Machine translation has recently achieved impressive performance thanks to recent advances in deep learning and the availability of large-scale parallel corpora. There have been numerous attempts to extend these successes to low-resource language pairs, yet requiring tens of thousands of parallel sentences. In this work, we take this research direction to the extreme and investigate whether it is possible to learn to translate even without any parallel data. We propose a model that takes sentences from monolingual corpora in two different languages and maps them into the same latent space. By learning to reconstruct in both languages from this shared feature space, the model effectively learns to translate without using any labeled data. We demonstrate our model on two widely used datasets and two language pairs, reporting BLEU scores of 32.8 and 15.1 on the Multi30k and WMT English-French datasets, without using even a single parallel sentence at training time.

Key facts. Cited by 273 papers in the map (data through 14 Oct 2026). First posted on arXiv 31 Oct 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 84; 2022: 66; 2023: 47; 2024: 37; 2025: 25; 2026: 14.

273 papers.

Sort:

By area:

  1. 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,175
  2. 2022data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Languagecited by 727
  3. 2021True Few-Shot Learning with Language Modelscited by 344
  4. 2022Autoformalization with Large Language Modelscited by 263
  5. 2022Self-Supervised Speech Representation Learning: A Reviewcited by 260
  6. 2023ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual Learningcited by 206
  7. 2021CodeNet: A Large-Scale AI for Code Dataset for Learning a Diversity of Coding Taskscited by 200
  8. 2023ProofNet: Autoformalizing and Formally Proving Undergraduate-Level Mathematicscited by 192
  9. 2021Unsupervised Speech Recognitioncited by 148
  10. 2021BERT: A Review of Applications in Natural Language Processing and Understandingcited by 109
  11. 2021Neural Machine Translation for Low-Resource Languages: A Surveycited by 109
  12. 2021Contrastive Learning for Many-to-many Multilingual Neural Machine Translationcited by 108
38 more
  1. 2021An Empirical Survey of Data Augmentation for Limited Data Learning in NLPcited by 101
  2. 2022A Few Thousand Translations Go a Long Way! Leveraging Pre-trained Models for African News Translationcited by 98
  3. 2024Towards Guaranteed Safe AI: A Framework for Ensuring Robust and Reliable AI Systemscited by 96
  4. 2021Survey of Low-Resource Machine Translationcited by 92
  5. 2023The unreasonable effectiveness of few-shot learning for machine translationcited by 91
  6. 2024Formal Mathematical Reasoning: A New Frontier in AIcited by 81
  7. 2022Meaning without reference in large language modelscited by 76
  8. 2023A Benchmark for Learning to Translate a New Language from One Grammar Bookcited by 75
  9. 2021Break-It-Fix-It: Unsupervised Learning for Program Repaircited by 71
  10. 2022Building Machine Translation Systems for the Next Thousand Languagescited by 69
  11. 2021DOBF: A Deobfuscation Pre-Training Objective for Programming Languagescited by 68
  12. 2023Self-Supervised Multimodal Learning: A Surveycited by 58
  13. 2022Transferability in Deep Learning: A Surveycited by 57
  14. 2021Are Multilingual Models Effective in Code-Switching?cited by 56
  15. 2025Harnessing the Universal Geometry of Embeddingscited by 55
  16. 2021How to Adapt Your Pretrained Multilingual Model to 1600 Languagescited by 54
  17. 2021AmericasNLI: Evaluating Zero-shot Natural Language Understanding of Pretrained Multilingual Models in Truly Low-resource Languagescited by 50
  18. 2024LLaMAX: Scaling Linguistic Horizons of LLM by Enhancing Translation Capabilities Beyond 100 Languagescited by 48
  19. 2022Code Translation with Compiler Representationscited by 42
  20. 2021TreeBERT: A Tree-Based Pre-Trained Model for Programming Languagecited by 41
  21. 2021Consistency Regularization for Cross-Lingual Fine-Tuningcited by 41
  22. 2023Multilingual Mathematical Autoformalizationcited by 39
  23. 2025Refusal Direction is Universal Across Safety-Aligned Languagescited by 38
  24. 2021Zero-shot Natural Language Video Localizationcited by 34
  25. 2021Multi-modal Sarcasm Detection and Humor Classification in Code-mixed Conversationscited by 33
  26. 2021LM-Critic: Language Models for Unsupervised Grammatical Error Correctioncited by 33
  27. 2021Civil Rephrases Of Toxic Texts With Self-Supervised Transformerscited by 32
  28. 2022Inducing Positive Perspectives with Text Reframingcited by 31
  29. 2022BERTIN: Efficient Pre-Training of a Spanish Language Model using Perplexity Samplingcited by 30
  30. 2021Continual Mixed-Language Pre-Training for Extremely Low-Resource Neural Machine Translationcited by 29
  31. 2021From Machine Translation to Code-Switching: Generating High-Quality Code-Switched Textcited by 29
  32. 2022Text Style Transfer for Bias Mitigation using Masked Language Modelingcited by 28
  33. 2021MAGIC: Multimodal relAtional Graph adversarIal inferenCe for Diverse and Unpaired Text-based Image Captioningcited by 27
  34. 2023Scene Graph as Pivoting: Inference-time Image-free Unsupervised Multimodal Machine Translation with Visual Scene Hallucinationcited by 27
  35. 2023Ethical Considerations for Machine Translation of Indigenous Languages: Giving a Voice to the Speakerscited by 27
  36. 2022Match the Script, Adapt if Multilingual: Analyzing the Effect of Multilingual Pretraining on Cross-lingual Transferabilitycited by 26
  37. 2021Broad-UNet: Multi-scale feature learning for nowcasting taskscited by 25
  38. 2023Pre-training for Speech Translation: CTC Meets Optimal Transportcited by 25

50 most cited of 273 All 273 (JSON)