mlsanityData to 14 Oct 2026

Filtering and Mining Parallel Data in a Joint Multilingual Space

arXiv 1805.09822 ↗First posted 24 May 2018cs.CL cs.AIcited by 32

Not on the map. Why?

Abstract (arXiv)

We learn a joint multilingual sentence embedding and use the distance between sentences in different languages to filter noisy parallel data and to mine for parallel data in large news collections. We are able to improve a competitive baseline on the WMT'14 English to German task by 0.3 BLEU by filtering out 25% of the training data. The same approach is used to mine additional bitexts for the WMT'14 system and to obtain competitive results on the BUCC shared task to identify parallel sentences in comparable corpora. The approach is generic, it can be applied to many language pairs and it is independent of the architecture of the machine translation system.

Key facts. Cited by 32 papers in the map (data through 14 Oct 2026). First posted on arXiv 24 May 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 10; 2022: 14; 2023: 4; 2024: 2; 2025: 0; 2026: 2.

32 papers.

Sort:

By area:

  1. 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 836
  2. 2021The Curious Case of Hallucinations in Neural Machine Translationcited by 161
  3. 2021Neural Machine Translation for Low-Resource Languages: A Surveycited by 109
  4. 2022Bitext Mining Using Distilled Sentence Representations for Low-Resource Languagescited by 48
  5. 2022SpeechMatrix: A Large-Scale Mined Corpus of Multilingual Speech-to-Speech Translationscited by 35
  6. 2022SAMU-XLSR: Semantically-Aligned Multimodal Utterance-level Cross-Lingual Speech Representationcited by 32
  7. 2022Pre-Trained Multilingual Sequence-to-Sequence Models: A Hope for Low-Resource Language Translation?cited by 24
  8. 2021Paraphrastic Representations at Scalecited by 21
  9. 2021Bilingual Lexicon Induction via Unsupervised Bitext Construction and Word Alignmentcited by 19
  10. 2022MSCTD: A Multimodal Sentiment Chat Translation Datasetcited by 15
  11. 2024Critical Learning Periods: Leveraging Early Training Dynamics for Efficient Data Pruningcited by 10
  12. 2021Unsupervised Multilingual Sentence Embeddings for Parallel Corpus Miningcited by 9
20 more
  1. 2023Dual-Alignment Pre-training for Cross-lingual Sentence Embeddingcited by 9
  2. 2022Language Agnostic Multilingual Information Retrieval with Contrastive Learningcited by 8
  3. 2022Very Low Resource Sentence Alignment: Luhya and Swahilicited by 6
  4. 2021Majority Voting with Bidirectional Pre-translation For Bitext Retrievalcited by 5
  5. 2021Self-Supervised Knowledge Assimilation for Expert-Layman Text Style Transfercited by 5
  6. 2022Retrofitting Multilingual Sentence Embeddings with Abstract Meaning Representationcited by 5
  7. 2022Beyond Contrastive Learning: A Variational Generative Model for Multilingual Retrievalcited by 5
  8. 2023Leveraging Auxiliary Domain Parallel Data in Intermediate Task Fine-tuning for Low-resource Translationcited by 5
  9. 2026MITRA: A Large-Scale Parallel Corpus and Multilingual Pretrained Language Model for Machine Translation and Semantic Retrieval for P=ali, Sanskrit, Buddhist Chinese, and Tibetancited by 5
  10. 2021Low-Resource Machine Translation Training Curriculum Fit for Low-Resource Languagescited by 3
  11. 2021BitextEdit: Automatic Bitext Editing for Improved Low-Resource Machine Translationcited by 3
  12. 2022OneAligner: Zero-shot Cross-lingual Transfer with One Rich-Resource Language Pair for Low-Resource Sentence Retrievalcited by 3
  13. 2021Secoco: Self-Correcting Encoding for Neural Machine Translationcited by 2
  14. 2022Cross-Lingual Phrase Retrievalcited by 2
  15. 2024Mitigating Semantic Leakage in Cross-lingual Embeddings via Orthogonality Constraintcited by 1
  16. 2022Learning How to Translate North Korean through South Koreancited by 0
  17. 2022Finetuning a Kalaallisut-English machine translation system using web-crawled datacited by 0
  18. 2023A General-Purpose Multilingual Document Encodercited by 0
  19. 2023Boosting Unsupervised Machine Translation with Pseudo-Parallel Datacited by 0
  20. 2026Model-Based Quality Assessment for Massively Multilingual Parallel Datacited by 0