mlsanityData to 7 Oct 2026

Quality Does Matter: A Detailed Look at the Quality and Utility of Web-Mined Parallel Corpora

arXiv 2402.07446 ↗First posted 12 Feb 2024cs.CLcited by 13

Not on the map. Why?

Abstract (arXiv)

We conducted a detailed analysis on the quality of web-mined corpora for two low-resource languages (making three language pairs, English-Sinhala, English-Tamil and Sinhala-Tamil). We ranked each corpus according to a similarity measure and carried out an intrinsic and extrinsic evaluation on different portions of this ranked corpus. We show that there are significant quality differences between different portions of web-mined corpora and that the quality varies across languages and datasets. We also show that, for some web-mined datasets, Neural Machine Translation (NMT) models trained with their highest-ranked 25k portion can be on par with human-curated datasets.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 24 of its 45 references that are in the map. First posted on arXiv 12 Feb 2024.

Builds on

24 of 45 references.

References · 24

  1. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  2. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
  3. 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,486
  4. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,290
  5. 2016Bag of Tricks for Efficient Text Classificationcited by 869
  6. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 789
  7. 2020Beyond English-Centric Multilingual Machine Translationcited by 559
  8. 2021The FLORES-101 Evaluation Benchmark for Low-Resource and Multilingual Machine Translationcited by 556
  9. 2018Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyondcited by 434
  10. 2016FastText.zip: Compressing text classification modelscited by 331
  11. 2019WikiMatrix: Mining 135M Parallel Sentences in 1620 Language Pairs from Wikipediacited by 221
  12. 2019CCMatrix: Mining Billions of High-Quality Parallel Sentences on the WEBcited by 177
12 more
  1. 2023Stop Uploading Test Data in Plain Text: Practical Strategies for Mitigating Data Contamination by Evaluation Benchmarkscited by 139
  2. 2019CCAligned: A Massive Collection of Cross-Lingual Web-Document Pairscited by 136
  3. 2021Neural Machine Translation for Low-Resource Languages: A Surveycited by 108
  4. 2018Margin-based Parallel Corpus Mining with Multilingual Sentence Embeddingscited by 83
  5. 2018On the Impact of Various Types of Noise on Neural Machine Translationcited by 76
  6. 2022Building Machine Translation Systems for the Next Thousand Languagescited by 69
  7. 2022Some Languages are More Equal than Others: Probing Deeper into the Linguistic Disparity in the NLP Worldcited by 55
  8. 2019Survey on Publicly Available Sinhala Natural Language Processing Tools and Researchcited by 45
  9. 2022Pre-Trained Multilingual Sequence-to-Sequence Models: A Hope for Low-Resource Language Translation?cited by 24
  10. 2020Data Augmentation and Terminology Integration for Domain-Specific Sinhala-English-Tamil Statistical Machine Translationcited by 16
  11. 2021XLEnt: Mining a Large Cross-lingual Entity Dataset with Lexical-Semantic-Phonetic Word Alignmentcited by 15
  12. 2023Leveraging Auxiliary Domain Parallel Data in Intermediate Task Fine-tuning for Low-resource Translationcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 7; 2025: 3; 2026: 3.

13 papers.

Sort:

  1. 2024Sinhala Transliteration: A Comparative Analysis Between Rule-based and Seq2Seq Approachescited by 6
  2. 2024Leveraging Large Language Models to Measure Gender Representation Bias in Gendered Language Corporacited by 5
  3. 2024How to Learn in a Noisy World? Self-Correcting the Real-World Data Noise in Machine Translationcited by 4
  4. 2024SiTSE: Sinhala Text Simplification Dataset and Evaluationcited by 3
  5. 2025Improving the quality of Web-mined Parallel Corpora of Low-Resource Languages using Debiasing Heuristicscited by 3
  6. 2025How Do LLMs Persuade? Linear Probes Can Uncover Persuasion Dynamics in Multi-Turn Conversationscited by 3
  7. 2024Exploiting Domain-Specific Parallel Data on Multilingual Language Models for Low-resource Language Translationcited by 2
  8. 2024Pralekha: Cross-Lingual Document Alignment for Indic Languagescited by 1
  9. 2025ACADATA: Parallel Dataset of Academic Data for Machine Translationcited by 1
  10. 2026EnSiTa - A Trilingual Multi-Domain Parallel Dataset and Benchmark for Domain-Specific Machine Translationcited by 1
  11. 2024Unsupervised Bilingual Lexicon Induction for Low Resource Languagescited by 0
  12. 2026Why Low-Resource NLP Needs More Than Cross-Lingual Transfer: Lessons Learned from Luxembourgishcited by 0
1 more
  1. 2026Trilingual Topic Modeling of Sri Lankan Parliamentary Debatescited by 0