mlsanityData to 7 Oct 2026

Parallel Corpora for Machine Translation in Low-resource Indic Languages: A Comprehensive Review

arXiv 2503.04797 ↗First posted 2 Mar 2025cs.CL cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

Parallel corpora play an important role in training machine translation (MT) models, particularly for low-resource languages where high-quality bilingual data is scarce. This review provides a comprehensive overview of available parallel corpora for Indic languages, which span diverse linguistic families, scripts, and regional variations. We categorize these corpora into text-to-text, code-switched, and various categories of multimodal datasets, highlighting their significance in the development of robust multilingual MT systems. Beyond resource enumeration, we critically examine the challenges faced in corpus creation, including linguistic diversity, script variation, data scarcity, and the prevalence of informal textual content.We also discuss and evaluate these corpora in various terms such as alignment quality and domain representativeness. Furthermore, we address open challenges such as data imbalance across Indic languages, the trade-off between quality and quantity, and the impact of noisy, informal, and dialectal data on MT performance. Finally, we outline future directions, including leveraging cross-lingual transfer learning, expanding multilingual datasets, and integrating multimodal resources to enhance translation quality. To the best of our knowledge, this paper presents the first comprehensive review of parallel corpora specifically tailored for low-resource Indic languages in the context of machine translation.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 48 of its 89 references that are in the map. First posted on arXiv 2 Mar 2025.

Builds on

48 of 89 references.

References · 48

  1. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  2. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,290
  3. 2019Cross-lingual Language Model Pretrainingcited by 1,088
  4. 2020COMET: A Neural Framework for MT Evaluationcited by 1,024
  5. 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,004
  6. 2015Improving Neural Machine Translation Models with Monolingual Datacited by 784
  7. 2020Beyond English-Centric Multilingual Machine Translationcited by 559
  8. 2018Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyondcited by 434
  9. 2019Mitigating Gender Bias in Natural Language Processing: Literature Reviewcited by 287
  10. 2019Evaluating Gender Bias in Machine Translationcited by 247
  11. 2019WikiMatrix: Mining 135M Parallel Sentences in 1620 Language Pairs from Wikipediacited by 221
  12. 2024An Introduction to Vision-Language Modelingcited by 175
36 more
  1. 2023IndicTrans2: Towards High-Quality and Accessible Machine Translation Models for all 22 Scheduled Indian Languagescited by 149
  2. 2019CCAligned: A Massive Collection of Cross-Lingual Web-Document Pairscited by 136
  3. 2021Samanantar: The Largest Publicly Available Parallel Corpora Collection for 11 Indic Languagescited by 133
  4. 2015Yara Parser: A Fast and Accurate Dependency Parsercited by 110
  5. 2020GLUECoS : An Evaluation Benchmark for Code-Switched NLPcited by 101
  6. 2021Survey of Low-Resource Machine Translationcited by 92
  7. 2017The IIT Bombay English-Hindi Parallel Corpuscited by 74
  8. 2019A Survey of Code-switched Speech and Language Processingcited by 73
  9. 2020TICO-19: the Translation Initiative for Covid-19cited by 67
  10. 2024A New Massive Multilingual Dataset for High-Performance Language Technologiescited by 56
  11. 2020QED: A Framework and Dataset for Explanations in Question Answeringcited by 55
  12. 2020PMIndia -- A Collection of Parallel Corpora of Languages of Indiacited by 40
  13. 2020PHINC: A Parallel Hinglish Social Media Code-Mixed Corpus for Machine Translationcited by 38
  14. 2022Towards Building Text-To-Speech Systems for the Next Billion Userscited by 27
  15. 2021Multilingual Code-Switching for Zero-Shot Cross-Lingual Intent Prediction and Slot Fillingcited by 25
  16. 2024CulturePark: Boosting Cross-cultural Understanding in Large Language Modelscited by 24
  17. 2025Advances in Multimodal Adaptation and Generalization: From Traditional Approaches to Foundation Modelscited by 23
  18. 2024GenTranslate: Large Language Models are Generative Multilingual Speech and Machine Translatorscited by 22
  19. 2021Language Modeling, Lexical Translation, Reordering: The Training Process of NMT through the Lens of Classical SMTcited by 21
  20. 2024Enhancing Visual Question Answering through Question-Driven Image Captions as Promptscited by 18
  21. 2019Hindi Visual Genome: A Dataset for Multimodal English-to-Hindi Machine Translationcited by 16
  22. 2020Parallel Corpus Filtering via Pre-trained Language Modelscited by 15
  23. 2017Learning Character-level Compositionality with Visual Featurescited by 12
  24. 2020Revisiting Low Resource Status of Indian Languages in Machine Translationcited by 12
  25. 2024What is lost in Normalization? Exploring Pitfalls in Multilingual ASR Model Evaluationscited by 12
  26. 2024Transcending Language Boundaries: Harnessing LLMs for Low-Resource Language Translationcited by 12
  27. 2017Building a Web-Scale Dependency-Parsed Corpus from CommonCrawlcited by 9
  28. 2024Benchmarking GPT-4 against Human Translators: A Comprehensive Evaluation Across Languages, Domains, and Expertise Levelscited by 9
  29. 2024xCOMET-lite: Bridging the Gap Between Efficiency and Quality in Learned MT Evaluation Metricscited by 7
  30. 2022Improving Multilingual Neural Machine Translation System for Indic Languagescited by 6
  31. 2024BhashaVerse : Translation Ecosystem for Indian Subcontinent Languagescited by 5
  32. 2023A Survey on Image-text Multimodal Modelscited by 4
  33. 2024Towards Building Large Scale Datasets and State-of-the-Art Automatic Speech Translation Systems for 14 Indian Languagescited by 4
  34. 2025Large Multimodal Models for Low-Resource Languages: A Surveycited by 4
  35. 2024Textual Similarity as a Key Metric in Machine Translation Quality Estimationcited by 2
  36. 2024On Instruction-Finetuning Neural Machine Translation Modelscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 2.

4 papers.