mlsanityData to 7 Oct 2026

PMIndia -- A Collection of Parallel Corpora of Languages of India

arXiv 2001.09907 ↗First posted 27 Jan 2020cs.CLcited by 40

Not on the map. Why?

Abstract (arXiv)

Parallel text is required for building high-quality machine translation (MT) systems, as well as for other multilingual NLP applications. For many South Asian languages, such data is in short supply. In this paper, we described a new publicly available corpus (PMIndia) consisting of parallel sentences which pair 13 major languages of India with English. The corpus includes up to 56000 sentences for each language pair. We explain how the corpus was constructed, including an assessment of two different automatic sentence alignment methods, and present some initial NMT results on the corpus.

Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 Jan 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 10; 2022: 7; 2023: 10; 2024: 5; 2025: 4; 2026: 4.

40 papers.

Sort:

  1. 2023MADLAD-400: A Multilingual And Document-Level Large Audited Datasetcited by 180
  2. 2021MuRIL: Multilingual Representations for Indian Languagescited by 177
  3. 2021Samanantar: The Largest Publicly Available Parallel Corpora Collection for 11 Indic Languagescited by 133
  4. 2021AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processingcited by 131
  5. 2022Towards Leaving No Indic Language Behind: Building Monolingual Corpora, Benchmark and Models for Indic Languagescited by 99
  6. 2021Survey of Low-Resource Machine Translationcited by 92
  7. 2022Building Machine Translation Systems for the Next Thousand Languagescited by 69
  8. 2022NusaX: Multilingual Parallel Sentiment Dataset for 10 Indonesian Local Languagescited by 67
  9. 2021MURAL: Multimodal, Multitask Retrieval Across Languagescited by 44
  10. 2021IndicBART: A Pre-trained Model for Indic Natural Language Generationcited by 39
  11. 2021Many-to-English Machine Translation Tools, Data, and Pretrained Modelscited by 31
  12. 2022IndicXNLI: Evaluating Multilingual Inference for Indian Languagescited by 26
28 more
  1. 2022Pre-Trained Multilingual Sequence-to-Sequence Models: A Hope for Low-Resource Language Translation?cited by 24
  2. 2024ProxyLM: Predicting Language Model Performance on Multilingual Tasks via Proxy Modelscited by 20
  3. 2021Itihasa: A large-scale corpus for Sanskrit to English translationcited by 13
  4. 2023PMIndiaSum: Multilingual and Cross-lingual Headline Summarization for Languages in Indiacited by 11
  5. 2025SMOL: Professionally translated parallel data for 115 under-represented languagescited by 11
  6. 2023Improving Machine Translation with Phrase Pair Injection and Corpus Filteringcited by 7
  7. 2022Improving Multilingual Neural Machine Translation System for Indic Languagescited by 6
  8. 2023Leveraging Auxiliary Domain Parallel Data in Intermediate Task Fine-tuning for Low-resource Translationcited by 5
  9. 2021Unsupervised Machine Translation On Dravidian Languagescited by 4
  10. 2023AxomiyaBERTa: A Phonologically-aware Transformer Model for Assamesecited by 4
  11. 2023MILPaC: A Novel Benchmark for Evaluating Translation of Legal Text to Indian Languagescited by 4
  12. 2024Decoding the Diversity: A Review of the Indic AI Research Landscapecited by 4
  13. 2025Parallel Corpora for Machine Translation in Low-resource Indic Languages: A Comprehensive Reviewcited by 4
  14. 2026OpenLID-v3: Improving the Precision of Closely Related Language Identification -- An Experience Reportcited by 4
  15. 2026When Flores Bloomz Wrong: Cross-Direction Contamination in Machine Translation Evaluationcited by 3
  16. 2022Cost-Effective Training in Low-Resource Neural Machine Translationcited by 2
  17. 2023"A Little is Enough": Few-Shot Quality Estimation based Corpus Filtering improves Machine Translationcited by 2
  18. 2024Exploiting Domain-Specific Parallel Data on Multilingual Language Models for Low-resource Language Translationcited by 2
  19. 2023Evaluating Inter-Bilingual Semantic Parsing for Indian Languagescited by 1
  20. 2024Using Language Models to Disambiguate Lexical Choices in Translationcited by 1
  21. 2025Leveraging the Cross-Domain & Cross-Linguistic Corpus for Low Resource NMT: A Case Study On Bhili-Hindi-English Parallel Corpuscited by 1
  22. 2026Mind the Pause: Disfluency-Aware Objective Tuning for Multilingual Speech Correction with LLMscited by 1
  23. 2021Analyzing Architectures for Neural Machine Translation Using Low Computational Resourcescited by 0
  24. 2023Machine Translation by Projecting Text into the Same Phonetic-Orthographic Space Using a Common Encodingcited by 0
  25. 2023APE-then-QE: Correcting then Filtering Pseudo Parallel Corpora for MT Training Data Creationcited by 0
  26. 2024SPRING Lab IITM's submission to Low Resource Indic Language Translation Shared Taskcited by 0
  27. 2025From Scratch to Fine-Tuned: A Comparative Study of Transformer Training Strategies for Legal Machine Translationcited by 0
  28. 2026BhashaSetu: A Data-Centric Approach to Low-Resource Machine Translationcited by 0