# A Multilingual Parallel Corpora Collection Effort for Indian Languages

arXiv: https://arxiv.org/abs/2007.07691 · HTML: https://mlsanity.com/paper/2007.07691/

## Key facts

- Cited by 16 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 15 Jul 2020.

## Built on by (most cited first, 16 of 16)

- [The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset](https://mlsanity.com/paper/2303.03915/) (2023)
- [Samanantar: The Largest Publicly Available Parallel Corpora Collection for 11 Indic Languages](https://mlsanity.com/paper/2104.05596/) (2021)
- [Survey of Low-Resource Machine Translation](https://mlsanity.com/paper/2109.00486/) (2021)
- [IndicLLMSuite: A Blueprint for Creating Pre-training and Fine-Tuning Datasets for Indian Languages](https://mlsanity.com/paper/2403.06350/) (2024)
- [IndicBART: A Pre-trained Model for Indic Natural Language Generation](https://mlsanity.com/paper/2109.02903/) (2021)
- [Debiasing Multilingual Word Embeddings: A Case Study of Three Indian Languages](https://mlsanity.com/paper/2107.10181/) (2021)
- [Improving Multilingual Neural Machine Translation System for Indic Languages](https://mlsanity.com/paper/2209.13279/) (2022)
- [MILPaC: A Novel Benchmark for Evaluating Translation of Legal Text to Indian Languages](https://mlsanity.com/paper/2310.09765/) (2023)
- [Using Machine Translation to Localize Task Oriented NLG Output](https://mlsanity.com/paper/2107.04512/) (2021)
- [An Overview of Indian Language Datasets used for Text Summarization](https://mlsanity.com/paper/2203.16127/) (2022)
- [Pralekha: Cross-Lingual Document Alignment for Indic Languages](https://mlsanity.com/paper/2411.19096/) (2024)
- [CorIL: Towards Enriching Indian Language to Indian Language Parallel Corpora and Machine Translation Systems](https://mlsanity.com/paper/2509.19941/) (2025)
- [Leveraging the Cross-Domain & Cross-Linguistic Corpus for Low Resource NMT: A Case Study On Bhili-Hindi-English Parallel Corpus](https://mlsanity.com/paper/2511.00486/) (2025)
- [A Review of the Marathi Natural Language Processing](https://mlsanity.com/paper/2412.15471/) (2024)
- [From Scratch to Fine-Tuned: A Comparative Study of Transformer Training Strategies for Legal Machine Translation](https://mlsanity.com/paper/2512.18593/) (2025)
- [BhashaSetu: A Data-Centric Approach to Low-Resource Machine Translation](https://mlsanity.com/paper/2605.27050/) (2026)

## Abstract (arXiv)

We present sentence aligned parallel corpora across 10 Indian Languages - Hindi, Telugu, Tamil, Malayalam, Gujarati, Urdu, Bengali, Oriya, Marathi, Punjabi, and English - many of which are categorized as low resource. The corpora are compiled from online sources which have content shared across languages. The corpora presented significantly extends present resources that are either not large enough or are restricted to a specific domain (such as health). We also provide a separate test corpus compiled from an independent online source that can be independently used for validating the performance in 10 Indian languages. Alongside, we report on the methods of constructing such corpora using tools enabled by recent advances in machine translation and cross-lingual retrieval using deep neural network based methods.