mlsanityData to 7 Oct 2026

IndicTrans2: Towards High-Quality and Accessible Machine Translation Models for all 22 Scheduled Indian Languages

arXiv 2305.16307 ↗First posted 25 May 2023cs.CLcited by 149

Not on the map. Why?

Abstract (arXiv)

India has a rich linguistic landscape with languages from 4 major language families spoken by over a billion people. 22 of these languages are listed in the Constitution of India (referred to as scheduled languages) are the focus of this work. Given the linguistic diversity, high-quality and accessible Machine Translation (MT) systems are essential in a country like India. Prior to this work, there was (i) no parallel training data spanning all 22 languages, (ii) no robust benchmarks covering all these languages and containing content relevant to India, and (iii) no existing translation models which support all the 22 scheduled languages of India. In this work, we aim to address this gap by focusing on the missing pieces required for enabling wide, easy, and open access to good machine translation systems for all 22 scheduled Indian languages. We identify four key areas of improvement: curating and creating larger training datasets, creating diverse and high-quality benchmarks, training multilingual models, and releasing models with open access. Our first contribution is the release of the Bharat Parallel Corpus Collection (BPCC), the largest publicly available parallel corpora for Indic languages. BPCC contains a total of 230M bitext pairs, of which a total of 126M were newly added, including 644K manually translated sentence pairs created as part of this work. Our second contribution is the release of the first n-way parallel benchmark covering all 22 Indian languages, featuring diverse domains, Indian-origin content, and source-original test sets. Next, we present IndicTrans2, the first model to support all 22 languages, surpassing existing models on multiple existing and new benchmarks created as a part of this work. Lastly, to promote accessibility and collaboration, we release our models and associated data with permissive licenses at https://github.com/AI4Bharat/IndicTrans2.

Key facts. Cited by 149 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 May 2023.

Builds on

0 of 0 references.

No references here yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 5; 2024: 58; 2025: 52; 2026: 34.

149 papers.

Sort:

By area:

  1. 2023MADLAD-400: A Multilingual And Document-Level Large Audited Datasetcited by 180
  2. 2023MEGAVERSE: Benchmarking Large Language Models Across Languages, Modalities, Models and Taskscited by 57
  3. 2024IndicGenBench: A Multilingual Benchmark to Evaluate Generation Capabilities of LLMs on Indic Languagescited by 55
  4. 2024IndicLLMSuite: A Blueprint for Creating Pre-training and Fine-Tuning Datasets for Indian Languagescited by 52
  5. 2024PARIKSHA: A Large-Scale Investigation of Human-LLM Evaluator Agreement on Multilingual and Multi-Cultural Datacited by 37
  6. 2024Airavata: Introducing Hindi Instruction-tuned LLMcited by 32
  7. 2024RomanSetu: Efficiently unlocking multilingual capabilities of Large Language Models via Romanizationcited by 29
  8. 2024MEXA: Multilingual Evaluation of English-Centric LLMs via Cross-Lingual Alignmentcited by 25
  9. 2024INDIC QA BENCHMARK: A Multilingual Benchmark to Evaluate Question Answering capability of LLMs for Indic Languagescited by 24
  10. 2024Adapting Multilingual LLMs to Low-Resource Languages using Continued Pre-training and Synthetic Corpuscited by 24
  11. 2024An Empirical Comparison of Vocabulary Expansion and Initialization Approaches for Language Modelscited by 20
  12. 2024Multilingual Large Language Models: A Systematic Surveycited by 18
38 more
  1. 2024GlotCC: An Open Broad-Coverage CommonCrawl Corpus and Pipeline for Minority Languagescited by 15
  2. 2024Outliers and Calibration Sets have Diminishing Effect on Quantization of Modern LLMscited by 11
  3. 2024Aurora-M: Open Source Continual Pre-training for Multilingual Language and Codecited by 10
  4. 2024Critical Learning Periods: Leveraging Early Training Dynamics for Efficient Data Pruningcited by 10
  5. 2025Analyzing the Effect of Linguistic Similarity on Cross-Lingual Transfer: Tasks and Experimental Setups Mattercited by 10
  6. 2025Chitrarth: Bridging Vision and Language for a Billion Peoplecited by 10
  7. 2025Llama-3-Nanda-10B-Chat: An Open Generative Large Language Model for Hindicited by 10
  8. 2024An Empirical Study of In-context Learning in LLMs for Machine Translationcited by 9
  9. 2025Krutrim LLM: Multilingual Foundational Model for over a Billion Peoplecited by 9
  10. 2025TituLLMs: A Family of Bangla LLMs with Comprehensive Benchmarkingcited by 9
  11. 2023Assessing Translation capabilities of Large Language Models involving English and Indian Languagescited by 8
  12. 2024Cost-Performance Optimization for Processing Low-Resource Language Tasks Using Commercial LLMscited by 7
  13. 2024Table Question Answering for Low-resourced Indic Languagescited by 7
  14. 2024Pretraining Language Models Using Translationesecited by 6
  15. 2024How Good is Zero-Shot MT Evaluation for Low Resource Indian Languages?cited by 6
  16. 2024Rasa: Building Expressive Speech Synthesis Systems for Indian Languages in Low-resource Settingscited by 6
  17. 2025Chitranuvad: Adapting Multi-Lingual LLMs for Multimodal Translationcited by 6
  18. 2025Bhaasha, Bhasa, Zaban: A Survey for Low-Resourced Languages in South Asia -- Current Stage and Challengescited by 6
  19. 2023Show Me the World in My Language: Establishing the First Baseline for Scene-Text to Scene-Text Translationcited by 5
  20. 2023IndicIRSuite: Multilingual Dataset and Neural Information Models for Indian Languagescited by 5
  21. 2024Introducing L2M3, A Multilingual Medical Large Language Model to Advance Health Equity in Low-Resource Regionscited by 5
  22. 2024Navigating Text-to-Image Generative Bias across Indic Languagescited by 5
  23. 2024PromptRefine: Enhancing Few-Shot Performance on Low-Resource Indic Languages with Example Selection from Related Example Bankscited by 5
  24. 2024Domain-adaptative Continual Learning for Low-resource Tasks: Evaluation on Nepalicited by 5
  25. 2024Multilingual Mathematical Reasoning: Advancing Open-Source LLMs in Hindi and Englishcited by 5
  26. 2025MorphTok: Morphologically Grounded Tokenization for Indian Languagescited by 5
  27. 2025BharatBBQ: A Multilingual Bias Benchmark for Question Answering in the Indian Contextcited by 5
  28. 2025Building Benchmarks from the Ground Up: Community-Centered Evaluation of LLMs in Healthcare Chatbot Settingscited by 5
  29. 2024Isometric Neural Machine Translation using Phoneme Count Ratio Reward-based Reinforcement Learningcited by 4
  30. 2024Decoding the Diversity: A Review of the Indic AI Research Landscapecited by 4
  31. 2024CoSTA: Code-Switched Speech Translation using Aligned Speech-Text Interleavingcited by 4
  32. 2024Towards Building Large Scale Datasets and State-of-the-Art Automatic Speech Translation Systems for 14 Indian Languagescited by 4
  33. 2025Parallel Corpora for Machine Translation in Low-resource Indic Languages: A Comprehensive Reviewcited by 4
  34. 2025The Art of Breaking Words: Rethinking Multilingual Tokenizer Designcited by 4
  35. 2025UPDESH: Synthesizing Grounded Instruction Tuning Data for 13 Indic Languagescited by 4
  36. 2024Language Modelling Approaches to Adaptive Machine Translationcited by 3
  37. 2024Improving Cross-Domain Low-Resource Text Generation through LLM Post-Editing: A Programmer-Interpreter Approachcited by 3
  38. 2024Towards Large Language Model driven Reference-less Translation Evaluation for English and Indian Languagescited by 3

50 most cited of 149 All 149 (JSON)