Krutrim LLM: Multilingual Foundational Model for over a Billion People
Not on the map. Why?
Abstract (arXiv)
India is a diverse society with unique challenges in developing AI systems, including linguistic diversity, oral traditions, data accessibility, and scalability. Existing foundation models are primarily trained on English, limiting their effectiveness for India's population. Indic languages comprise only 1 percent of Common Crawl corpora despite India representing 18 percent of the global population, leading to linguistic biases. Thousands of regional languages, dialects, and code mixing create additional representation challenges due to sparse training data. We introduce Krutrim LLM, a 2 trillion token multilingual model designed for India's linguistic landscape. It incorporates the largest known Indic dataset, mitigating data scarcity and ensuring balanced performance across dialects. Krutrim outperforms or matches state-of-the-art models on Indic benchmarks while maintaining competitive English performance. Despite being significantly smaller in training flops, Krutrim LLM matches or exceeds models like LLAMA-2 on 10 out of 16 tasks, with an average score of 0.57 versus 0.55. This evidences Krutrim's flexible multilingual fluency across diverse linguistic contexts. Krutrim is integrated with real-time search to improve factual accuracy in conversational AI applications. This enhances accessibility for over 1 billion users worldwide. Through intentional design choices addressing data imbalances, Krutrim LLM signifies meaningful progress in building ethical, globally representative AI models.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 29 of its 38 references that are in the map. First posted on arXiv 10 Feb 2025.
Builds on
29 of 38 references.
References · 29
- 2017Attention Is All You Needcited by 60,361
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
- 2020Learning to summarize from human feedbackcited by 2,588
- 2019Language Models as Knowledge Bases?cited by 1,936
17 more
- 2022Language Models (Mostly) Know What They Knowcited by 1,856
- 2023GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpointscited by 1,346
- 2021Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolationcited by 1,103
- 2021A General Language Assistant as a Laboratory for Alignmentcited by 1,055
- 2023The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Onlycited by 763
- 2024Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Researchcited by 483
- 2020ReClor: A Reading Comprehension Dataset Requiring Logical Reasoningcited by 217
- 2023Continual Pre-training of Language Modelscited by 198
- 2023IndicTrans2: Towards High-Quality and Accessible Machine Translation Models for all 22 Scheduled Indian Languagescited by 152
- 2022Towards Leaving No Indic Language Behind: Building Monolingual Corpora, Benchmark and Models for Indic Languagescited by 102
- 2024Self-Distillation Bridges Distribution Gap in Language Model Fine-Tuningcited by 96
- 2022Continual Pre-Training Mitigates Forgetting in Language and Visioncited by 83
- 2024IndicLLMSuite: A Blueprint for Creating Pre-training and Fine-Tuning Datasets for Indian Languagescited by 52
- 2017Composite Task-Completion Dialogue Policy Learning via Hierarchical Deep Reinforcement Learningcited by 44
- 2023Tamil-Llama: A New Tamil Language Model Based on Llama 2cited by 32
- 2024Airavata: Introducing Hindi Instruction-tuned LLMcited by 32
- 2023Building a Llama2-finetuned LLM for Odia Language Utilizing Domain Knowledge Instruction Setcited by 12
Built on by
Citing papers per year: 2025: 4; 2026: 6.
10 papers.
- 2025Chitrarth: Bridging Vision and Language for a Billion Peoplecited by 10
- 2025TALES: A Taxonomy and Analysis of Cultural Representations in LLM-generated Storiescited by 10
- 2025Chitranuvad: Adapting Multi-Lingual LLMs for Multimodal Translationcited by 6
- 2026BhashaSutra: A Task-Centric Unified Survey of Indian NLP Datasets, Corpora, and Resourcescited by 1
- 2025HITSZ's End-To-End Speech Translation Systems Combining Sequence-to-Sequence Auto Speech Recognition Model and Indic Large Language Model for IWSLT 2025 in Indic Trackcited by 0
- 2026IndRegBias: A Dataset for Studying Indian Regional Biases in English and Code-Mixed Social Media Commentscited by 0
- 2026Code Mixologist : A Practitioner's Guide to Building Code-Mixed LLMscited by 0
- 2026Designing Production-Scale OCR for India: Multilingual and Domain-Specific Systemscited by 0
- 2026Rethinking Indic AI from a Lens of Cultural Heritage Preservationcited by 0
- 2026Meta-Learning Preferences for Multilingual LLM Alignmentcited by 0
- 2026Meta-Learning Preferences for Multilingual LLM Alignment14 Jul 2026
- 2026Rethinking Indic AI from a Lens of Cultural Heritage Preservation7 Jul 2026
- 2026BhashaSutra: A Task-Centric Unified Survey of Indian NLP Datasets, Corpora, and Resources20 Apr 2026
- 2026Designing Production-Scale OCR for India: Multilingual and Domain-Specific Systems18 Feb 2026
- 2026Code Mixologist : A Practitioner's Guide to Building Code-Mixed LLMs21 Jan 2026
- 2026IndRegBias: A Dataset for Studying Indian Regional Biases in English and Code-Mixed Social Media Comments10 Jan 2026
- 2025TALES: A Taxonomy and Analysis of Cultural Representations in LLM-generated Stories26 Nov 2025
- 2025HITSZ's End-To-End Speech Translation Systems Combining Sequence-to-Sequence Auto Speech Recognition Model and Indic Large Language Model for IWSLT 2025 in Indic Track25 Jul 2025
- 2025Chitranuvad: Adapting Multi-Lingual LLMs for Multimodal Translation27 Feb 2025
- 2025Chitrarth: Bridging Vision and Language for a Billion People21 Feb 2025