mlsanityData to 7 Oct 2026

IndicXNLI: Evaluating Multilingual Inference for Indian Languages

arXiv 2204.08776 ↗First posted 19 Apr 2022cs.CL cs.AIcited by 26

Not on the map. Why?

Abstract (arXiv)

While Indic NLP has made rapid advances recently in terms of the availability of corpora and pre-trained models, benchmark datasets on standard NLU tasks are limited. To this end, we introduce IndicXNLI, an NLI dataset for 11 Indic languages. It has been created by high-quality machine translation of the original English XNLI dataset and our analysis attests to the quality of IndicXNLI. By finetuning different pre-trained LMs on this IndicXNLI, we analyze various cross-lingual transfer techniques with respect to the impact of the choice of language models, languages, multi-linguality, mix-language input, etc. These experiments provide us with useful insights into the behaviour of pre-trained models for a diverse set of languages.

Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). Builds on 30 of its 57 references that are in the map. First posted on arXiv 19 Apr 2022.

Builds on

30 of 57 references.

References · 30

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  4. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  5. 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,665
  6. 2015A large annotated corpus for learning natural language inferencecited by 1,837
  7. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
  8. 2019Cross-lingual Language Model Pretrainingcited by 1,088
  9. 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,028
  10. 2018XNLI: Evaluating Cross-lingual Sentence Representationscited by 913
  11. 2020XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalizationcited by 738
  12. 2013An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networkscited by 711
18 more
  1. 2019How multilingual is Multilingual BERT?cited by 642
  2. 2019CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Datacited by 544
  3. 2019MLQA: Evaluating Cross-lingual Extractive Question Answeringcited by 339
  4. 2019PAWS-X: A Cross-lingual Adversarial Dataset for Paraphrase Identificationcited by 262
  5. 2020XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generationcited by 221
  6. 2021Muppet: Massive Multi-task Representations with Pre-Finetuningcited by 192
  7. 2021MuRIL: Multilingual Representations for Indian Languagescited by 177
  8. 2021XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluationcited by 167
  9. 2021Samanantar: The Largest Publicly Available Parallel Corpora Collection for 11 Indic Languagescited by 133
  10. 2020A Monolingual Approach to Contextualized Word Embeddings for Mid-Resource Languagescited by 131
  11. 2019On The Evaluation of Machine Translation Systems Trained With Back-Translationcited by 40
  12. 2020PMIndia -- A Collection of Parallel Corpora of Languages of Indiacited by 40
  13. 2021IndicBART: A Pre-trained Model for Indic Natural Language Generationcited by 39
  14. 2020Revisiting Round-Trip Translation for Quality Estimationcited by 24
  15. 2020iNLTK: Natural Language Toolkit for Indic Languagescited by 24
  16. 2020Indic-Transformers: An Analysis of Transformer Language Models for Indian Languagescited by 22
  17. 2021Analyzing the Effects of Reasoning Types on Cross-Lingual Transfer Performancecited by 6
  18. 2021Language Invariant Properties in Natural Language Processingcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 4; 2023: 6; 2024: 7; 2025: 7; 2026: 2.

26 papers.

Sort:

  1. 2023MEGA: Multilingual Evaluation of Generative AIcited by 291
  2. 2022Towards Leaving No Indic Language Behind: Building Monolingual Corpora, Benchmark and Models for Indic Languagescited by 99
  3. 2023BUFFET: Benchmarking Large Language Models for Few-shot Cross-lingual Transfercited by 68
  4. 2024MEXA: Multilingual Evaluation of English-Centric LLMs via Cross-Lingual Alignmentcited by 25
  5. 2024TRUCE: Private Benchmarking to Prevent Contamination and Improve Comparative Evaluation of LLMscited by 24
  6. 2023BHASA: A Holistic Southeast Asian Linguistic and Cultural Evaluation Suite for Large Language Modelscited by 16
  7. 2024Better to Ask in English: Evaluation of Large Language Models on English, Low-resource and Cross-Lingual Settingscited by 14
  8. 2022JamPatoisNLI: A Jamaican Patois Natural Language Inference Datasetcited by 11
  9. 2022L3Cube-MahaSBERT and HindSBERT: Sentence BERT Models and Benchmarking BERT Sentence Representations for Hindi and Marathicited by 10
  10. 2025IndicMMLU-Pro: Benchmarking Indic Large Language Models on Multi-Task Language Understandingcited by 9
  11. 2025Rethinking Tokenization for Rich Morphology: The Dominance of Unigram over BPE and Morphological Alignmentcited by 9
  12. 2023Free Lunch: Robust Cross-Lingual Transfer via Model Checkpoint Averagingcited by 8
14 more
  1. 2025mSTEB: Massively Multilingual Evaluation of LLMs on Speech and Text Taskscited by 7
  2. 2022Improving Multilingual Neural Machine Translation System for Indic Languagescited by 6
  3. 2024Do Large Language Models Speak All Languages Equally? A Comparative Study in Low-Resource Settingscited by 6
  4. 2024No Train but Gain: Language Arithmetic for training-free Language Adapters enhancementcited by 5
  5. 2025Multilingual Prompt Engineering in Large Language Models: A Survey Across NLP Taskscited by 5
  6. 2024Decoding the Diversity: A Review of the Indic AI Research Landscapecited by 4
  7. 2023One For All & All For One: Bypassing Hyperparameter Tuning with Model Averaging For Cross-Lingual Transfercited by 2
  8. 2023Evaluating Inter-Bilingual Semantic Parsing for Indian Languagescited by 1
  9. 2024Towards Building Efficient Sentence BERT Models using Layer Pruningcited by 1
  10. 2025Improving Multilingual Capabilities with Cultural and Local Knowledge in Large Language Models While Enhancing Native Performancecited by 1
  11. 2025On Importance of Layer Pruning for Smaller BERT Models and Low Resource Languagescited by 0
  12. 2025Utilizing Multilingual Encoders to Improve Large Language Models for Low-Resource Languagescited by 0
  13. 2026SumTablets: A Transliteration Dataset of Sumerian Tabletscited by 0
  14. 2026Indi-RomCoM: Code-Mixed Benchmark for Evaluating LLMs on Romanized Indic-English Instructionscited by 0