IndicSQuAD: A Comprehensive Multilingual Question Answering Dataset for Indic Languages
Not on the map. Why?
Abstract (arXiv)
The rapid progress in question-answering (QA) systems has predominantly benefited high-resource languages, leaving Indic languages largely underrepresented despite their vast native speaker base. In this paper, we present IndicSQuAD, a comprehensive multi-lingual extractive QA dataset covering nine major Indic languages, systematically derived from the SQuAD dataset. Building on previous work with MahaSQuAD for Marathi, our approach adapts and extends translation techniques to maintain high linguistic fidelity and accurate answer-span alignment across diverse languages. IndicSQuAD comprises extensive training, validation, and test sets for each language, providing a robust foundation for model development. We evaluate baseline performances using language-specific monolingual BERT models and the multilingual MuRIL-BERT. The results indicate some challenges inherent in low-resource settings. Moreover, our experiments suggest potential directions for future work, including expanding to additional languages, developing domain-specific datasets, and incorporating multimodal data. The dataset and models are publicly shared at https://github.com/l3cube-pune/indic-nlp
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 15 of its 19 references that are in the map. First posted on arXiv 6 May 2025.
Builds on
15 of 19 references.
References · 15
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
- 2019On the Cross-lingual Transferability of Monolingual Representationscited by 578
- 2020TyDi QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languagescited by 488
- 2019MLQA: Evaluating Cross-lingual Extractive Question Answeringcited by 340
- 2021MuRIL: Multilingual Representations for Indian Languagescited by 179
- 2022L3Cube-MahaCorpus and MahaBERT: Marathi Monolingual Corpus, Marathi BERT Language Models, and Resourcescited by 51
- 2022L3Cube-HindBERT and DevBERT: Pre-Trained BERT Transformer models for Devanagari based Hindi and Marathi Languagescited by 35
- 2022L3Cube-MahaNLP: Marathi Natural Language Processing Datasets, Models, and Librarycited by 31
- 2024INDIC QA BENCHMARK: A Multilingual Benchmark to Evaluate Question Answering capability of LLMs for Indic Languagescited by 24
- 2023L3Cube-IndicSBERT: A simple approach for learning cross-lingual sentence representations using multilingual BERTcited by 15
- 2024L3Cube-IndicQuest: A Benchmark Question Answering Dataset for Evaluating Knowledge of LLMs in Indic Contextcited by 10
- 2024BanglaQuAD: A Bengali Open-domain Question Answering Datasetcited by 4
Built on by
Citing papers per year: 2025: 2; 2026: 3.
5 papers.
- 2025Benchmarking Hindi LLMs: A New Suite of Datasets and a Comparative Analysiscited by 2
- 2026BhashaSutra: A Task-Centric Unified Survey of Indian NLP Datasets, Corpora, and Resourcescited by 1
- 2025MATA: Mindful Assessment of the Telugu Abilities of Large Language Modelscited by 0
- 2026LittiChoQA: Literary Texts in Indic Languages Chosen for Question Answeringcited by 0
- 2026L3Cube-IndicQuest v2: A Large-Scale Multilingual Benchmark for Evaluating Factual Knowledge of Large Language Models Across Indic Languagescited by 0
- 2026L3Cube-IndicQuest v2: A Large-Scale Multilingual Benchmark for Evaluating Factual Knowledge of Large Language Models Across Indic Languages16 Aug 2026
- 2026BhashaSutra: A Task-Centric Unified Survey of Indian NLP Datasets, Corpora, and Resources20 Apr 2026
- 2026LittiChoQA: Literary Texts in Indic Languages Chosen for Question Answering6 Jan 2026
- 2025Benchmarking Hindi LLMs: A New Suite of Datasets and a Comparative Analysis27 Aug 2025
- 2025MATA: Mindful Assessment of the Telugu Abilities of Large Language Models19 Aug 2025