mlsanityData to 14 Oct 2026

IndicVoices: Towards building an Inclusive Multilingual Speech Dataset for Indian Languages

arXiv 2403.01926 ↗First posted 4 Mar 2024cs.CLcited by 41

Not on the map. Why?

Abstract (arXiv)

We present INDICVOICES, a dataset of natural and spontaneous speech containing a total of 7348 hours of read (9%), extempore (74%) and conversational (17%) audio from 16237 speakers covering 145 Indian districts and 22 languages. Of these 7348 hours, 1639 hours have already been transcribed, with a median of 73 hours per language. Through this paper, we share our journey of capturing the cultural, linguistic and demographic diversity of India to create a one-of-its-kind inclusive and representative dataset. More specifically, we share an open-source blueprint for data collection at scale comprising of standardised protocols, centralised tools, a repository of engaging questions, prompts and conversation scenarios spanning multiple domains and topics of interest, quality control mechanisms, comprehensive transcription guidelines and transcription tools. We hope that this open source blueprint will serve as a comprehensive starter kit for data collection efforts in other multilingual regions of the world. Using INDICVOICES, we build IndicASR, the first ASR model to support all the 22 languages listed in the 8th schedule of the Constitution of India. All the data, tools, guidelines, models and other materials developed as a part of this work will be made publicly available

Key facts. Cited by 41 papers in the map (data through 14 Oct 2026). Builds on 14 of its 31 references that are in the map. First posted on arXiv 4 Mar 2024.

Builds on

14 of 31 references.

References · 14

  1. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  2. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
  3. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
  4. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,384
  5. 2022data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Languagecited by 727
  6. 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 469
  7. 2021VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretationcited by 463
  8. 2023Scaling Speech Technology to 1,000+ Languagescited by 411
  9. 2021Multilingual and code-switching ASR challenges for low resource Indian languagescited by 53
  10. 2022Massively Multilingual ASR on 70 Languages: Tokenization, Architecture, and Generalization Capabilitiescited by 16
  11. 2023Svarah: Evaluating English ASR Systems on Indian Accentscited by 16
  12. 2021Automatic Speech Recognition in Sanskrit: A New Speech Corpus and Modelling Insightscited by 14
2 more
  1. 2022Knowledge-driven Subword Grammar Modeling for Automatic Speech Recognition in Tamil and Kannadacited by 6
  2. 2023SPIRE-SIES: A Spontaneous Indian English Speech Corpuscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 10; 2025: 12; 2026: 19.

41 papers.

Sort:

By area:

  1. 2024Survey of Cultural Awareness in Language Models: Text and Beyondcited by 103
  2. 2024IndicVoices-R: Unlocking a Massive Multilingual Multi-speaker Speech Corpus for Scaling Indian TTScited by 16
  3. 2024LAHAJA: A Robust Multi-accent Benchmark for Evaluating Hindi ASR Systemscited by 10
  4. 2025The NaijaVoices Dataset: Cultivating Large-Scale, High-Quality, Culturally-Rich Speech Data for African Languagescited by 7
  5. 2024Empowering Low-Resource Language ASR via Large-Scale Pseudo Labelingcited by 5
  6. 2024Towards Building Large Scale Datasets and State-of-the-Art Automatic Speech Translation Systems for 14 Indian Languagescited by 5
  7. 2025Voxlect: A Speech Foundation Model Benchmark for Modeling Dialects and Regional Languages Around the Globecited by 5
  8. 2025LASER: An LLM-based ASR Scoring and Evaluation Rubriccited by 5
  9. 2026Towards Orthographically-Informed Evaluation of Speech Recognition Systems for Indian Languagescited by 5
  10. 2024CoSTA: Code-Switched Speech Translation using Aligned Speech-Text Interleavingcited by 4
  11. 2025RASMALAI: Resources for Adaptive Speech Modeling in Indian Languages with Accents and Intonationscited by 4
  12. 2025ASR Under the Stethoscope: Evaluating Biases in Clinical Speech Recognition across Indian Languagescited by 3
29 more
  1. 2026IndicContextEval: A Benchmark for Evaluating Context Utilisation in Audio Large Language Models Across 8 Indic Languagescited by 3
  2. 2024Enhancing Out-of-Vocabulary Performance of Indian TTS Systems for Practical Applications through Low-Effort Data Strategiescited by 2
  3. 2024ELAICHI: Enhancing Low-resource TTS by Addressing Infrequent and Low-frequency Character Bigramscited by 2
  4. 2025Phir Hera Fairy: An English Fairytaler is a Strong Faker of Fluent Speech in Low-Resource Indian Languagescited by 2
  5. 2025Mark My Words: A Robust Multilingual Model for Punctuation in Text and Speech Transcriptscited by 2
  6. 2025NIRANTAR: Continual Learning with New Languages and Domains on Real-world Speech Datacited by 2
  7. 2025SpeechT: Findings of the First Mentorship in Speech Translationcited by 1
  8. 2025Are ASR foundation models generalized enough to capture features of regional dialects for low-resource languages?cited by 1
  9. 2025Efficient ASR for Low-Resource Languages: Leveraging Cross-Lingual Unlabeled Datacited by 1
  10. 2026Dynamic Multi-Expert Projectors with Stabilized Routing for Multilingual Speech Recognitioncited by 1
  11. 2026CrossAccent-TTS: Cross-Lingual Accent-Intensity Controllable Text-to-Speech via Disentangled Speaker and Accent Representationscited by 1
  12. 2026Indic DiarBench: A Multilingual Joint Diarization and ASR Benchmark for Indian Languagescited by 1
  13. 2026Seeds Before Objectives: Rethinking Evaluation for Low-Resource Garhwali ASRcited by 1
  14. 2026Sequential Adapter Stacking for Cross-Lingual Low-Resource ASRcited by 1
  15. 2024Parameter-efficient Adaptation of Multilingual Multimodal Models for Low-resource ASRcited by 0
  16. 2024AMPS: ASR with Multimodal Paraphrase Supervisioncited by 0
  17. 2025HITSZ's End-To-End Speech Translation Systems Combining Sequence-to-Sequence Auto Speech Recognition Model and Indic Large Language Model for IWSLT 2025 in Indic Trackcited by 0
  18. 2026Voice of India: A Large-Scale Benchmark for Real-World Speech Recognition in Indiacited by 0
  19. 2026The TTS-STT Flywheel: Synthetic Entity-Dense Audio Closes the Indic ASR Gap Where Commercial and Open-Source Systems Failcited by 0
  20. 2026Vividh-ASR: A Complexity-Tiered Benchmark and Optimization Dynamics for Robust Indic Speech Recognitioncited by 0
  21. 2026SCRIBE: Diagnostic Evaluation and Rich Transcription Models for Indic ASRcited by 0
  22. 2026Multilingual Multi-Speaker Unit Vocoders: A Systematic Analysis of Discrete Speech Representationscited by 0
  23. 2026FormBharo: Designing and Evaluating a Voice Agent for Conversational Form Filling in Rural Indiacited by 0
  24. 2026Comparative Analysis of Multilingual Pre-trained Models for Nepali Automatic Speech Recognitioncited by 0
  25. 2026PUMA: A Polish Benchmark for Culturally Grounded Multimodal Understandingcited by 0
  26. 2026V=akQA: A Benchmark and Evaluation Study for Telugu Spoken Factoid Question Answeringcited by 0
  27. 2026Vimarsha: Faithful ASR Evaluation for Indian Languages with Demographic Diversity, In-the-Wild Audio and Spelling Variationscited by 0
  28. 2026Anuvani-LID: Robust and Calibrated Spoken Language Identification for Indian Languagescited by 0
  29. 2026Anuvani-Diarization: Zero Shot Speaker Diarization and Annotation Conventions Across 22 Languagescited by 0