VAANI: Capturing the language landscape for an inclusive digital India
Not on the map. Why?
Abstract (arXiv)
Voice based technologies have the potential to bridge digital accessibility gaps; however, existing datasets fail to capture the linguistic and regional diversity of Indic languages. We present Project VAANI, a large scale multimodal dataset designed to represent India's linguistic landscape across 165 districts. Speech data is collected using image based prompts to elicit spontaneous responses, while images are curated through a separate pipeline covering diverse themes across regions. The dataset undergoes a rigorous multi stage quality control process, combining automated and manual evaluation to ensure high audio quality and transcription accuracy. We release approximately 289K images, 31,255 hours of speech, and 2,043 hours of transcribed audio spanning 105 languages from 28 states and 3 union territories. Many of these languages are represented at this scale for the first time, making VAANI a foundational resource for inclusive speech technology. The dataset enables the development of robust, multilingual, and multimodal models, and supports research in speech recognition, language understanding, and cross-modal learning for underrepresented languages.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). First posted on arXiv 30 Mar 2026.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Connecting Speech to Words through Imagescited by 1
- 2026Seeds Before Objectives: Rethinking Evaluation for Low-Resource Garhwali ASRcited by 1
- 2026Rethinking Indic AI from a Lens of Cultural Heritage Preservationcited by 0
- 2026FormBharo: Designing and Evaluating a Voice Agent for Conversational Form Filling in Rural Indiacited by 0
- 2026Mapping Written Words to Spoken Words in a Different Language Using Only Visual Groundingcited by 0
- 2026Mapping Written Words to Spoken Words in a Different Language Using Only Visual Grounding27 Aug 2026
- 2026Seeds Before Objectives: Rethinking Evaluation for Low-Resource Garhwali ASR11 Aug 2026
- 2026FormBharo: Designing and Evaluating a Voice Agent for Conversational Form Filling in Rural India6 Aug 2026
- 2026Rethinking Indic AI from a Lens of Cultural Heritage Preservation7 Jul 2026
- 2026Connecting Speech to Words through Images15 Jun 2026