SCRIBE: Diagnostic Evaluation and Rich Transcription Models for Indic ASR
Not on the map. Why?
Abstract (arXiv)
Automatic speech recognition replaces typing only when correction costs less than manual entry - a threshold determined by error types, not counts: fixing a misrecognized domain term costs far more than inserting a comma. Word error rate (WER) fails on two fronts: it collapses distinct error categories into a single scalar, and it structurally penalizes agglutinative languages where valid sandhi merges inflate scores. We introduce SCRIBE, a diagnostic framework offering categorical error decomposition into lexical, punctuation, numeral, and domain-entity rates via sandhi-tolerant alignment with domain vocabulary injection. Human validation confirms SCRIBE aligns with expert judgment where WER does not. We release SCRIBE, an LLM curation pipeline, benchmarks, and open-weight rich transcription models for Hindi, Malayalam, and Kannada.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 25 references that are in the map. First posted on arXiv 20 May 2026.
Builds on
15 of 25 references.
References · 15
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 469
- 2023IndicTrans2: Towards High-Quality and Accessible Machine Translation Models for all 22 Scheduled Indian Languagescited by 152
- 2024IndicVoices: Towards building an Inclusive Multilingual Speech Dataset for Indian Languagescited by 41
- 2022IndicSUPERB: A Speech Processing Universal Performance Benchmark for Indian languagescited by 40
- 2024Advocating Character Error Rate for Multilingual ASR Evaluationcited by 24
- 2025Granary: Speech Recognition and Translation Dataset in 25 European Languagescited by 22
- 2023Vistaar: Diverse Benchmarks and Training Sets for Indian Language ASRcited by 21
- 2022Effectiveness of Mining Audio and Text Pairs from Public Data for Improving ASR Systems for Low-Resource Languagescited by 16
- 2024What is lost in Normalization? Exploring Pitfalls in Multilingual ASR Model Evaluationscited by 13
- 2026Towards Orthographically-Informed Evaluation of Speech Recognition Systems for Indian Languagescited by 5
3 more
Built on by
Not cited yet.