ASR Under the Stethoscope: Evaluating Biases in Clinical Speech Recognition across Indian Languages
Not on the map. Why?
Abstract (arXiv)
Automatic Speech Recognition (ASR) is increasingly used to document clinical encounters, yet its reliability in multilingual and demographically diverse Indian healthcare contexts remains largely unknown. In this study, we conduct the first systematic audit of ASR performance on real world clinical interview data spanning Kannada, Hindi, and Indian English, comparing leading models including Indic Whisper, Whisper, Sarvam, Google speech to text, Gemma3n, Omnilingual, Vaani, and Gemini. We evaluate transcription accuracy across languages, speakers, and demographic subgroups, with a particular focus on error patterns affecting patients vs. clinicians and gender based or intersectional disparities. Our results reveal substantial variability across models and languages, with some systems performing competitively on Indian English but failing on code mixed or vernacular speech. We also uncover systematic performance gaps tied to speaker role and gender, raising concerns about equitable deployment in clinical settings. By providing a comprehensive multilingual benchmark and fairness analysis, our work highlights the need for culturally and demographically inclusive ASR development for healthcare ecosystem in India.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 9 of its 26 references that are in the map. First posted on arXiv 30 Nov 2025.
Builds on
9 of 26 references.
References · 9
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2019A Survey of Code-switched Speech and Language Processingcited by 75
- 2024IndicVoices: Towards building an Inclusive Multilingual Speech Dataset for Indian Languagescited by 41
- 2022IndicSUPERB: A Speech Processing Universal Performance Benchmark for Indian languagescited by 40
- 2017Speech recognition for medical conversationscited by 18
- 2023Svarah: Evaluating English ASR Systems on Indian Accentscited by 16
- 2023A Deep Dive into the Disparity of Word Error Rates Across Thousands of NPTEL MOOC Videoscited by 5
- 2024DENOASR: Debiasing ASRs through Selective Denoisingcited by 3
- 2025Toward Responsible ASR for African American English Speakers: A Scoping Review of Bias and Equity in Speech Technologycited by 2
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Seeds Before Objectives: Rethinking Evaluation for Low-Resource Garhwali ASRcited by 1
- 2026RECOVER: Robust Entity Correction via agentic Orchestration of hypothesis Variants for Evidence-based Recoverycited by 0
- 2026From Black Box to Glass Box: Cross-Model ASR Disagreement to Prioto Review in Ambient AI Scribe Documentationcited by 0
- 2026Seeds Before Objectives: Rethinking Evaluation for Low-Resource Garhwali ASR11 Aug 2026
- 2026RECOVER: Robust Entity Correction via agentic Orchestration of hypothesis Variants for Evidence-based Recovery17 Mar 2026
- 2026From Black Box to Glass Box: Cross-Model ASR Disagreement to Prioto Review in Ambient AI Scribe Documentation2 Mar 2026