Automatic Speech Recognition Biases in Newcastle English: an Error Analysis
Not on the map. Why?
Abstract (arXiv)
Automatic Speech Recognition (ASR) systems struggle with regional dialects due to biased training which favours mainstream varieties. While previous research has identified racial, age, and gender biases in ASR, regional bias remains underexamined. This study investigates ASR performance on Newcastle English, a well-documented regional dialect known to be challenging for ASR. A two-stage analysis was conducted: first, a manual error analysis on a subsample identified key phonological, lexical, and morphosyntactic errors behind ASR misrecognitions; second, a case study focused on the systematic analysis of ASR recognition of the regional pronouns ``yous'' and ``wor''. Results show that ASR errors directly correlate with regional dialectal features, while social factors play a lesser role in ASR mismatches. We advocate for greater dialectal diversity in ASR training data and highlight the value of sociolinguistic analysis in diagnosing and addressing regional biases.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 5 of its 35 references that are in the map. First posted on arXiv 19 Jun 2025.
Builds on
5 of 35 references.
References · 5
- 2023The Edinburgh International Accents of English Corpus: Towards the Democratization of English ASRcited by 36
- 2024CrisperWhisper: Accurate Timestamps on Verbatim Speech Transcriptionscited by 34
- 2021Towards Measuring Fairness in Speech Recognition: Casual Conversations Dataset Transcriptionscited by 26
- 2022Hey ASR System! Why Aren't You More Inclusive? Automatic Speech Recognition Systems' Bias and Proposed Bias Mitigation Techniques. A Literature Reviewcited by 19
- 2024The Sociolinguistic Foundations of Language Modelingcited by 13
Built on by
Citing papers per year: 2025: 1; 2026: 5.
6 papers.
- 2025WenetSpeech-Chuan: A Large-Scale Sichuanese Corpus with Rich Annotation for Dialectal Speech Processingcited by 8
- 2026Unheard in the Digital Age: Rethinking AI Bias and Speech Diversitycited by 0
- 2026Demographic and Linguistic Bias Evaluation in Omnimodal Language Modelscited by 0
- 2026Evaluating Bias in Phoneme-Based Automatic Speech Recognition Systems: An Analysis of IPA Transcription Modelscited by 0
- 2026NADI 2026: The Second Multidialectal Arabic Speech Processing Shared Taskcited by 0
- 2026Fairness Beyond a Single Run: Training-Seed Variability in Speech LLM Adaptationcited by 0
- 2026Fairness Beyond a Single Run: Training-Seed Variability in Speech LLM Adaptation30 Sep 2026
- 2026NADI 2026: The Second Multidialectal Arabic Speech Processing Shared Task22 Sep 2026
- 2026Evaluating Bias in Phoneme-Based Automatic Speech Recognition Systems: An Analysis of IPA Transcription Models10 Jun 2026
- 2026Demographic and Linguistic Bias Evaluation in Omnimodal Language Models11 Apr 2026
- 2026Unheard in the Digital Age: Rethinking AI Bias and Speech Diversity26 Jan 2026
- 2025WenetSpeech-Chuan: A Large-Scale Sichuanese Corpus with Rich Annotation for Dialectal Speech Processing22 Sep 2025