Language technology practitioners as language managers: arbitrating data bias and predictive bias in ASR
Not on the map. Why?
Abstract (arXiv)
Despite the fact that variation is a fundamental characteristic of natural language, automatic speech recognition systems perform systematically worse on non-standardised and marginalised language varieties. In this paper we use the lens of language policy to analyse how current practices in training and testing ASR systems in industry lead to the data bias giving rise to these systematic error differences. We believe that this is a useful perspective for speech and language technology practitioners to understand the origins and harms of algorithmic bias, and how they can mitigate it. We also propose a re-framing of language resources as (public) infrastructure which should not solely be designed for markets, but for, and with meaningful cooperation of, speech communities.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 21 of its 86 references that are in the map. First posted on arXiv 25 Feb 2022.
Builds on
21 of 86 references.
References · 21
- 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 951
- 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 789
- 2021AI and the Everything in the Whole Wide World Benchmarkcited by 340
- 2020Data and its (dis)contents: A survey of dataset development and use in machine learning researchcited by 259
- 2021What Will it Take to Fix Benchmarking in Natural Language Understanding?cited by 200
- 2017State-of-the-art Speech Recognition With Sequence-to-Sequence Modelscited by 196
- 2019Mitigating Bias in Algorithmic Hiring: Evaluating Claims and Practicescited by 170
- 2020Towards Accountability for Machine Learning Datasets: Practices from Software Engineering and Infrastructurecited by 138
- 2019Predictive Biases in Natural Language Processing Models: A Conceptual Framework and Overviewcited by 137
- 2020Massively Multilingual ASR: 50 Languages, 1 Model, 1 Billion Parameterscited by 110
- 2021Reduced, Reused and Recycled: The Life of a Dataset in Machine Learning Researchcited by 100
- 2021Towards Measuring Fairness in AI: the Casual Conversations Datasetcited by 80
9 more
- 2020"What We Can't Measure, We Can't Understand": Challenges to Demographic Data Procurement in the Pursuit of Fairnesscited by 56
- 2017The Microsoft 2017 Conversational Speech Recognition Systemcited by 51
- 2020Targeting the Benchmark: On Methodology in Current Natural Language Processing Researchcited by 44
- 2020Bringing the People Back In: Contesting Benchmark Machine Learning Datasetscited by 43
- 2020Data Leverage: A Framework for Empowering the Public in its Relationship with Technology Companiescited by 25
- 2020WER we are and WER we think we arecited by 19
- 2020Black-box Adaptation of ASR for Accented Speechcited by 8
- 2020Language Technology Programme for Icelandic 2019-2023cited by 6
- 2019Automatic Speech Recognition Services: Deaf and Hard-of-Hearing Usabilitycited by 5
Built on by
Citing papers per year: 2022: 2; 2023: 1; 2024: 0; 2025: 3; 2026: 1.
7 papers.
- 2022A Study of Gender Impact in Self-supervised Models for Speech-to-Text Systemscited by 14
- 2025Data Quality Issues in Multilingual Speech Datasets: The Need for Sociolinguistic Awareness and Proactive Language Planningcited by 10
- 2023Improving Speech Recognition for African American English With Audio Classificationcited by 4
- 2025Toward Responsible ASR for African American English Speakers: A Scoping Review of Bias and Equity in Speech Technologycited by 2
- 2022Goodness of Pronunciation Pipelines for OOV Problemcited by 0
- 2025BERnaT: Basque Encoders for Representing Natural Textual Diversitycited by 0
- 2026Unheard in the Digital Age: Rethinking AI Bias and Speech Diversitycited by 0
- 2026Unheard in the Digital Age: Rethinking AI Bias and Speech Diversity26 Jan 2026
- 2025BERnaT: Basque Encoders for Representing Natural Textual Diversity3 Dec 2025
- 2025Toward Responsible ASR for African American English Speakers: A Scoping Review of Bias and Equity in Speech Technology20 Aug 2025
- 2025Data Quality Issues in Multilingual Speech Datasets: The Need for Sociolinguistic Awareness and Proactive Language Planning21 Jun 2025
- 2023Improving Speech Recognition for African American English With Audio Classification16 Sep 2023
- 2022Goodness of Pronunciation Pipelines for OOV Problem8 Sep 2022
- 2022A Study of Gender Impact in Self-supervised Models for Speech-to-Text Systems4 Apr 2022