mlsanityData to 7 Oct 2026

Language technology practitioners as language managers: arbitrating data bias and predictive bias in ASR

arXiv 2202.12603 ↗First posted 25 Feb 2022cs.CL cs.AI cs.DBcited by 7

Not on the map. Why?

Abstract (arXiv)

Despite the fact that variation is a fundamental characteristic of natural language, automatic speech recognition systems perform systematically worse on non-standardised and marginalised language varieties. In this paper we use the lens of language policy to analyse how current practices in training and testing ASR systems in industry lead to the data bias giving rise to these systematic error differences. We believe that this is a useful perspective for speech and language technology practitioners to understand the origins and harms of algorithmic bias, and how they can mitigate it. We also propose a re-framing of language resources as (public) infrastructure which should not solely be designed for markets, but for, and with meaningful cooperation of, speech communities.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 21 of its 86 references that are in the map. First posted on arXiv 25 Feb 2022.

Builds on

21 of 86 references.

References · 21

  1. 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 951
  2. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 789
  3. 2021AI and the Everything in the Whole Wide World Benchmarkcited by 340
  4. 2020Data and its (dis)contents: A survey of dataset development and use in machine learning researchcited by 259
  5. 2021What Will it Take to Fix Benchmarking in Natural Language Understanding?cited by 200
  6. 2017State-of-the-art Speech Recognition With Sequence-to-Sequence Modelscited by 196
  7. 2019Mitigating Bias in Algorithmic Hiring: Evaluating Claims and Practicescited by 170
  8. 2020Towards Accountability for Machine Learning Datasets: Practices from Software Engineering and Infrastructurecited by 138
  9. 2019Predictive Biases in Natural Language Processing Models: A Conceptual Framework and Overviewcited by 137
  10. 2020Massively Multilingual ASR: 50 Languages, 1 Model, 1 Billion Parameterscited by 110
  11. 2021Reduced, Reused and Recycled: The Life of a Dataset in Machine Learning Researchcited by 100
  12. 2021Towards Measuring Fairness in AI: the Casual Conversations Datasetcited by 80
9 more
  1. 2020"What We Can't Measure, We Can't Understand": Challenges to Demographic Data Procurement in the Pursuit of Fairnesscited by 56
  2. 2017The Microsoft 2017 Conversational Speech Recognition Systemcited by 51
  3. 2020Targeting the Benchmark: On Methodology in Current Natural Language Processing Researchcited by 44
  4. 2020Bringing the People Back In: Contesting Benchmark Machine Learning Datasetscited by 43
  5. 2020Data Leverage: A Framework for Empowering the Public in its Relationship with Technology Companiescited by 25
  6. 2020WER we are and WER we think we arecited by 19
  7. 2020Black-box Adaptation of ASR for Accented Speechcited by 8
  8. 2020Language Technology Programme for Icelandic 2019-2023cited by 6
  9. 2019Automatic Speech Recognition Services: Deaf and Hard-of-Hearing Usabilitycited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 2; 2023: 1; 2024: 0; 2025: 3; 2026: 1.

7 papers.