Greater accessibility can amplify discrimination in generative AI
Not on the map. Why?
Abstract (arXiv)
Hundreds of millions of people rely on large language models (LLMs) for education, work, and even healthcare. Yet these models are known to reproduce and amplify social biases present in their training data. Moreover, text-based interfaces remain a barrier for many, for example, users with limited literacy, motor impairments, or mobile-only devices. Voice interaction promises to expand accessibility, but unlike text, speech carries identity cues that users cannot easily mask, raising concerns about whether accessibility gains may come at the cost of equitable treatment. Here we show that audio-enabled LLMs exhibit systematic gender discrimination, shifting responses toward gender-stereotyped adjectives and occupations solely on the basis of speaker voice, and amplifying bias beyond that observed in text-based interaction. Thus, voice interfaces do not merely extend text models to a new modality but introduce distinct bias mechanisms tied to paralinguistic cues. Complementary survey evidence (n=1,000) shows that infrequent chatbot users are most hesitant to undisclosed attribute inference and most likely to disengage when such practices are revealed. To demonstrate a potential mitigation strategy, we show that pitch manipulation can systematically regulate gender-discriminatory outputs. Overall, our findings reveal a critical tension in AI development: efforts to expand accessibility through voice interfaces simultaneously create new pathways for discrimination, demanding that fairness and accessibility be addressed in tandem.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 35 of its 84 references that are in the map. First posted on arXiv 23 Mar 2026.
Builds on
35 of 84 references.
References · 35
- 2024GPT-4o System Cardcited by 4,588
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
- 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,384
- 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,312
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
- 2018Gender Bias in Coreference Resolution: Evaluation and Debiasing Methodscited by 659
- 2023Bias and Fairness in Large Language Models: A Surveycited by 639
- 2023LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Datasetcited by 461
- 2018Gender Bias in Coreference Resolutioncited by 442
- 2023Jailbreak in pieces: Compositional Adversarial Attacks on Multi-Modal Language Modelscited by 273
- 2019Lipstick on a Pig: Debiasing Methods Cover up Systematic Gender Biases in Word Embeddings But do not Remove Themcited by 268
23 more
- 2024AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehensioncited by 220
- 2023"Kelly is a Warm Person, Joseph is a Role Model": Gender Biases in LLM-Generated Reference Letterscited by 199
- 2023Gender bias and stereotypes in Large Language Modelscited by 187
- 2021Evaluating CLIP: Towards Characterization of Broader Capabilities and Downstream Implicationscited by 128
- 2023Large Language Models in Law: A Surveycited by 128
- 2024AudioBench: A Universal Benchmark for Audio Large Language Modelscited by 128
- 2021Text-Free Prosody-Aware Generative Spoken Language Modelingcited by 119
- 2023Generative Language Models Exhibit Social Identity Biasescited by 111
- 2025LLaMA-Omni2: LLM-based Real-time Spoken Chatbot with Autoregressive Streaming Speech Synthesiscited by 76
- 2024Building Guardrails for Large Language Modelscited by 65
- 2025Anthropic Economic Index report: Uneven geographic and enterprise AI adoptioncited by 26
- 2024Twists, Humps, and Pebbles: Multilingual Speech Recognition Models Exhibit Gender Performance Gapscited by 25
- 2022Gender Bias in Word Embeddings: A Comprehensive Analysis of Frequency, Syntax, and Semanticscited by 24
- 2019Gender Representation in French Broadcast Corpora and Its Impact on ASR Performancecited by 23
- 2024Listen and Speak Fairly: A Study on Semantic Gender Bias in Speech Integrated Large Language Modelscited by 21
- 2021VoxCeleb Enrichment for Age and Gender Recognitioncited by 20
- 2024Spoken Stereoset: On Evaluating Social Bias Toward Speaker in Speech Large Language Modelscited by 16
- 2025AHELM: A Holistic Evaluation of Audio-Language Modelscited by 14
- 2024Why do LLaVA Vision-Language Models Reply to Images in English?cited by 11
- 2022An External Stability Audit Framework to Test the Validity of Personality Prediction in AI Hiringcited by 10
- 2024Social Debiasing for Fair Multi-modal LLMscited by 8
- 2024MERaLiON-AudioLLM: Bridging Audio and Language with Large Language Modelscited by 8
- 2025VoiceBBQ: Investigating Effect of Content and Acoustics in Social Bias of Spoken Language Modelcited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.