It's How You Ask: Gender-Associated Linguistic Bias in LLMs
Not on the map. Why?
Abstract (arXiv)
Professional communication is increasingly mediated by LLMs - but do these models serve all users equally? We show that when prompts contain linguistic features more commonly used by women (hedges, tag questions, collective reference), they systematically elicit shorter, less sophisticated, and less formal responses across three document types and four models. These effects persist after controlling for prompt complexity and feature carry-over. Explicit gender cues like sign-off names are encoded in the same representational space as linguistic dialect - suggesting shared underlying mechanisms - yet linguistic register is far more influential, producing large, consistent effects where names produce none. Our results further reveal that post-hoc mitigation is challenging: because these patterns are culturally embedded and outside conscious control, users cannot easily avoid them through strategic self-presentation, and mechanistic analysis reveals that linguistic features are encoded in early transformer layers and entangled with other features. Our work calls for upstream consideration of the influences of linguistic variation to mitigate disparate impacts of LLM-mediated workplace communication.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 14 of its 49 references that are in the map. First posted on arXiv 13 Aug 2026.
Builds on
14 of 49 references.
References · 14
- 2024The Llama 3 Herd of Modelscited by 14,486
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,968
- 2023Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formattingcited by 797
- 2022Easily Accessible Text-to-Image Generation Amplifies Demographic Stereotypes at Large Scalecited by 262
- 2023Marked Personas: Using Natural Language Prompts to Measure Stereotypes in Language Modelscited by 205
- 2023"Kelly is a Warm Person, Joseph is a Role Model": Gender Biases in LLM-Generated Reference Letterscited by 198
- 2024Linguistic Bias in ChatGPT: Language Models Reinforce Dialect Discriminationcited by 56
- 2019Text Readability Assessment for Second Language Learnerscited by 54
- 2023Evaluation of African American Language Bias in Natural Language Generationcited by 36
- 2015Computational Sociolinguistics: A Surveycited by 35
- 2025The AI Gap: How Socioeconomic Status Affects Language Technology Interactionscited by 15
- 2021Application of Lexical Features Towards Improvement of Filipino Readability Identification of Children's Literaturecited by 6
Built on by
Not cited yet.