Linguistic Triggers of Gender and Racial Bias in Open-Weight LLMs Applied to Recruitment
Not on the map. Why?
Abstract (arXiv)
Open-weight large language models are rapidly entering hiring pipelines, yet their discriminatory failure modes -- and the regulatory exposure these create under the EU AI Act high-risk classification (Annex III) and U.S. EEOC adverse-impact analysis -- remain poorly understood. We present the first systematic, multi-model audit of open-weight LLMs that treats job-posting language as the primary experimental variable, evaluating six models (Llama 3.2, Mistral, Gemma 3, Qwen 3, Phi 3, DeepSeek-R1) across four controlled experiments that jointly probe recruiter-simulation and job-seeker-simulation tasks. We find that (1) agentic posting language depresses recruiter recommendation scores for female candidates (r_rb = 0.309, p_Bonf = 7x10^-5; model-fixed-effects r_rb = 0.448), while communal language partially reverses the penalty; and (2) coded-exclusion language suppresses non-White recruiter scores at large effect sizes (r_rb = 0.646-0.758) and, on the job-seeker side, selectively deters non-White personas from expressing interest -- operationalizing a chilling-effect mechanism at scale. A label-ablation experiment isolates the explicit demographic persona label as the primary causal driver, and Word Embedding Association Tests corroborate these findings at the representational level (d = 1.01-1.45 under Caliskan et al.'s multi-word gender attribute lists). We translate these results into a concrete pre-deployment audit protocol -- posting-vocabulary scoring, persona-conditioned LLM probing, and adverse-impact flagging against the four-fifths threshold -- that operationalizes the documentation and risk-management obligations Annex III imposes on high-risk AI in recruitment.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 21 references that are in the map. First posted on arXiv 16 Sep 2026.
Builds on
9 of 21 references.
References · 9
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,917
- 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,312
- 2016Semantics derived automatically from language corpora contain human-like biasescited by 901
- 2023Toxicity in ChatGPT: Analyzing Persona-assigned Language Modelscited by 360
- 2019Bias in Bios: A Case Study of Semantic Representation Bias in a High-Stakes Settingcited by 349
- 2023Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMscited by 199
- 2019Mitigating Bias in Algorithmic Hiring: Evaluating Claims and Practicescited by 174
- 2024Gender, Race, and Intersectional Bias in Resume Screening via Language Model Retrievalcited by 51
- 2025No Thoughts Just AI: Biased LLM Hiring Recommendations Alter Human Decision Making and Limit Human Autonomycited by 8
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Robustly Improving LLM Fairness in Realistic Settings via Interpretability
- 2026Evaluating LLM Behavior in Hiring: Implicit Weights, Fairness Across Groups, and Alignment with Human Preferences
- 2023Gender bias and stereotypes in Large Language Models
- 2025I Think, Therefore I Am Under-Qualified? A Benchmark for Evaluating Linguistic Shibboleth Detection in LLM Hiring Evaluations
- 2024Unboxing Occupational Bias: Grounded Debiasing of LLMs with U.S. Labor Data
- 2024White Men Lead, Black Women Help? Benchmarking and Mitigating Language Agency Social Biases in LLMs
- 2026AI Alignment Amplifies the Role of Race, Gender, and Disability in Hiring Decisions ↗
- 2024Protected group bias and stereotypes in Large Language Models