mlsanityData to 14 Oct 2026

Linguistic Triggers of Gender and Racial Bias in Open-Weight LLMs Applied to Recruitment

arXiv 2609.18106 ↗First posted 16 Sep 2026cs.CL cs.AI cs.CYcited by 0

Not on the map. Why?

Abstract (arXiv)

Open-weight large language models are rapidly entering hiring pipelines, yet their discriminatory failure modes -- and the regulatory exposure these create under the EU AI Act high-risk classification (Annex III) and U.S. EEOC adverse-impact analysis -- remain poorly understood. We present the first systematic, multi-model audit of open-weight LLMs that treats job-posting language as the primary experimental variable, evaluating six models (Llama 3.2, Mistral, Gemma 3, Qwen 3, Phi 3, DeepSeek-R1) across four controlled experiments that jointly probe recruiter-simulation and job-seeker-simulation tasks. We find that (1) agentic posting language depresses recruiter recommendation scores for female candidates (r_rb = 0.309, p_Bonf = 7x10^-5; model-fixed-effects r_rb = 0.448), while communal language partially reverses the penalty; and (2) coded-exclusion language suppresses non-White recruiter scores at large effect sizes (r_rb = 0.646-0.758) and, on the job-seeker side, selectively deters non-White personas from expressing interest -- operationalizing a chilling-effect mechanism at scale. A label-ablation experiment isolates the explicit demographic persona label as the primary causal driver, and Word Embedding Association Tests corroborate these findings at the representational level (d = 1.01-1.45 under Caliskan et al.'s multi-word gender attribute lists). We translate these results into a concrete pre-deployment audit protocol -- posting-vocabulary scoring, persona-conditioned LLM probing, and adverse-impact flagging against the four-fifths threshold -- that operationalizes the documentation and risk-management obligations Annex III imposes on high-risk AI in recruitment.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 21 references that are in the map. First posted on arXiv 16 Sep 2026.

Builds on

9 of 21 references.

References · 9

  1. 2019A Survey on Bias and Fairness in Machine Learningcited by 1,917
  2. 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,312
  3. 2016Semantics derived automatically from language corpora contain human-like biasescited by 901
  4. 2023Toxicity in ChatGPT: Analyzing Persona-assigned Language Modelscited by 360
  5. 2019Bias in Bios: A Case Study of Semantic Representation Bias in a High-Stakes Settingcited by 349
  6. 2023Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMscited by 199
  7. 2019Mitigating Bias in Algorithmic Hiring: Evaluating Claims and Practicescited by 174
  8. 2024Gender, Race, and Intersectional Bias in Resume Screening via Language Model Retrievalcited by 51
  9. 2025No Thoughts Just AI: Biased LLM Hiring Recommendations Alter Human Decision Making and Limit Human Autonomycited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Robustly Improving LLM Fairness in Realistic Settings via Interpretability
  2. 2026Evaluating LLM Behavior in Hiring: Implicit Weights, Fairness Across Groups, and Alignment with Human Preferences
  3. 2023Gender bias and stereotypes in Large Language Models
  4. 2025I Think, Therefore I Am Under-Qualified? A Benchmark for Evaluating Linguistic Shibboleth Detection in LLM Hiring Evaluations
  5. 2024Unboxing Occupational Bias: Grounded Debiasing of LLMs with U.S. Labor Data
  6. 2024White Men Lead, Black Women Help? Benchmarking and Mitigating Language Agency Social Biases in LLMs
  7. 2026AI Alignment Amplifies the Role of Race, Gender, and Disability in Hiring Decisions ↗
  8. 2024Protected group bias and stereotypes in Large Language Models