mlsanityData to 14 Oct 2026

Fairness Is Not Enough: Auditing Competence and Intersectional Bias in AI-powered Resume Screening

arXiv 2507.11548 ↗First posted 11 Jul 2025cs.CY cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

The use of publicly available generative AI systems for resume evaluation is often justified by the assumption that these tools reduce bias relative to human judgment. However, this framing leaves a prior question unresolved: whether these systems are capable of performing the evaluative task at all. This study presents a two-part audit of eight widely used AI platforms used for resume screening. Drawing on the concept of the Illusion of Neutrality, the study examines cases in which systems appear demographically unbiased because they lack the ability to meaningfully differentiate among candidates. Experiment 1 evaluates racial and gender bias using matched fictitious resumes and finds that bias persists in context-dependent and intersectional forms. Some models penalize candidates for the presence of demographic signals, while others exhibit inconsistent patterns across roles and identities under controlled conditions. Experiment 2 evaluates task competence using resume-role mismatch and keyword-manipulation tests and finds that several models that appear relatively unbiased fail to distinguish relevant from irrelevant candidate experience in relation to the target role. In these cases, outputs appear stable or neutral not because the systems are fair, but because they fail to perform meaningful evaluation. Fairness assessments alone are therefore insufficient. The paper proposes a dual-validation framework that requires auditing for both demographic bias and evaluative competence as a minimum condition for responsible deployment.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 45 references that are in the map. First posted on arXiv 11 Jul 2025.

Builds on

14 of 45 references.

References · 14

  1. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
  2. 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,312
  3. 2020Beyond Accuracy: Behavioral Testing of NLP models with CheckListcited by 1,006
  4. 2017Counterfactual Fairnesscited by 804
  5. 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 619
  6. 2017Word Embeddings Quantify 100 Years of Gender and Ethnic Stereotypescited by 253
  7. 2019Probing Neural Network Comprehension of Natural Language Argumentscited by 214
  8. 2019Mitigating Bias in Algorithmic Hiring: Evaluating Claims and Practicescited by 174
  9. 2024What's in a Name? Auditing Large Language Models for Race and Gender Biascited by 51
  10. 2024Gender, Race, and Intersectional Bias in Resume Screening via Language Model Retrievalcited by 51
  11. 2024Thinking Fair and Slow: On the Efficacy of Structured Prompts for Debiasing Language Modelscited by 45
  12. 2025Unmasking Implicit Bias: Evaluating Persona-Prompted LLM Responses in Power-Disparate Social Scenarioscited by 26
2 more
  1. 2024Auditing the Use of Language Models to Guide Hiring Decisionscited by 20
  2. 2025Evaluating the Promise and Pitfalls of LLMs in Hiring Decisionscited by 7

Built on by

Not cited yet.