Bias in the Tails: How Name-conditioned Evaluative Framing in Resume Summaries Destabilizes LLM-based Hiring
Not on the map. Why?
Abstract (arXiv)
Research has documented LLMs' name-based bias in hiring and salary recommendations. In this paper, we instead consider a setting where LLMs generate candidate summaries for downstream assessment. In a large-scale controlled study, we analyze nearly one million resume summaries produced by 4 models under systematic race-gender name perturbations, using synthetic resumes and real-world job postings. By decomposing each summary into resume-grounded factual content and evaluative framing, we find that factual content remains largely stable, while evaluative language exhibits subtle name-conditioned variation concentrated in the extremes of the distribution, especially in open-source models. Our hiring simulation demonstrates how evaluative summary transforms directional harm into symmetric instability that might evade conventional fairness audit, highlighting a potential pathway for LLM-to-LLM automation bias.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 23 of its 59 references that are in the map. First posted on arXiv 21 Apr 2026.
Builds on
23 of 59 references.
References · 23
- 2016Equality of Opportunity in Supervised Learningcited by 2,000
- 2017Counterfactual Fairnesscited by 802
- 2024MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documentscited by 251
- 2023"Kelly is a Warm Person, Joseph is a Role Model": Gender Biases in LLM-Generated Reference Letterscited by 196
- 2024Pride and Prejudice: LLM Amplifies Self-Bias in Self-Refinementcited by 111
- 2022A Systematic Study of Bias Amplificationcited by 65
- 2024Gender, Race, and Intersectional Bias in Resume Screening via Language Model Retrievalcited by 49
- 2025IHEval: Evaluating Language Models on Following the Instruction Hierarchycited by 48
- 2024Thinking Fair and Slow: On the Efficacy of Structured Prompts for Debiasing Language Modelscited by 44
- 2023The Unequal Opportunities of Large Language Models: Revealing Demographic Bias through Job Recommendationscited by 41
- 2025A Closer Look at System Prompt Robustnesscited by 31
- 2023Fairness and Bias in Algorithmic Hiring: a Multidisciplinary Surveycited by 30
11 more
- 2024The Silicon Ceiling: Auditing GPT's Race and Gender Biases in Hiringcited by 29
- 2024Identifying and Improving Disability Bias in GPT-Based Resume Screeningcited by 27
- 2024Stop! In the Name of Flaws: Disentangling Personal Names and Sociodemographic Attributes in NLPcited by 22
- 2024Bias Amplification in Language Model Evolution: An Iterated Learning Perspectivecited by 17
- 2018Bias Amplification in Artificial Intelligence Systemscited by 15
- 2024Bias and Volatility: A Statistical Framework for Evaluating Large Language Model's Stereotypes and the Associated Generation Inconsistencycited by 15
- 2025Evaluating Bias in LLMs for Job-Resume Matching: Gender, Race, and Educationcited by 13
- 2024Natural Language Processing for Human Resources: A Surveycited by 9
- 2025Evaluating the Promise and Pitfalls of LLMs in Hiring Decisionscited by 7
- 2022Cascaded Debiasing: Studying the Cumulative Effect of Multiple Fairness-Enhancing Interventionscited by 6
- 2025Small Changes, Large Consequences: Analyzing the Allocational Fairness of LLMs in Hiring Contextscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.