Competence-Preserving Resume Perturbations Expose Presentation Sensitivity in LLM Screening
Not on the map. Why?
Abstract (arXiv)
Resume screeners must infer job-relevant competence from resumes whose presentation can vary substantially in wording, structure, stylistic polish, and document extraction quality. Ideally, such surface variation should not change decisions when the underlying qualification evidence is unchanged. We introduce a controlled audit of this property, constructing occupation-grounded candidate profiles at controlled competence levels and rendering each profile into multiple resume presentations. A deterministic validation gate excludes variants that alter the underlying evidence before scoring. Across six open instruction-tuned LLM conditions, we find a clear disconnect between screening validity and presentation stability. Llama-3.1-8B with its native chat template achieves the strongest validity (0.781) yet reverses 29.6% of matched pairwise decisions under competence-preserving presentation changes; Mistral-7B-v0.3 reaches validity 0.644 with a 41.4% flip rate. Native chat formatting improves validity for several chat-tuned models but does not remove this instability. These results show that resume-screening evaluations should assess not only whether a system identifies stronger candidates, but also whether those decisions remain stable when the same competence evidence is presented differently.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 16 references that are in the map. First posted on arXiv 15 Sep 2026.
Builds on
9 of 16 references.
References · 9
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formattingcited by 817
- 2019Bias in Bios: A Case Study of Semantic Representation Bias in a High-Stakes Settingcited by 349
- 2019Mitigating Bias in Algorithmic Hiring: Evaluating Claims and Practicescited by 174
- 2024POSIX: A Prompt Sensitivity Index For Large Language Modelscited by 59
- 2025Evaluating Bias in LLMs for Job-Resume Matching: Gender, Race, and Educationcited by 14
- 2025AI Self-preferencing in Algorithmic Hiring: Empirical Evidence and Insightscited by 10
- 2026Can LLMs Hire Fairly? Racial Bias in Resume Screeningcited by 4
- 2026Measuring Validity in LLM-based Resume Screeningcited by 2
Built on by
Not cited yet.