Gender bias across LLMs is common and highly heterogeneous
Not on the map. Why?
Abstract (arXiv)
Understanding gender biases in large language models (LLMs) is increasingly important as these systems become embedded in decision-support tools with real consequences. Prior research has focused only on a small set of models, leaving open the extent to which gender biases are common and heterogeneous across LLMs. We address this gap across ten models released between April 2025 and June 2026, spanning nine vendors, using two paradigms: gender attribution to stereotyped phrases (Study 1) and moral judgment of abuse or torture against a woman or a man to prevent a catastrophic outcome (Study 2). In Study 1, two of ten models attributed masculine-stereotyped phrases to female writers more often than the reverse, while three models showed the opposite pattern. In Study 2, several models converged on a male-disadvantaging asymmetry that was directionally consistent with a documented human tendency to protect female targets from harm, though the specific conditions under which this asymmetry emerged varied by model; three other models, by contrast, showed no variation across conditions. These results indicate that gender-related biases are common in LLMs. Their direction and magnitude, however, are highly heterogeneous, to the point that some models behave in diametrically opposite ways to others. Bias auditing should therefore be treated as an ongoing, multi-vendor process, rather than a one-time assessment.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 26 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
7 of 26 references.
References · 7
- 2024Large Language Model Safety: A Holistic Surveycited by 59
- 2024Language Model Alignment in Multilingual Trolley Problemscited by 46
- 2023The impact of generative artificial intelligence on socioeconomic inequalities and policy makingcited by 20
- 2024Evaluating Gender Bias of LLMs in Making Morality Judgementscited by 15
- 2026Failure of contextual invariance in large language modelscited by 3
- 2025Responsible LLM Deployment for High-Stake Decisions by Decentralized Technologies and Human-AI Interactionscited by 2
- 2026Harsher on Male? Evaluating LLMs on Gender-Asymmetric Moral Framing Across Diverse Conflict Scenarioscited by 2
Built on by
Not cited yet.