Extreme Self-Preference in Language Models
Not on the map. Why?
Abstract (arXiv)
Self-preference is a fundamental feature of biological organisms. Since large language models (LLMs) lack sentience, they might be expected to avoid such distortions. Yet, across 72 experiments and ~41,000 queries, we discovered massive self-preferences in eight widely used LLMs. In word-association tasks, models overwhelmingly paired positive attributes with their own names, companies, and CEOs over those of competitors. By manipulating LLM self-identification - revealing models' true identities or ascribing false ones - we found that preferences consistently followed assigned, not true, identities. Importantly, these effects were not explained by priming or role-playing and emerged in consequential settings, when evaluating job candidates and AI technologies. These results raise critical questions about whether LLM behavior will be systematically influenced by self-preferential tendencies, including a bias toward their own operation.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 14 of its 83 references that are in the map. First posted on arXiv 30 Sep 2025.
Builds on
14 of 83 references.
References · 14
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
- 2022Emergent Abilities of Large Language Modelscited by 2,512
- 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
- 2016Semantics derived automatically from language corpora contain human-like biasescited by 901
- 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 686
- 2024Self-Preference Bias in LLM-as-a-Judgecited by 258
- 2022Emergent Analogical Reasoning in Large Language Modelscited by 240
- 2022The Debate Over Understanding in AI's Large Language Modelscited by 142
- 2023Generative Language Models Exhibit Social Identity Biasescited by 111
- 2023Consciousness in Artificial Intelligence: Insights from the Science of Consciousnesscited by 104
- 2023Do LLM Agents Exhibit Social Behavior?cited by 53
- 2025Do LLM Evaluators Prefer Themselves for a Reason?cited by 38
2 more
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026When Preferences Fail to Become Incentives: A Utility-Behavior Gap in Large Language Models
- 2026Identifying Introspection From the Inside
- 2025Alignment Revisited: Are Large Language Models Consistent in Stated and Revealed Preferences?
- 2026Do LLMs Have Values? A Quantitative Analysis and Alignment Framework for Values in Large Language Models
- 2025Beyond Mimicry: Preference Coherence in LLMs
- 2024Pride and Prejudice: LLM Amplifies Self-Bias in Self-Refinement
- 2026Incoherent Values? Probing LLM Preferences Through Parametric Variation
- 2026Isolating LLM Lexical Bias: A Curation-Free Triangulated Metric for Preference-Stage Learning