Pro-AI Bias in Large Language Models
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are increasingly employed for decision-support across multiple domains. We investigate whether these models display a systematic preferential bias in favor of artificial intelligence (AI) itself. Across three complementary experiments, we find consistent evidence of pro-AI bias. First, we show that LLMs disproportionately recommend AI-related options in response to diverse advice-seeking queries, with proprietary models doing so almost deterministically. Second, we demonstrate that models systematically overestimate salaries for AI-related jobs relative to closely matched non-AI jobs, with proprietary models overestimating AI salaries more by 10 percentage points. Finally, probing internal representations of open-weight models reveals that ``Artificial Intelligence'' exhibits the highest similarity to generic prompts for academic fields under positive, negative, and neutral framings alike, indicating valence-invariant representational centrality. These patterns suggest that LLM-generated advice and valuation can systematically skew choices and perceptions in high-stakes decisions.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 45 references that are in the map. First posted on arXiv 20 Jan 2026.
Builds on
30 of 45 references.
References · 30
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
- 2016Semantics derived automatically from language corpora contain human-like biasescited by 894
- 2019How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddingscited by 770
- 2024WildChat: 1M ChatGPT Interaction Logs in the Wildcited by 598
- 2019On Measuring Social Biases in Sentence Encoderscited by 397
- 2024LLM2Vec: Large Language Models Are Secretly Powerful Text Encoderscited by 396
- 2023State of What Art? A Call for Multi-Prompt LLM Evaluationcited by 299
- 2023Benchmarking Cognitive Biases in Large Language Models as Evaluatorscited by 147
- 2023Generative Language Models Exhibit Social Identity Biasescited by 107
- 2024Bias in Large Language Models: Origin, Evaluation, and Mitigationcited by 77
- 2024Efficient multi-prompt evaluation of LLMscited by 72
18 more
- 2024Repetition Improves Language Model Embeddingscited by 70
- 2023Evaluating the Zero-shot Robustness of Instruction-tuned Language Modelscited by 63
- 2014Improving zero-shot learning by mitigating the hubness problemcited by 53
- 2023Decision-Oriented Dialogue for Human-AI Collaborationcited by 29
- 2024Large Language Models as Recommender Systems: A Study of Popularity Biascited by 25
- 2024AI-AI Bias: large language models favor communications generated by large language modelscited by 25
- 2024Auditing the Use of Language Models to Guide Hiring Decisionscited by 19
- 2025Are Generative AI Agents Effective Personalized Financial Advisors?cited by 18
- 2025Rankers, Judges, and Assistants: Towards Understanding the Interplay of LLMs in Information Retrieval Evaluationcited by 15
- 2023Cognitive Effects in Large Language Modelscited by 14
- 2025Taxonomy of User Needs and Actionscited by 13
- 2024AdvisorQA: Towards Helpful and Harmless Advice-seeking Question Answering with Collective Intelligencecited by 12
- 2025HumanAgencyBench: Scalable Evaluation of Human Agency Support in AI Assistantscited by 10
- 2025Measuring Political Preferences in AI Systems: An Integrative Approachcited by 9
- 2025Evaluate Bias without Manual Test Sets: A Concept Representation Perspective for LLMscited by 5
- 2025Gender and Positional Biases in LLM-Based Hiring Decisions: Evidence from Comparative CV/R'esum'e Evaluationscited by 3
- 2025Out-of-Context Reasoning in Large Language Modelscited by 2
- 2025Towards New Benchmark for AI Alignment & Sentiment Analysis in Socially Important Issues: A Comparative Study of Human and LLMs in the Context of AGIcited by 1
Built on by
Not cited yet.