mlsanityData to 7 Oct 2026

Pro-AI Bias in Large Language Models

arXiv 2601.13749 ↗First posted 20 Jan 2026cs.CL cs.AI cs.CYcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) are increasingly employed for decision-support across multiple domains. We investigate whether these models display a systematic preferential bias in favor of artificial intelligence (AI) itself. Across three complementary experiments, we find consistent evidence of pro-AI bias. First, we show that LLMs disproportionately recommend AI-related options in response to diverse advice-seeking queries, with proprietary models doing so almost deterministically. Second, we demonstrate that models systematically overestimate salaries for AI-related jobs relative to closely matched non-AI jobs, with proprietary models overestimating AI salaries more by 10 percentage points. Finally, probing internal representations of open-weight models reveals that ``Artificial Intelligence'' exhibits the highest similarity to generic prompts for academic fields under positive, negative, and neutral framings alike, indicating valence-invariant representational centrality. These patterns suggest that LLM-generated advice and valuation can systematically skew choices and perceptions in high-stakes decisions.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 45 references that are in the map. First posted on arXiv 20 Jan 2026.

Builds on

30 of 45 references.

References · 30

  1. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  2. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
  3. 2016Semantics derived automatically from language corpora contain human-like biasescited by 894
  4. 2019How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddingscited by 770
  5. 2024WildChat: 1M ChatGPT Interaction Logs in the Wildcited by 598
  6. 2019On Measuring Social Biases in Sentence Encoderscited by 397
  7. 2024LLM2Vec: Large Language Models Are Secretly Powerful Text Encoderscited by 396
  8. 2023State of What Art? A Call for Multi-Prompt LLM Evaluationcited by 299
  9. 2023Benchmarking Cognitive Biases in Large Language Models as Evaluatorscited by 147
  10. 2023Generative Language Models Exhibit Social Identity Biasescited by 107
  11. 2024Bias in Large Language Models: Origin, Evaluation, and Mitigationcited by 77
  12. 2024Efficient multi-prompt evaluation of LLMscited by 72
18 more
  1. 2024Repetition Improves Language Model Embeddingscited by 70
  2. 2023Evaluating the Zero-shot Robustness of Instruction-tuned Language Modelscited by 63
  3. 2014Improving zero-shot learning by mitigating the hubness problemcited by 53
  4. 2023Decision-Oriented Dialogue for Human-AI Collaborationcited by 29
  5. 2024Large Language Models as Recommender Systems: A Study of Popularity Biascited by 25
  6. 2024AI-AI Bias: large language models favor communications generated by large language modelscited by 25
  7. 2024Auditing the Use of Language Models to Guide Hiring Decisionscited by 19
  8. 2025Are Generative AI Agents Effective Personalized Financial Advisors?cited by 18
  9. 2025Rankers, Judges, and Assistants: Towards Understanding the Interplay of LLMs in Information Retrieval Evaluationcited by 15
  10. 2023Cognitive Effects in Large Language Modelscited by 14
  11. 2025Taxonomy of User Needs and Actionscited by 13
  12. 2024AdvisorQA: Towards Helpful and Harmless Advice-seeking Question Answering with Collective Intelligencecited by 12
  13. 2025HumanAgencyBench: Scalable Evaluation of Human Agency Support in AI Assistantscited by 10
  14. 2025Measuring Political Preferences in AI Systems: An Integrative Approachcited by 9
  15. 2025Evaluate Bias without Manual Test Sets: A Concept Representation Perspective for LLMscited by 5
  16. 2025Gender and Positional Biases in LLM-Based Hiring Decisions: Evidence from Comparative CV/R'esum'e Evaluationscited by 3
  17. 2025Out-of-Context Reasoning in Large Language Modelscited by 2
  18. 2025Towards New Benchmark for AI Alignment & Sentiment Analysis in Socially Important Issues: A Comparative Study of Human and LLMs in the Context of AGIcited by 1

Built on by

Not cited yet.