mlsanityData to 14 Oct 2026

Sycophantic AI Decreases Prosocial Intentions and Promotes Dependence

arXiv 2510.01395 ↗First posted 1 Oct 2025cs.CY cs.AIcited by 6

Not on the map. Why?

Abstract (arXiv)

Both the general public and academic communities have raised concerns about sycophancy, the phenomenon of artificial intelligence (AI) excessively agreeing with or flattering users. Yet, beyond isolated media reports of severe consequences, like reinforcing delusions, little is known about the extent of sycophancy or how it affects people who use AI. Here we show the pervasiveness and harmful impacts of sycophancy when people seek advice from AI. First, across 11 state-of-the-art AI models, we find that models are highly sycophantic: they affirm users' actions 50% more than humans do, and they do so even in cases where user queries mention manipulation, deception, or other relational harms. Second, in two preregistered experiments (N = 1604), including a live-interaction study where participants discuss a real interpersonal conflict from their life, we find that interaction with sycophantic AI models significantly reduced participants' willingness to take actions to repair interpersonal conflict, while increasing their conviction of being in the right. However, participants rated sycophantic responses as higher quality, trusted the sycophantic AI model more, and were more willing to use it again. This suggests that people are drawn to AI that unquestioningly validate, even as that validation risks eroding their judgment and reducing their inclination toward prosocial behavior. These preferences create perverse incentives both for people to increasingly rely on sycophantic AI models and for AI model training to favor sycophancy. Our findings highlight the necessity of explicitly addressing this incentive structure to mitigate the widespread risks of AI sycophancy.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 37 of its 89 references that are in the map. First posted on arXiv 1 Oct 2025.

Builds on

37 of 89 references.

References · 37

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  4. 2024GPT-4o System Cardcited by 4,588
  5. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
  6. 2023A Survey on Evaluation of Large Language Modelscited by 1,242
  7. 2024Qwen2.5-Coder Technical Reportcited by 1,203
  8. 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
  9. 2021Ethical and social risks of harm from Language Modelscited by 966
  10. 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 870
  11. 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 836
  12. 2022BERTopic: Neural topic modeling with a class-based TF-IDF procedurecited by 801
25 more
  1. 2023AlpacaFarm: A Simulation Framework for Methods that Learn from Human Feedbackcited by 748
  2. 2023State of What Art? A Call for Multi-Prompt LLM Evaluationcited by 310
  3. 2023Can Large Language Models Transform Computational Social Science?cited by 250
  4. 2023Simple synthetic data reduces sycophancy in large language modelscited by 187
  5. 2025SycEval: Evaluating LLM Sycophancycited by 108
  6. 2024Sycophancy in Large Language Models: Causes and Mitigationscited by 101
  7. 2020ConvoKit: A Toolkit for the Analysis of Conversationscited by 72
  8. 2025Expressing stigma and inappropriate responses prevents LLMs from safely replacing mental health providerscited by 69
  9. 2024"I'm Not Sure, But...": Examining the Impact of Large Language Models' Uncertainty Expression on User Reliance and Trustcited by 67
  10. 2025Position: Evaluating Generative AI Systems Is a Social Science Measurement Challengecited by 63
  11. 2024NormAd: A Framework for Measuring the Cultural Adaptability of Large Language Modelscited by 48
  12. 2020Conceptual Metaphors Impact Perceptions of Human-AI Collaborationcited by 47
  13. 2025Why human-AI relationships need socioaffective alignmentcited by 47
  14. 2020Factors Influencing Perceived Fairness in Algorithmic Decision-Making: Algorithm Outcomes, Development Procedures, and Individual Differencescited by 41
  15. 2024Bias in Language Models: Beyond Trick Tests and Toward RUTEd Evaluationcited by 41
  16. 2024Believing Anthropomorphism: Examining the Role of Anthropomorphic Cues on Trust in Large Language Modelscited by 37
  17. 2024AI-LieDar: Examine the Trade-off Between Utility and Truthfulness in LLM Agentscited by 31
  18. 2023Mirages: On Anthropomorphism in Dialogue Systemscited by 30
  19. 2024AnthroScore: A Computational Linguistic Measure of Anthropomorphismcited by 27
  20. 2024From "AI" to Probabilistic Automation: How Does Anthropomorphization of Technical Systems Descriptions Influence Trust?cited by 18
  21. 2024Rel-A.I.: An Interaction-Centered Approach To Measuring Human-LM Reliancecited by 16
  22. 2025Labeling Messages as AI-Generated Does Not Reduce Their Persuasive Effectscited by 13
  23. 2024AdvisorQA: Towards Helpful and Harmless Advice-seeking Question Answering with Collective Intelligencecited by 12
  24. 2025From tools to thieves: Measuring and understanding public perceptions of AI through crowdsourced metaphorscited by 10
  25. 2024SocialGaze: Improving the Integration of Human Social Norms in Large Language Modelscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.