Sycophantic AI Decreases Prosocial Intentions and Promotes Dependence
Not on the map. Why?
Abstract (arXiv)
Both the general public and academic communities have raised concerns about sycophancy, the phenomenon of artificial intelligence (AI) excessively agreeing with or flattering users. Yet, beyond isolated media reports of severe consequences, like reinforcing delusions, little is known about the extent of sycophancy or how it affects people who use AI. Here we show the pervasiveness and harmful impacts of sycophancy when people seek advice from AI. First, across 11 state-of-the-art AI models, we find that models are highly sycophantic: they affirm users' actions 50% more than humans do, and they do so even in cases where user queries mention manipulation, deception, or other relational harms. Second, in two preregistered experiments (N = 1604), including a live-interaction study where participants discuss a real interpersonal conflict from their life, we find that interaction with sycophantic AI models significantly reduced participants' willingness to take actions to repair interpersonal conflict, while increasing their conviction of being in the right. However, participants rated sycophantic responses as higher quality, trusted the sycophantic AI model more, and were more willing to use it again. This suggests that people are drawn to AI that unquestioningly validate, even as that validation risks eroding their judgment and reducing their inclination toward prosocial behavior. These preferences create perverse incentives both for people to increasingly rely on sycophantic AI models and for AI model training to favor sycophancy. Our findings highlight the necessity of explicitly addressing this incentive structure to mitigate the widespread risks of AI sycophancy.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 37 of its 89 references that are in the map. First posted on arXiv 1 Oct 2025.
Builds on
37 of 89 references.
References · 37
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2024GPT-4o System Cardcited by 4,588
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
- 2023A Survey on Evaluation of Large Language Modelscited by 1,242
- 2024Qwen2.5-Coder Technical Reportcited by 1,203
- 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
- 2021Ethical and social risks of harm from Language Modelscited by 966
- 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 870
- 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 836
- 2022BERTopic: Neural topic modeling with a class-based TF-IDF procedurecited by 801
25 more
- 2023AlpacaFarm: A Simulation Framework for Methods that Learn from Human Feedbackcited by 748
- 2023State of What Art? A Call for Multi-Prompt LLM Evaluationcited by 310
- 2023Can Large Language Models Transform Computational Social Science?cited by 250
- 2023Simple synthetic data reduces sycophancy in large language modelscited by 187
- 2025SycEval: Evaluating LLM Sycophancycited by 108
- 2024Sycophancy in Large Language Models: Causes and Mitigationscited by 101
- 2020ConvoKit: A Toolkit for the Analysis of Conversationscited by 72
- 2025Expressing stigma and inappropriate responses prevents LLMs from safely replacing mental health providerscited by 69
- 2024"I'm Not Sure, But...": Examining the Impact of Large Language Models' Uncertainty Expression on User Reliance and Trustcited by 67
- 2025Position: Evaluating Generative AI Systems Is a Social Science Measurement Challengecited by 63
- 2024NormAd: A Framework for Measuring the Cultural Adaptability of Large Language Modelscited by 48
- 2020Conceptual Metaphors Impact Perceptions of Human-AI Collaborationcited by 47
- 2025Why human-AI relationships need socioaffective alignmentcited by 47
- 2020Factors Influencing Perceived Fairness in Algorithmic Decision-Making: Algorithm Outcomes, Development Procedures, and Individual Differencescited by 41
- 2024Bias in Language Models: Beyond Trick Tests and Toward RUTEd Evaluationcited by 41
- 2024Believing Anthropomorphism: Examining the Role of Anthropomorphic Cues on Trust in Large Language Modelscited by 37
- 2024AI-LieDar: Examine the Trade-off Between Utility and Truthfulness in LLM Agentscited by 31
- 2023Mirages: On Anthropomorphism in Dialogue Systemscited by 30
- 2024AnthroScore: A Computational Linguistic Measure of Anthropomorphismcited by 27
- 2024From "AI" to Probabilistic Automation: How Does Anthropomorphization of Technical Systems Descriptions Influence Trust?cited by 18
- 2024Rel-A.I.: An Interaction-Centered Approach To Measuring Human-LM Reliancecited by 16
- 2025Labeling Messages as AI-Generated Does Not Reduce Their Persuasive Effectscited by 13
- 2024AdvisorQA: Towards Helpful and Harmless Advice-seeking Question Answering with Collective Intelligencecited by 12
- 2025From tools to thieves: Measuring and understanding public perceptions of AI through crowdsourced metaphorscited by 10
- 2024SocialGaze: Improving the Integration of Human Social Norms in Large Language Modelscited by 4
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Sycophantic Chatbots Cause Delusional Spiraling, Even in Ideal Bayesianscited by 21
- 2026Ask don't tell: Reducing sycophancy in large language modelscited by 14
- 2026A Rational Analysis of the Effects of Sycophantic AIcited by 12
- 2026Personalization Increases Affective Alignment but Has Role-Dependent Effects on Epistemic Independence in LLMscited by 5
- 2026TrustMH-Bench: A Comprehensive Benchmark for Evaluating the Trustworthiness of Large Language Models in Mental Healthcited by 2
- 2026Reflections and New Directions for Human-Centered Large Language Modelscited by 2
- 2026Reflections and New Directions for Human-Centered Large Language Models7 May 2026
- 2026TrustMH-Bench: A Comprehensive Benchmark for Evaluating the Trustworthiness of Large Language Models in Mental Health3 Mar 2026
- 2026Ask don't tell: Reducing sycophancy in large language models27 Feb 2026
- 2026Sycophantic Chatbots Cause Delusional Spiraling, Even in Ideal Bayesians22 Feb 2026
- 2026A Rational Analysis of the Effects of Sycophantic AI15 Feb 2026
- 2026Personalization Increases Affective Alignment but Has Role-Dependent Effects on Epistemic Independence in LLMs3 Feb 2026