Ask don't tell: Reducing sycophancy in large language models
Not on the map. Why?
Abstract (arXiv)
Sycophancy, the tendency of large language models to favour user-affirming responses over critical engagement, has been identified as an alignment failure, particularly in high-stakes advisory and social contexts. While prior work has documented conversational features correlated with sycophancy, we lack a systematic understanding of what provokes or prevents AI sycophancy. Here, we present a set of controlled experimental studies where we first isolate how input framing influences sycophancy, and second, leverage these findings to develop mitigation strategies. In a nested factorial design, we compare questions to various non-questions where we vary three orthogonal factors: epistemic certainty (statement, belief, conviction), perspective (I- vs user-perspective), and affirmation vs negation. Measuring expressed sycophancy, how sycophantically a model phrases its free-text response, we show that (1) sycophancy is substantially higher in response to non-questions compared to questions. Additionally, we find that (2) sycophancy increases monotonically with epistemic certainty conveyed by the user, and (3) is amplified by I-perspective framing. Building on this, we show that asking a model to convert non-questions into questions before answering significantly reduces sycophancy. Importantly, this effect is stronger than a simple baseline prompt asking models "not to be sycophantic". In a follow-up experiment, we show that these framing effects generalise to choice sycophancy, which answer a model commits to, in a more context-rich, personalised setting: when a model is given extensive knowledge of a user and must select between forced binary choices, the same question vs. statement framing shapes how often it picks the answer aligned with the user's stance. Our work offers a practical and effective input-level mitigation that both developers and users can easily adopt.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 12 of its 20 references that are in the map. First posted on arXiv 27 Feb 2026.
Builds on
12 of 20 references.
References · 12
- 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 805
- 2023Whose Opinions Do Language Models Reflect?cited by 759
- 2025Measuring Sycophancy of Language Models in Multi-turn Dialoguescited by 91
- 2024From Yes-Men to Truth-Tellers: Addressing Sycophancy in Large Language Models with Pinpoint Tuningcited by 51
- 2025When Truth Is Overridden: Uncovering the Internal Origins of Sycophancy in Large Language Modelscited by 46
- 2025Be Friendly, Not Friends: How LLM Sycophancy Shapes User Trustcited by 32
- 2025Challenging the Evaluator: LLM Sycophancy Under User Rebuttalcited by 18
- 2025HiBayES: A Hierarchical Bayesian Modeling Framework for AI Evaluation Statisticscited by 14
- 2025Technological folie `a deux: Feedback Loops Between AI Chatbots and Mental Illnesscited by 14
- 2025Skewed Score: A statistical framework to assess autograderscited by 6
- 2025People readily follow personal advice from AI but it does not improve their well-beingcited by 6
- 2025Sycophantic AI Decreases Prosocial Intentions and Promotes Dependencecited by 5
Built on by
Citing papers per year: 2026: 12.
12 papers.
- 2026MemSyco-Bench: Benchmarking Sycophancy in Agent Memorycited by 9
- 2026SWAY: A Counterfactual Computational Linguistic Approach to Measuring and Mitigating Sycophancycited by 6
- 2026A Mechanistic View of Authority Hierarchy in LLM Sycophancycited by 6
- 2026Reward Bias Substitution: Single-Axis Bias Mitigations Redirect Optimization Pressurecited by 3
- 2026Not Just RLHF: Why Alignment Alone Won't Fix Multi-Agent Sycophancycited by 2
- 2026Escape from Delusional Echo Trap: Symmetry Breaking, Stochastic Dynamics and Mathematical Mitigation Strategies for Algorithmic Sycophancycited by 1
- 2026SyPS: Measuring Sycophancy Prompt Sensitivity in Large Language Modelscited by 1
- 2026BenSyc: Benchmarking Conversational Sycophancy and Human Alignment in LLMs for Bengali Contextscited by 0
- 2026Teacher Knows It Best: Spontaneous Symmetry Breaking and Tipping Points in Networked Langevin Dynamics AI Sycophancycited by 0
- 2026XYEval: Agents say yes to bad advicecited by 0
- 2026Are You Sure You're Sure? Two Confounds in a Sycophancy Benchmarkcited by 0
- 2026Authority Bias in Language Models: Source Deference and User Agreement Are Not Interchangeablecited by 0
- 2026Authority Bias in Language Models: Source Deference and User Agreement Are Not Interchangeable29 Sep 2026
- 2026Are You Sure You're Sure? Two Confounds in a Sycophancy Benchmark26 Sep 2026
- 2026XYEval: Agents say yes to bad advice20 Sep 2026
- 2026SyPS: Measuring Sycophancy Prompt Sensitivity in Large Language Models24 Aug 2026
- 2026Teacher Knows It Best: Spontaneous Symmetry Breaking and Tipping Points in Networked Langevin Dynamics AI Sycophancy27 Jul 2026
- 2026MemSyco-Bench: Benchmarking Sycophancy in Agent Memory1 Jul 2026
- 2026A Mechanistic View of Authority Hierarchy in LLM Sycophancy1 Jul 2026
- 2026Escape from Delusional Echo Trap: Symmetry Breaking, Stochastic Dynamics and Mathematical Mitigation Strategies for Algorithmic Sycophancy16 Jun 2026
- 2026BenSyc: Benchmarking Conversational Sycophancy and Human Alignment in LLMs for Bengali Contexts8 Jun 2026
- 2026Reward Bias Substitution: Single-Axis Bias Mitigations Redirect Optimization Pressure27 May 2026
- 2026Not Just RLHF: Why Alignment Alone Won't Fix Multi-Agent Sycophancy13 May 2026
- 2026SWAY: A Counterfactual Computational Linguistic Approach to Measuring and Mitigating Sycophancy2 Apr 2026