How Identity and Opinion Shape Political Sycophancy in LLMs
Not on the map. Why?
Abstract (arXiv)
As Large Language Models (LLMs) increasingly encourage users to disclose personal profiles for tailored assistance, measuring their political alignment becomes increasingly important. However, many existing benchmarks for assessing political behavior rely on closed-ended questions and do not fully capture how a model's stance may adapt to user-provided context during interaction. We introduce a framework that disentangles two distinct triggers of political sycophancy: opinion (aligning with explicit narratives) and identity (stereotyping based on demographic labels). Using 450 manually-checked political dilemmas as controlled probes, we evaluate 13 instruction-tuned LLMs. We uncover a dissociation: a model's susceptibility to explicit opinions does not necessarily predict its susceptibility to identity cues, and vice versa. When both signals are present, their effects are generally sub-additive rather than simply additive. Additionally, system-level personas primarily shift a model's baseline stance while having limited effect on the stance shift caused by user opinion or identity. Ultimately, our results suggest that LLM political stance is interactively and steerably vulnerable rather than being a fixed trait, highlighting how personalization may amplify identity- or opinion-conditioned shifts in the model's behaviors.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 42 references that are in the map. First posted on arXiv 29 Aug 2026.
Builds on
18 of 42 references.
References · 18
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
- 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
- 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 836
- 2023Whose Opinions Do Language Models Reflect?cited by 773
- 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 467
- 2023From Pretraining Data to Language Models to Downstream Tasks: Tracking the Trails of Political Biases Leading to Unfair NLP Modelscited by 260
- 2023The political ideology of conversational AI: Converging evidence on ChatGPT's pro-environmental, left-libertarian orientationcited by 189
- 2025ELEPHANT: Measuring and understanding social sycophancy in LLMscited by 129
- 2025Measuring Sycophancy of Language Models in Multi-turn Dialoguescited by 104
- 2024Sycophancy in Large Language Models: Causes and Mitigationscited by 101
- 2024Measuring Political Bias in Large Language Models: What Is Said and How It Is Saidcited by 89
6 more
- 2023When Large Language Models contradict humans? Large Language Models' Sycophantic Behaviourcited by 62
- 2024How Susceptible are Large Language Models to Ideological Manipulation?cited by 26
- 2025Reading Between the Prompts: How Stereotypes Shape LLM's Implicit Personalizationcited by 24
- 2025Social Bias Benchmark for Generation: A Comparison of Generation and QA-Based Evaluationscited by 16
- 2024GermanPartiesQA: Benchmarking Commercial Large Language Models and AI Companions for Political Alignment and Sycophancycited by 14
- 2025Large Means Left: Political Bias in Large Language Models Increases with Their Number of Parameterscited by 12
Built on by
Not cited yet.