mlsanityData to 7 Oct 2026

Personalization Increases Affective Alignment but Has Role-Dependent Effects on Epistemic Independence in LLMs

arXiv 2603.00024 ↗First posted 3 Feb 2026cs.CL cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) are prone to sycophantic behavior, uncritically conforming to user beliefs. As models increasingly condition responses on user-specific context (personality traits, preferences, conversation history), they gain information to tailor agreement more effectively. Understanding how personalization modulates sycophancy is critical, yet systematic evaluation across models and contexts remains limited. We present a rigorous evaluation of personalization's impact on LLM sycophancy across nine frontier models and five benchmark datasets spanning advice, moral judgment, and debate contexts. We find that personalization generally increases affective alignment (emotional validation, hedging/deference), but affects epistemic alignment (belief adoption, position stability, resistance to influence) with context-dependent role modulation. When the LLM's role is to give advice, personalization strengthens epistemic independence (models challenge user presuppositions). When its role is that of a social peer, personalization decreases epistemic independence. In this role, extensively personalized user challenges causing LLMs to abandon their position at significantly higher rates. Robustness tests confirm that the effects are driven by personalized conditioning, not by additional input tokens per se or demographic information alone. Our work provides measurement frameworks for evaluating personalized AI systems, demonstrates the necessity of role-sensitive evaluation, and establishes a novel benchmark to assess goal alignment.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 32 of its 47 references that are in the map. First posted on arXiv 3 Feb 2026.

Builds on

32 of 47 references.

References · 32

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  2. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
  3. 2023Large Language Models are not Fair Evaluatorscited by 1,050
  4. 2023Towards Understanding Sycophancy in Language Modelscited by 988
  5. 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 805
  6. 2024LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methodscited by 451
  7. 2023Role-Play with Large Language Modelscited by 290
  8. 2024Judging the Judges: A Systematic Study of Position Bias in LLM-as-a-Judgecited by 249
  9. 2024From Persona to Personalization: A Survey on Role-Playing Language Agentscited by 206
  10. 2024Secrets of RLHF in Large Language Models Part II: Reward Modelingcited by 170
  11. 2024Personalizing Reinforcement Learning from Human Feedback with Variational Preference Learningcited by 147
  12. 2024Language Models Learn to Mislead Humans via RLHFcited by 118
20 more
  1. 2025SycEval: Evaluating LLM Sycophancycited by 101
  2. 2024Personalization of Large Language Models: A Surveycited by 100
  3. 2025Measuring Sycophancy of Language Models in Multi-turn Dialoguescited by 91
  4. 2026The Assistant Axis: Situating and Stabilizing the Default Persona of Language Modelscited by 76
  5. 2023Are You Sure? Challenging LLMs Leads to Performance Drops in The FlipFlop Experimentcited by 71
  6. 2024RLHF from Heterogeneous Feedback via Personalization and Preference Aggregationcited by 71
  7. 2025Reinforcement Learning from Human Feedbackcited by 53
  8. 2024Measuring and Controlling Instruction (In)Stability in Language Model Dialogscited by 51
  9. 2025When Truth Is Overridden: Uncovering the Internal Origins of Sycophancy in Large Language Modelscited by 46
  10. 2025Language Models use Lookbacks to Track Beliefscited by 36
  11. 2025TRUTH DECAY: Quantifying Multi-Turn Sycophancy in Language Modelscited by 31
  12. 2024AI-LieDar: Examine the Trade-off Between Utility and Truthfulness in LLM Agentscited by 28
  13. 2025SynthesizeMe! Inducing Persona-Guided Prompts for Personalized Reward Models in LLMscited by 26
  14. 2025Synthetic Socratic Debates: Examining Persona Effects on Moral Decision and Persuasion Dynamicscited by 19
  15. 2025Training language models to be warm and empathetic makes them less reliable and more sycophanticcited by 19
  16. 2025Exploring the Impact of Personality Traits on LLM Bias and Toxicitycited by 14
  17. 2025Simulating Psychological Risks in Human-AI Interactions: Real-Case Informed Modeling of AI-Induced Addiction, Anorexia, Depression, Homicide, Psychosis, and Suicidecited by 10
  18. 2026Accommodation and Epistemic Vigilance: A Pragmatic Account of Why LLMs Fail to Challenge Harmful Beliefscited by 8
  19. 2025Sycophantic AI Decreases Prosocial Intentions and Promotes Dependencecited by 5
  20. 2025Personalized AI Scaffolds Synergistic Multi-Turn Collaboration in Creative Workcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026When Helpfulness Becomes Sycophancy: Sycophancy is a Boundary Failure Between Social Alignment and Epistemic Integrity in Large Language Models
  2. 2026Re-Centering Humans in LLM Personalization
  3. 2026Benchmarking the Personalization Capabilities of Large Language Models
  4. 2025The Personalization Trap: How User Memory Alters Emotional Reasoning in LLMs
  5. 2026PRISM-X: Experiments on Personalised Fine-Tuning with Human and Simulated Users
  6. 2024LLM Agents in Interaction: Measuring Personality Consistency and Linguistic Alignment in Interacting Populations of Large Language Models
  7. 2025Operationalizing Pluralistic Values in Large Language Model Alignment Reveals Trade-offs in Safety, Inclusivity, and Model Behavior
  8. 2026Psi-Bench: Evaluating Persona-Sensitive Influencing in Persuasive Dialogues