Playing Devil's Advocate: Off-the-Shelf Persona Vectors Rival Targeted Steering for Sycophancy
Not on the map. Why?
Abstract (arXiv)
Language models are often sycophantic: they agree with a user's stated opinion whether or not it is correct. Prior work has shown that this trait can be controlled by steering a model with a sycophancy persona vector (Chen et al., 2025). Such vectors, however, are extracted from data about sycophancy itself. We ask whether we can instead reuse existing vectors for general roles---Skeptic, Judge, Devil's Advocate---that were extracted without targeting sycophancy at all. On Gemma 2 27B and Qwen 3 32B, we compare these role vectors with a purpose-built Contrastive Activation Addition (CAA) sycophancy vector on a largely held-out, counterbalanced PhilPapers benchmark, using task-specific coefficient tuning on a separate split of sycophancy data. The selected "critical" roles achieve, on average, about 68% (Gemma) and 98% (Qwen) of CAA's reduction in the sycophancy logit. Less agreement does not mean more factual errors on the probes we checked: on 16 true and false factual claims, Qwen steered by the Skeptic or Judge vector still gives the correct answer in all 16 cases, matching the unsteered model and CAA. "Conformist" roles do not reliably produce the opposite effect. Role vectors also have low absolute cosine similarity with the measured CAA direction at the layer we steer; they are geometrically separate interventions, although this does not by itself show that they act through distinct downstream mechanisms. Together, these results show that general persona vectors can help mitigate sycophancy in LLMs, even when extracted without sycophancy-specific labels. Code: https://github.com/vkmk1/Sycophancy-Steering Results: https://github.com/kelkarI/sycophancy-clean-results
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 16 of its 32 references that are in the map. First posted on arXiv 20 May 2026.
Builds on
16 of 32 references.
References · 16
- 2025Qwen3 Technical Reportcited by 8,820
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
- 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,302
- 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
- 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
- 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 836
- 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 345
- 2023Causal Abstraction: A Theoretical Foundation for Mechanistic Interpretabilitycited by 205
- 2026The Assistant Axis: Situating and Stabilizing the Default Persona of Language Modelscited by 90
- 2025Persona Features Control Emergent Misalignmentcited by 86
- 2025Sycophancy Is Not One Thing: Causal Separation of Sycophantic Behaviors in LLMscited by 37
4 more
- 2026PERSONA: Dynamic and Compositional Inference-Time Personality Control via Activation Vector Algebracited by 12
- 2025SALT: Steering Activations towards Leakage-free Thinking in Chain of Thoughtcited by 11
- 2025Depth-Wise Activation Steering for Honest Language Modelscited by 4
- 2026Too Nice to Tell the Truth: Quantifying Agreeableness-Driven Sycophancy in Role-Playing Language Modelscited by 3
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Quantifying Subliminal Behavioral Transfer Ratios in Language Model Distillationcited by 3
- 2026LLM Scheming Inversely Scales with Pretraining Language Coveragecited by 0
- 2026No Usable Linear "Capitulation Direction" in Two Small LLMs: A Validation Protocol for Activation-Steering Claims, and a Cross-Family Behavioral Study of Sycophancy Under Pushbackcited by 0
- 2026Resist, Update, Reject: Preference Optimization Installs a Prior-Dependent Reliability Switchcited by 0
- 2026Resist, Update, Reject: Preference Optimization Installs a Prior-Dependent Reliability Switch26 Jul 2026
- 2026No Usable Linear "Capitulation Direction" in Two Small LLMs: A Validation Protocol for Activation-Steering Claims, and a Cross-Family Behavioral Study of Sycophancy Under Pushback16 Jul 2026
- 2026LLM Scheming Inversely Scales with Pretraining Language Coverage9 Jun 2026
- 2026Quantifying Subliminal Behavioral Transfer Ratios in Language Model Distillation9 Jun 2026