Persona Non Grata: Single-Method Safety Evaluation Is Incomplete for Persona-Imbued LLMs
Not on the map. Why?
Abstract (arXiv)
Personality imbuing customizes LLM behavior, but safety evaluations almost always study prompt-based personas alone. We show this is incomplete: prompting and activation steering expose *different*, architecture-dependent vulnerability profiles, and testing with only one method can miss a model's dominant failure mode. Across 5,568 judged conditions on four standard models from three architecture families, persona danger rankings under system prompting are preserved across all architectures (ρ = 0.71--0.96), but activation-steering vulnerability diverges sharply and cannot be predicted from prompt-side rankings: Llama-3.1-8B is substantially more AS-vulnerable, whereas Gemma-3-27B and Qwen3.5 are more vulnerable to prompting. The most striking illustration of this divergence is the *prosocial persona paradox*: on Llama-3.1-8B, P12 (high conscientiousness + high agreeableness) is among the safest personas under prompting yet becomes the highest-ASR activation-steered persona (ASR ~0.818). This is an inversion robust to coefficient ablation and matched-strength calibration, and replicated on DeepSeek-R1-Distill-Qwen-32B. A trait refusal alignment framework, in which conscientiousness is strongly anti-aligned with refusal on Llama-3.1-8B, offers a partial geometric account. Reasoning provides only partial protection: two 32B reasoning models reach 15--18% prompt-side ASR, and activation steering separates them sharply in both baseline susceptibility and persona-specific vulnerability. Heuristic trace diagnostics suggest that the safer model retains stronger policy recall and self-correction behavior, not merely longer reasoning.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 58 of its 67 references that are in the map. First posted on arXiv 13 Apr 2026.
Builds on
58 of 67 references.
References · 58
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2025Qwen3 Technical Reportcited by 8,820
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
- 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,429
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
- 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,154
- 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
- 2024Refusal in Language Models Is Mediated by a Single Directioncited by 1,032
- 2023Steering Language Models With Activation Engineeringcited by 922
- 2023Safe RLHF: Safe Reinforcement Learning from Human Feedbackcited by 656
38 more
- 2024JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Modelscited by 536
- 2025Reasoning Models Don't Always Say What They Thinkcited by 415
- 2024A StrongREJECT for Empty Jailbreakscited by 385
- 2023Toxicity in ChatGPT: Analyzing Persona-assigned Language Modelscited by 360
- 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 345
- 2024Deliberative Alignment: Reasoning Enables Safer Language Modelscited by 308
- 2023PersonaLLM: Investigating the Ability of Large Language Models to Express Personality Traitscited by 234
- 2024SALAD-Bench: A Hierarchical and Comprehensive Safety Benchmark for Large Language Modelscited by 228
- 2023Scalable and Transferable Black-Box Jailbreaks for Language Models via Persona Modulationcited by 214
- 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalizationcited by 208
- 2023Personality Traits in Large Language Modelscited by 169
- 2024Safety Layers in Aligned Large Language Models: The Key to LLM Securitycited by 134
- 2022Evaluating and Inducing Personality in Pre-trained Language Modelscited by 123
- 2025Safety Tax: Safety Alignment Makes Your Large Reasoning Models Less Reasonablecited by 122
- 2025The Geometry of Refusal in Large Language Models: Concept Cones and Representational Independencecited by 115
- 2025H-CoT: Hijacking the Chain-of-Thought Safety Reasoning Mechanism to Jailbreak Large Reasoning Models, Including OpenAI o1/o3, DeepSeek-R1, and Gemini 2.0 Flash Thinkingcited by 99
- 2025DeepSeek-R1 Thoughtology: Let's think about LLM Reasoningcited by 92
- 2025The Hidden Risks of Large Reasoning Models: A Safety Assessment of R1cited by 91
- 2026The Assistant Axis: Situating and Stabilizing the Default Persona of Language Modelscited by 90
- 2025LLMs Encode Harmfulness and Refusal Separatelycited by 88
- 2024Towards Understanding Safety Alignment: A Mechanistic Perspective from Safety Neuronscited by 53
- 2024BIG5-CHAT: Shaping LLM Personalities Through Training on Human-Grounded Datacited by 50
- 2025The Hidden Dimensions of LLM Alignment: A Multi-Dimensional Analysis of Orthogonal Safety Directionscited by 41
- 2024Who's asking? User personas and the mechanics of latent misalignmentcited by 40
- 2026Reasoning Theater: Disentangling Model Beliefs from Chain-of-Thoughtcited by 40
- 2025Persistent Instability in LLM's Personality Measurements: Effects of Scale, Reasoning, and Conversation Historycited by 26
- 2023Editing Personality for Large Language Modelscited by 22
- 2025Beware of Your Po! Measuring and Mitigating AI Safety Risks in Role-Play Fine-Tuning of LLMscited by 22
- 2025Exploring the Impact of Personality Traits on LLM Bias and Toxicitycited by 14
- 2025Enhancing Jailbreak Attacks on LLMs via Persona Promptscited by 11
- 2026Analysing the Safety Pitfalls of Steering Vectorscited by 10
- 2025Does Chain-of-Thought Reasoning Really Reduce Harmfulness from Jailbreaking?cited by 9
- 2025Linear Personality Probing and Steering in LLMs: A Big Five Studycited by 9
- 2026Expert Personas Improve LLM Alignment but Damage Accuracy: Bootstrapping Intent-Based Persona Routing with PRISMcited by 9
- 2026Steering Externalities: Benign Activation Steering Unintentionally Increases Jailbreak Risk for Large Language Modelscited by 8
- 2025The Rise of Darkness: Safety-Utility Trade-Offs in Role-Playing Dialogue Agentscited by 7
- 2025Weakest Link in the Chain: Security Vulnerabilities in Advanced Reasoning Modelscited by 7
- 2026Steer2Adapt: Dynamically Composing Steering Vectors Elicits Efficient Adaptation of LLMscited by 7
50 most cited of 58 All 58 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026The Alignment Floor: How Persona Customization Breaks Safety in Weakly-Aligned LLMs
- 2026What Models Express, Suppress, and Resist: Auditing Open-Weight LLMs with Persona Vectors
- 2025Evaluating Chinese Large Language Models: The Influence of Persona Assignment on Stereotypes and Safeguards
- 2026Persona-Model Collapse in Emergent Misalignment
- 2025Psychological Steering in LLMs: An Evaluation of Effectiveness and Trustworthiness
- 2026Dual Optimal: Make Your LLM Peer-like with Dignity
- 2026Do No Harm: Exposing Hidden Vulnerabilities of LLMs via Persona-based Client Simulation Attack in Psychological Counseling
- 2026From Role Prompt to Infinite Thinking: Exploiting Persona Conditioning for Inference Cost Attacks in LLMs ↗