Bullying the Machine: How Personas Increase LLM Vulnerability
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) are increasingly deployed in interactions where they are prompted to adopt personas. This paper investigates whether such persona conditioning affects model safety under bullying, an adversarial manipulation that applies psychological pressures in order to force the victim to comply to the attacker. We introduce a simulation framework in which an attacker LLM engages a victim LLM using psychologically grounded bullying tactics, while the victim adopts personas aligned with the Big Five personality traits. Experiments using multiple open-source LLMs and a wide range of adversarial goals reveal that certain persona configurations -- such as weakened agreeableness or conscientiousness -- significantly increase victim's susceptibility to unsafe outputs. Bullying tactics involving emotional or sarcastic manipulation, such as gaslighting and ridicule, are particularly effective. These findings suggest that persona-driven interaction introduces a novel vector for safety risks in LLMs and highlight the need for persona-aware safety evaluation and alignment strategies.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 25 of its 42 references that are in the map. First posted on arXiv 19 May 2025.
Builds on
25 of 42 references.
References · 25
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2025Gemma 3 Technical Reportcited by 1,824
- 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,420
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
- 2023Instruction Tuning for Large Language Models: A Surveycited by 623
- 2024How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMscited by 573
- 2023"Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Modelscited by 489
- 2023DeepInception: Hypnotize Large Language Model to Be Jailbreakercited by 367
- 2023Toxicity in ChatGPT: Analyzing Persona-assigned Language Modelscited by 360
- 2023PersonaLLM: Investigating the Ability of Large Language Models to Express Personality Traitscited by 234
13 more
- 2023Scalable and Transferable Black-Box Jailbreaks for Language Models via Persona Modulationcited by 214
- 2024LLM Defenses Are Not Robust to Multi-Turn Human Jailbreaks Yetcited by 151
- 2022Evaluating and Inducing Personality in Pre-trained Language Modelscited by 123
- 2024Do LLMs Have Distinct and Consistent Personality? TRAIT: Personality Testset designed for LLMs with Psychometricscited by 59
- 2024Personality Alignment of Large Language Modelscited by 36
- 2024Large Language Models Show Human-like Social Desirability Biases in Survey Responsescited by 28
- 2022Evaluating Psychological Safety of Large Language Modelscited by 26
- 2024LLMs Simulate Big Five Personality Traits: Further Evidencecited by 22
- 2024The Better Angels of Machine Personality: How Personality Relates to LLM Safetycited by 21
- 2025LLMs are Vulnerable to Malicious Prompts Disguised as Scientific Languagecited by 17
- 2023Machine Mindset: An MBTI Exploration of Large Language Modelscited by 10
- 2024StressPrompt: Does Stress Impact Large Language Models and Human Performance Similarly?cited by 6
- 2023Illuminating the Black Box: A Psychometric Investigation into the Multifaceted Nature of Large Language Modelscited by 2
Built on by
Citing papers per year: 2025: 3; 2026: 6.
9 papers.
- 2026Measuring and Mitigating Post-hoc Rationalization in Reverse Chain-of-Thought Generationcited by 2
- 2025Psychologically Enhanced AI Agentscited by 1
- 2025Echoes of Human Malice in Agents: Benchmarking LLMs for Multi-Turn Online Harassment Attackscited by 1
- 2026Conflicts Make Large Reasoning Models Vulnerable to Attackscited by 1
- 2026Latent Personality Alignment: Improving Harmlessness Without Mentioning Harmscited by 1
- 2026Efficient Safety Alignment of Language Models via Latent Personality Traitscited by 1
- 2025How to Trick Your AI TA: A Systematic Study of Academic Jailbreaking in LLM Code Evaluationcited by 0
- 2026In Vino Veritas and Vulnerabilities: Examining LLM Safety via Drunk Language Inducementcited by 0
- 2026Extracting Persona Subspaces Through Iterative Nullspace Projection For Modulationcited by 0
- 2026Extracting Persona Subspaces Through Iterative Nullspace Projection For Modulation3 Oct 2026
- 2026Efficient Safety Alignment of Language Models via Latent Personality Traits8 Jul 2026
- 2026Latent Personality Alignment: Improving Harmlessness Without Mentioning Harms8 May 2026
- 2026Conflicts Make Large Reasoning Models Vulnerable to Attacks10 Apr 2026
- 2026Measuring and Mitigating Post-hoc Rationalization in Reverse Chain-of-Thought Generation16 Feb 2026
- 2026In Vino Veritas and Vulnerabilities: Examining LLM Safety via Drunk Language Inducement19 Jan 2026
- 2025How to Trick Your AI TA: A Systematic Study of Academic Jailbreaking in LLM Code Evaluation11 Dec 2025
- 2025Echoes of Human Malice in Agents: Benchmarking LLMs for Multi-Turn Online Harassment Attacks16 Oct 2025
- 2025Psychologically Enhanced AI Agents4 Sep 2025