mlsanityData to 14 Oct 2026

Bullying the Machine: How Personas Increase LLM Vulnerability

arXiv 2505.12692 ↗First posted 19 May 2025cs.AI cs.CLcited by 9

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) are increasingly deployed in interactions where they are prompted to adopt personas. This paper investigates whether such persona conditioning affects model safety under bullying, an adversarial manipulation that applies psychological pressures in order to force the victim to comply to the attacker. We introduce a simulation framework in which an attacker LLM engages a victim LLM using psychologically grounded bullying tactics, while the victim adopts personas aligned with the Big Five personality traits. Experiments using multiple open-source LLMs and a wide range of adversarial goals reveal that certain persona configurations -- such as weakened agreeableness or conscientiousness -- significantly increase victim's susceptibility to unsafe outputs. Bullying tactics involving emotional or sarcastic manipulation, such as gaslighting and ridicule, are particularly effective. These findings suggest that persona-driven interaction introduces a novel vector for safety risks in LLMs and highlight the need for persona-aware safety evaluation and alignment strategies.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 25 of its 42 references that are in the map. First posted on arXiv 19 May 2025.

Builds on

25 of 42 references.

References · 25

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2024Qwen2.5 Technical Reportcited by 4,942
  3. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
  4. 2025Gemma 3 Technical Reportcited by 1,824
  5. 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,420
  6. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
  7. 2023Instruction Tuning for Large Language Models: A Surveycited by 623
  8. 2024How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMscited by 573
  9. 2023"Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Modelscited by 489
  10. 2023DeepInception: Hypnotize Large Language Model to Be Jailbreakercited by 367
  11. 2023Toxicity in ChatGPT: Analyzing Persona-assigned Language Modelscited by 360
  12. 2023PersonaLLM: Investigating the Ability of Large Language Models to Express Personality Traitscited by 234
13 more
  1. 2023Scalable and Transferable Black-Box Jailbreaks for Language Models via Persona Modulationcited by 214
  2. 2024LLM Defenses Are Not Robust to Multi-Turn Human Jailbreaks Yetcited by 151
  3. 2022Evaluating and Inducing Personality in Pre-trained Language Modelscited by 123
  4. 2024Do LLMs Have Distinct and Consistent Personality? TRAIT: Personality Testset designed for LLMs with Psychometricscited by 59
  5. 2024Personality Alignment of Large Language Modelscited by 36
  6. 2024Large Language Models Show Human-like Social Desirability Biases in Survey Responsescited by 28
  7. 2022Evaluating Psychological Safety of Large Language Modelscited by 26
  8. 2024LLMs Simulate Big Five Personality Traits: Further Evidencecited by 22
  9. 2024The Better Angels of Machine Personality: How Personality Relates to LLM Safetycited by 21
  10. 2025LLMs are Vulnerable to Malicious Prompts Disguised as Scientific Languagecited by 17
  11. 2023Machine Mindset: An MBTI Exploration of Large Language Modelscited by 10
  12. 2024StressPrompt: Does Stress Impact Large Language Models and Human Performance Similarly?cited by 6
  13. 2023Illuminating the Black Box: A Psychometric Investigation into the Multifaceted Nature of Large Language Modelscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 6.

9 papers.