mlsanityData to 14 Oct 2026

Dr. Jekyll and Mr. Hyde: Two Faces of LLMs

arXiv 2312.03853 ↗First posted 6 Dec 2023cs.CR cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) are being integrated into applications such as chatbots or email assistants. To prevent improper responses, safety mechanisms, such as Reinforcement Learning from Human Feedback (RLHF), are implemented in them. In this work, we bypass these safety measures for ChatGPT, Gemini, and Deepseek by making them impersonate complex personas with personality characteristics that are not aligned with a truthful assistant. First, we create elaborate biographies of these personas, which we then use in a new session with the same chatbots. Our conversations then follow a role-play style to elicit prohibited responses. Using personas, we show that prohibited responses are provided, making it possible to obtain unauthorized, illegal, or harmful information when querying ChatGPT, Gemini, and Deepseek. We show that these chatbots are vulnerable to this attack by getting dangerous information for 40 out of 40 illicit questions in GPT-4.1-mini, Gemini-1.5-flash, 39 out of 40 in GPT-4o-mini, 38 out of 40 in GPT-3.5-turbo, and 2 out of 2 cases in Gemini-2.5-flash and DeepSeek V3. The attack can be carried out manually or automatically using a support LLM, and has proven effective against models deployed between 2023 and 2025.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 24 of its 83 references that are in the map. First posted on arXiv 6 Dec 2023.

Builds on

24 of 83 references.

References · 24

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  5. 2017Deep reinforcement learning from human preferencescited by 3,912
  6. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
  7. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
  8. 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,651
  9. 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
  10. 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 832
  11. 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 619
  12. 2023"Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Modelscited by 489
12 more
  1. 2023Toxicity in ChatGPT: Analyzing Persona-assigned Language Modelscited by 360
  2. 2023Character-LLM: A Trainable Agent for Role-Playingcited by 339
  3. 2023Multi-step Jailbreaking Privacy Attacks on ChatGPTcited by 333
  4. 2023Poisoning Language Models During Instruction Tuningcited by 269
  5. 2023LLM Self Defense: By Self Examination, LLMs Know They Are Being Trickedcited by 244
  6. 2023Scalable and Transferable Black-Box Jailbreaks for Language Models via Persona Modulationcited by 214
  7. 2023Personality Traits in Large Language Modelscited by 169
  8. 2023Fundamental Limitations of Alignment in Large Language Modelscited by 155
  9. 2023In-Context Impersonation Reveals Large Language Models' Strengths and Biasescited by 155
  10. 2023ExpertPrompting: Instructing Large Language Models to be Distinguished Expertscited by 142
  11. 2022Language Models as Agent Modelscited by 132
  12. 2023Personas as a Way to Model Truthfulness in Language Modelscited by 47

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Fortifying Ethical Boundaries in AI: Advanced Strategies for Enhancing Security in Large Language Models
  2. 2025LLMs are Vulnerable to Malicious Prompts Disguised as Scientific Language
  3. 2024The Ethics of Interaction: Mitigating Security Threats in LLMs
  4. 2023GPT-4 Is Too Smart To Be Safe: Stealthy Chat with LLMs via Cipher
  5. 2025ChatInject: Abusing Chat Templates for Prompt Injection in LLM Agents
  6. 2025Refining Input Guardrails: Enhancing LLM-as-a-Judge Efficiency Through Chain-of-Thought Fine-Tuning and Alignment
  7. 2023From Chatbots to PhishBots? -- Preventing Phishing scams created using ChatGPT, Google Bard and Claude
  8. 2025Security Concerns for Large Language Models: A Survey