LLM Persona Unlearning
On the map: LLM safety and security → Machine unlearning
Abstract (arXiv)
Pre-training equips large language models (LLMs) with a broad repertoire of behavioral patterns associated with roles, styles, values, and goals. Post-training teaches conditional enactment and makes a helpful Assistant the default, but it does not erase alternative modes from the weights; explicit prompts can therefore elicit personas that repeatedly shape judgment, language, and action. In open-weight settings, runtime controls can be removed, motivating persona unlearning: a weight-level edit that makes a designated persona difficult to elicit and enact on unseen contexts. We introduce PersonaUnlearnBench, a model-specific paired benchmark spanning six LLMs from three families and five personas, with aligned forget/retain sets, held-out instruction paraphrases, and four-axis evaluation. The benchmark shows that standard unlearning methods cannot reliably erase the target persona without sacrificing meaningful generation or general utility. We therefore propose PaCE, which compares target and desirable responses to the same questions to locate an internal behavior direction, then trains target-prompt states away from the target mode and toward the matched desirable response. Experiments show that PaCE consistently suppresses target personas with high response quality and useful counterpart behavior, at moderate utility cost. These results establish persona unlearning as a distinct behavior-level editing problem and a practical route toward persistent control of latent LLM response policies.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 57 of its 68 references that are in the map. First posted on arXiv 30 Sep 2026.
Builds on
57 of 68 references.
Closest ancestors · 18
Same direction, newest first
- 2025LLM Unlearning with LLM Beliefs22 Oct
- 2025OpenUnlearning: Accelerating LLM Unlearning via Unified Benchmarking of Methods and Metrics14 Jun
- 2025Constrained Entropic Unlearning: A Primal-Dual Framework for Large Language Models5 Jun
- 2025Exploring Criteria of Loss Reweighting to Enhance LLM Unlearning17 May
- 2025Rethinking LLM Unlearning Objectives: A Gradient Perspective and Go Beyond26 Feb
- 2024WAGLE: Strategic Weight Attribution for Effective and Modular Unlearning in Large Language Models23 Oct
- 2024LLM Unlearning via Loss Adjustment with Only Forget Data14 Oct
- 2024Simplicity Prevails: Rethinking Negative Preference Optimization for LLM Unlearning9 Oct
- 2024MUSE: Machine Unlearning Six-Way Evaluation for Language Models8 Jul
- 2024RWKU: Benchmarking Real-World Knowledge Unlearning for Large Language Models16 Jun
- 2024Reversing the Forget-Retain Objectives: An Efficient LLM Unlearning Framework from Logit Difference12 Jun
- 2024Large Language Model Unlearning via Embedding-Corrupted Prompts12 Jun
6 more
- 2024Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearning8 Apr
- 2024Rethinking Machine Unlearning for Large Language Models13 Feb
- 2024TOFU: A Task of Fictitious Unlearning for LLMs11 Jan
- 2023Large Language Model Unlearning14 Oct
- 2023Who's Harry Potter? Approximate Unlearning in LLMs3 Oct
- 2022Knowledge Unlearning for Mitigating Privacy Risks in Language Models4 Oct
Other references · 39
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
- 2022Locating and Editing Factual Associations in GPTcited by 2,609
- 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,326
- 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,259
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
- 2023Instruction-Following Evaluation for Large Language Modelscited by 1,143
27 more
- 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,106
- 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,009
- 2023Towards Understanding Sycophancy in Language Modelscited by 988
- 2022Mass-Editing Memory in a Transformercited by 976
- 2024Refusal in Language Models Is Mediated by a Single Directioncited by 960
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 877
- 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 805
- 2021Fast Model Editing at Scalecited by 491
- 2024The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearningcited by 488
- 2023"Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Modelscited by 457
- 2022Memory-Based Model Editing at Scalecited by 443
- 2020Null It Out: Guarding Protected Attributes by Iterative Nullspace Projectioncited by 442
- 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 303
- 2023Role-Play with Large Language Modelscited by 290
- 2023LEACE: Perfect linear concept erasure in closed formcited by 254
- 2022Extracting Latent Steering Vectors from Pretrained Language Modelscited by 217
- 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalizationcited by 203
- 2023Scalable and Transferable Black-Box Jailbreaks for Language Models via Persona Modulationcited by 202
- 2026Gemma 4 Technical Reportcited by 187
- 2023RoleLLM: Benchmarking, Eliciting, and Enhancing Role-Playing Abilities of Large Language Modelscited by 173
- 2024Tamper-Resistant Safeguards for Open-Weight LLMscited by 132
- 2022Linear Adversarial Concept Erasurecited by 98
- 2024PersonaGym: Evaluating Persona Agents and LLMscited by 89
- 2025Persona Features Control Emergent Misalignmentcited by 76
- 2026The Assistant Axis: Situating and Stabilizing the Default Persona of Language Modelscited by 76
- 2026Emotion Concepts and their Function in a Large Language Modelcited by 48
- 2026Where is the Mind? Persona Vectors and LLM Individuationcited by 7
Built on by
Not cited yet.