Your Language Model Secretly Contains Personality Subnetworks
Not on the map. Why?
Abstract (arXiv)
Humans shift between different personas depending on social context. Large Language Models (LLMs) demonstrate a similar flexibility in adopting different personas and behaviors. Existing approaches, however, typically adapt such behavior through external knowledge such as prompting, retrieval-augmented generation (RAG), or fine-tuning. We ask: do LLMs really need external context or parameters to adapt to different behaviors, or do they already have such knowledge embedded in their parameters? In this work, we show that LLMs already contain persona-specialized subnetworks in their parameter space. Using small calibration datasets, we identify distinct activation signatures associated with different personas. Guided by these statistics, we develop a masking strategy that isolates lightweight persona subnetworks. Building on the findings, we further discuss: how can we discover opposing subnetwork from the model that lead to binary-opposing personas, such as introvert-extrovert? To further enhance separation in binary opposition scenarios, we introduce a contrastive pruning strategy that identifies parameters responsible for the statistical divergence between opposing personas. Our method is entirely training-free and relies solely on the language model's existing parameter space. Across diverse evaluation settings, the resulting subnetworks exhibit significantly stronger persona alignment than baselines that require external knowledge while being more efficient. Our findings suggest that diverse human-like behaviors are not merely induced in LLMs, but are already embedded in their parameter space, pointing toward a new perspective on controllable and interpretable personalization in large language models.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 33 of its 36 references that are in the map. First posted on arXiv 6 Feb 2026.
Builds on
33 of 36 references.
References · 33
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,018
- 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,250
- 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,259
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
- 2023SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shotcited by 1,090
- 2022Toy Models of Superpositioncited by 928
- 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 805
- 2023A Simple and Effective Pruning Approach for Large Language Modelscited by 776
- 2023LLM-Pruner: On the Structural Pruning of Large Language Modelscited by 643
- 2023Dissecting Recall of Factual Associations in Auto-Regressive Language Modelscited by 512
- 2023Character-LLM: A Trainable Agent for Role-Playingcited by 335
21 more
- 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 303
- 2023Marked Personas: Using Natural Language Prompts to Measure Stereotypes in Language Modelscited by 204
- 2024RankRAG: Unifying Context Ranking with Retrieval-Augmented Generation in LLMscited by 200
- 2023InCharacter: Evaluating Personality Fidelity in Role-Playing Agents through Psychological Interviewscited by 177
- 2023Personality Traits in Large Language Modelscited by 166
- 2025Do LLMs Recognize Your Preferences? Evaluating Personalized Preference Following in LLMscited by 142
- 2023Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimizationcited by 121
- 2024Personalized Steering of Large Language Models: Versatile Steering Vectors Through Bi-directional Preference Optimizationcited by 112
- 2023Pearl: Personalizing Large Language Model Writing Assistants with Generation-Calibrated Retrieverscited by 91
- 2024HYDRA: Model Factorization Framework for Black-Box LLM Personalizationcited by 59
- 2024LLMs + Persona-Plug = Personalized LLMscited by 29
- 2024PersonaRAG: Enhancing Retrieval-Augmented Generation Systems with User-Centric Agentscited by 28
- 2023Rethinking Graph Lottery Tickets: Graph Sparsity Matterscited by 23
- 2024A Survey of Lottery Ticket Hypothesiscited by 23
- 2024Context Steering: Controllable Personalization at Inference Timecited by 22
- 2025PROPER: A Progressive Learning Framework for Personalized Large Language Models with Group-Level Adaptationcited by 22
- 2024Lifelong Personalized Low-Rank Adaptation of Large Language Models for Recommendationcited by 16
- 2025Exploring the Potential of LLMs as Personalized Assistants: Dataset, Evaluation, and Analysiscited by 16
- 2023Successfully Applying Lottery Ticket Hypothesis to Diffusion Modelcited by 11
- 2023Machine Mindset: An MBTI Exploration of Large Language Modelscited by 9
- 2025Beyond Profile: From Surface-Level Facts to Deep Persona Simulation in LLMscited by 9
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Identity as Attractor: Geometric Evidence for Persistent Agent Architecture in LLM Activation Spacecited by 2
- 2026Incoherent Values? Probing LLM Preferences Through Parametric Variationcited by 2
- 2026Steering Geometry: Validating Human Value Geometry in LLM Steering Spacecited by 0
- 2026PersonaManifold: Revealing and Exploiting Curved Geometry in LLM Persona Representationscited by 0
- 2026PersonaManifold: Revealing and Exploiting Curved Geometry in LLM Persona Representations28 Sep 2026
- 2026Steering Geometry: Validating Human Value Geometry in LLM Steering Space5 Sep 2026
- 2026Incoherent Values? Probing LLM Preferences Through Parametric Variation19 Jun 2026
- 2026Identity as Attractor: Geometric Evidence for Persistent Agent Architecture in LLM Activation Space13 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026The Persona Hierarchy Model: Understanding Contextual Generalization in Fine-Tuning LLMs
- 2026What Models Express, Suppress, and Resist: Auditing Open-Weight LLMs with Persona Vectors
- 2026Invisible Influences: Investigating Implicit Intersectional Biases through Persona Engineering in Large Language Models
- 2026Probing Persona-Dependent Preferences in Language Models
- 2025Dissecting Persona-Driven Reasoning in Language Models via Activation Patching
- 2025PersonaFuse: A Personality Activation-Driven Framework for Enhancing Human-LLM Interactions
- 2026Persona Prompting as a Lens on LLM Social Reasoning
- 2026Beyond Fixed Psychological Personas: State Beats Trait, but Language Models are State-Blind