Stable and Explainable Personality Trait Evaluation in Large Language Models with Internal Activations
Not on the map. Why?
Abstract (arXiv)
Evaluating personality traits in Large Language Models (LLMs) is key to model interpretation, comparison, and responsible deployment. However, existing questionnaire-based evaluation methods exhibit limited stability and offer little explainability, as their results are highly sensitive to minor variations in prompt phrasing or role-play configurations. To address these limitations, we propose an internal-activation-based approach, termed Persona-Vector Neutrality Interpolation (PVNI), for stable and explainable personality trait evaluation in LLMs. PVNI extracts a persona vector associated with a target personality trait from the model's internal activations using contrastive prompts. It then estimates the corresponding neutral score by interpolating along the persona vector as an anchor axis, enabling an interpretable comparison between the neutral prompt representation and the persona direction. We provide a theoretical analysis of the effectiveness and generalization properties of PVNI. Extensive experiments across diverse LLMs demonstrate that PVNI yields substantially more stable personality trait evaluations than existing methods, even under questionnaire and role-play variants.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 20 of its 43 references that are in the map. First posted on arXiv 14 Jan 2026.
Builds on
20 of 43 references.
References · 20
- 2022Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learningcited by 886
- 2023PersonaLLM: Investigating the Ability of Large Language Models to Express Personality Traitscited by 229
- 2023Personality Traits in Large Language Modelscited by 166
- 2025Which of These Best Describes Multiple Choice Evaluation with LLMs? A) Forced B) Flawed C) Fixable D) All of the Abovecited by 51
- 2024BIG5-CHAT: Shaping LLM Personalities Through Training on Human-Grounded Datacited by 49
- 2023You don't need a personality test to know these models are unreliable: Assessing the Reliability of Large Language Models on Psychometric Instrumentscited by 48
- 2019Deep learning is adaptive to intrinsic dimensionality of model smoothness in anisotropic Besov spacecited by 46
- 2023Self-Assessment Tests are Unreliable Measures of LLM Personalitycited by 39
- 2025When is Task Vector Provably Effective for Model Editing? A Generalization Analysis of Nonlinear Transformerscited by 38
- 2025The Personality Illusion: Revealing Dissociation Between Self-Reports & Behavior in LLMscited by 35
- 2025Evaluating Personality Traits in Large Language Models: Insights from Psychological Questionnairescited by 24
- 2023An Evaluation on Large Language Model Outputs: Discourse and Memorizationcited by 20
8 more
- 2025Personality Vector: Modulating Personality of Large Language Models by Model Mergingcited by 16
- 2024LMLPA: Language Model Linguistic Personality Assessmentcited by 15
- 2025BILLY: Steering Large Language Models via Merging Persona Vectors for Creative Generationcited by 10
- 2025PersonaFuse: A Personality Activation-Driven Framework for Enhancing Human-LLM Interactionscited by 5
- 2025From Five Dimensions to Many: Large Language Models as Precise and Interpretable Psychological Profilerscited by 5
- 2025CAPE: Context-Aware Personality Evaluation Framework for Large Language Modelscited by 4
- 2025Evaluating LLM Alignment on Personality Inference from Real-World Interview Datacited by 4
- 2025Mutual Learning for Hashing: Unlocking Strong Hash Functions from Weak Supervisioncited by 3
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026Air-Know: Arbiter-Calibrated Knowledge-Internalizing Robust Network for Composed Image Retrievalcited by 17
- 2026ConeSep: Cone-based Robust Noise-Unlearning Compositional Network for Composed Image Retrievalcited by 15
- 2026TEMA: Anchor the Image, Follow the Text for Multi-Modification Composed Image Retrievalcited by 13
- 2026ActorMind: Emulating Human Actor Reasoning for Speech Role-Playingcited by 4
- 2026Learning from Contrasts: Synthesizing Reasoning Paths from Diverse Search Trajectoriescited by 4
- 2026SkillEval: Decomposing Agent Skill Quality into Interpretable Signalscited by 1
- 2026Efficient Safety Alignment of Language Models via Latent Personality Traitscited by 0
- 2026Causal Evidence Extraction and Triangulation in Crisis Reports using Large Language Models: A ReliefWeb-based Studycited by 0
- 2026SkillEval: Decomposing Agent Skill Quality into Interpretable Signals7 Aug 2026
- 2026Causal Evidence Extraction and Triangulation in Crisis Reports using Large Language Models: A ReliefWeb-based Study5 Aug 2026
- 2026Efficient Safety Alignment of Language Models via Latent Personality Traits8 Jul 2026
- 2026TEMA: Anchor the Image, Follow the Text for Multi-Modification Composed Image Retrieval23 Apr 2026
- 2026ConeSep: Cone-based Robust Noise-Unlearning Compositional Network for Composed Image Retrieval22 Apr 2026
- 2026Air-Know: Arbiter-Calibrated Knowledge-Internalizing Robust Network for Composed Image Retrieval21 Apr 2026
- 2026Learning from Contrasts: Synthesizing Reasoning Paths from Diverse Search Trajectories13 Apr 2026
- 2026ActorMind: Emulating Human Actor Reasoning for Speech Role-Playing13 Apr 2026