PersonaManifold: Revealing and Exploiting Curved Geometry in LLM Persona Representations
Not on the map. Why?
Abstract (arXiv)
Controlling persona in large language models (LLMs) at inference time is important for role-playing, personalized dialogue, and social simulation. Recent methods extract persona vectors from the model's activation space and apply Euclidean operations---addition, scaling, and linear interpolation---under the linear representation hypothesis. However, these methods themselves report systematic failures: non-orthogonal trait dimensions, asymmetric ceiling and resistance effects, and significant deviations in multi-trait composition, suggesting that the linear isotropic assumption does not hold. We propose PersonaManifold, a framework that models persona representations as points on a curved, low-dimensional Riemannian submanifold in activation space. We estimate the manifold's intrinsic geometry---local metric tensors, geodesic distances, and Ollivier-Ricci curvature---and introduce geodesic steering, which interpolates between personas along manifold geodesics rather than Euclidean straight lines. We also propose the Behavioral Similarity Triplet (BST) benchmark, which automatically generates situational questions grounded in six established psychological constructs and defines persona similarity through behavioral responses rather than self-report questionnaires. Experiments on three open-source LLMs show that persona activations form a manifold with heterogeneous curvature, geodesic distance predicts behavioral similarity more accurately than Euclidean alternatives with independent contributions from anisotropy and curvature, and geodesic steering produces more coherent intermediate personas on both our BST benchmark and external evaluations, with the advantage concentrated in high-deviation regions where the manifold deviates most from flatness.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 36 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
17 of 36 references.
References · 17
- 2019How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddingscited by 770
- 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 397
- 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 303
- 2023InCharacter: Evaluating Personality Fidelity in Role-Playing Agents through Psychological Interviewscited by 177
- 2020Riemannian Continuous Normalizing Flowscited by 143
- 2024PersonaGym: Evaluating Persona Agents and LLMscited by 89
- 2019Community Detection on Networks with Ricci Flowcited by 62
- 2024Evaluating Character Understanding of Large Language Models via Character Profiling from Fictional Workscited by 38
- 2025The Personality Illusion: Revealing Dissociation Between Self-Reports & Behavior in LLMscited by 35
- 2025Consistently Simulating Human Personas with Multi-Turn Reinforcement Learningcited by 35
- 2024Character is Destiny: Can Role-Playing Language Agents Make Persona-Driven Decisions?cited by 34
- 2024Capturing Minds, Not Just Words: Enhancing Role-Playing Language Models with Personality-Indicative Datacited by 17
5 more
- 2025Personality Vector: Modulating Personality of Large Language Models by Model Mergingcited by 16
- 2026PERSONA: Dynamic and Compositional Inference-Time Personality Control via Activation Vector Algebracited by 11
- 2024MINDECHO: Role-Playing Language Agents for Key Opinion Leaderscited by 10
- 2025Dissecting Persona-Driven Reasoning in Language Models via Activation Patchingcited by 5
- 2026Your Language Model Secretly Contains Personality Subnetworkscited by 4
Built on by
Not cited yet.