PTCBENCH: Benchmarking Contextual Stability of Personality Traits in LLM Systems
Not on the map. Why?
Abstract (arXiv)
With the increasing deployment of large language models (LLMs) in affective agents and AI systems, maintaining a consistent and authentic LLM personality becomes critical for user trust and engagement. However, existing work overlooks a fundamental psychological consensus that personality traits are dynamic and context-dependent. To bridge this gap, we introduce PTCBENCH, a systematic benchmark designed to quantify the consistency of LLM personalities under controlled situational contexts. PTCBENCH subjects models to 12 distinct external conditions spanning diverse location contexts and life events, and rigorously assesses the personality using the NEO Five-Factor Inventory. Our study on 39,240 personality trait records reveals that certain external scenarios (e.g., "Unemployment") can trigger significant personality changes of LLMs, and even alter their reasoning capabilities. Overall, PTCBENCH establishes an extensible framework for evaluating personality consistency in realistic, evolving environments, offering actionable insights for developing robust and psychologically aligned AI systems.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 22 of its 55 references that are in the map. First posted on arXiv 12 Jan 2026.
Builds on
22 of 55 references.
References · 22
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
- 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 828
- 2023AGIEval: A Human-Centric Benchmark for Evaluating Foundation Modelscited by 716
- 2024Large Language Models: A Surveycited by 525
- 2023Challenges and Applications of Large Language Modelscited by 254
- 2023PersonaLLM: Investigating the Ability of Large Language Models to Express Personality Traitscited by 234
- 2024OASIS: Open Agent Social Interaction Simulations with One Million Agentscited by 132
- 2024BIG5-CHAT: Shaping LLM Personalities Through Training on Human-Grounded Datacited by 50
- 2025Consistently Simulating Human Personas with Multi-Turn Reinforcement Learningcited by 39
- 2024CharacterBox: Evaluating the Role-Playing Capabilities of LLMs in Text-Based Virtual Worldscited by 38
- 2024AI Companions Reduce Lonelinesscited by 28
10 more
- 2024PsycoLLM: Enhancing LLM for Psychological Understanding and Evaluationcited by 26
- 2025Evaluating Personality Traits in Large Language Models: Insights from Psychological Questionnairescited by 25
- 2024LLMs Simulate Big Five Personality Traits: Further Evidencecited by 22
- 2024PersoBench: Benchmarking Personalized Response Generation in Large Language Modelscited by 13
- 2025Personality-Driven Decision-Making in LLM-Based Autonomous Agentscited by 13
- 2024Neuron-based Personality Trait Induction in Large Language Modelscited by 9
- 2025The Power of Personality: A Human Simulation Perspective to Investigate Large Language Model Agentscited by 8
- 2025Role-Playing Evaluation for Large Language Modelscited by 5
- 2025A Comparative Study of Large Language Models and Human Personality Traitscited by 3
- 2025Exploring Big Five Personality and AI Capability Effects in LLM-Simulated Negotiation Dialoguescited by 3
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Do AI Personas Grow? Analyzing and Benchmarking Personality Evolution in LLM Agents After Life Eventscited by 2
- 2026FinPersona-Bench: A Benchmark for Longitudinal Psychometric Stability of Autonomous Financial Agentscited by 1
- 2026Identity Is More Than Recall: A Benchmark for Persistent Identity in Deployed AI Agentscited by 0
- 2026Emergi-PersonaOS: A Persona Agent Operating System for Situational Adaptation and Controllable Evolutioncited by 0
- 2026Emergi-PersonaOS: A Persona Agent Operating System for Situational Adaptation and Controllable Evolution23 Sep 2026
- 2026Identity Is More Than Recall: A Benchmark for Persistent Identity in Deployed AI Agents12 Sep 2026
- 2026Do AI Personas Grow? Analyzing and Benchmarking Personality Evolution in LLM Agents After Life Events6 Aug 2026
- 2026FinPersona-Bench: A Benchmark for Longitudinal Psychometric Stability of Autonomous Financial Agents30 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026Structured Personality Control and Adaptation for LLM Agents
- 2025Activation-Space Personality Steering: Hybrid Layer Selection for Stable Trait Control in LLMs
- 2025Persistent Instability in LLM's Personality Measurements: Effects of Scale, Reasoning, and Conversation History
- 2024LLM Agents in Interaction: Measuring Personality Consistency and Linguistic Alignment in Interacting Populations of Large Language Models
- 2025Evaluating LLM Alignment on Personality Inference from Real-World Interview Data
- 2025Humanizing LLMs: A Survey of Psychological Measurements with Tools, Datasets, and Human-Agent Applications
- 2025Personality as a Probe for LLM Evaluation: Method Trade-offs and Downstream Effects
- 2025Beyond BFI: The CSI for Enhanced Reliability and Validity in Evaluating LLM Personality Traits