mlsanityData to 7 Oct 2026

Deep Persona: A Psychologically Grounded Architecture and Evaluation Framework for Role-Playing Agents and Simulations

arXiv 2609.22255 ↗First posted 6 Sep 2026cs.CL cs.AIcited by 0

On the map: LLM agents and tool use → Social simulation and multi-agent debate

Abstract (arXiv)

Existing approaches to persona simulation with Large Language Models (LLMs) mostly rely on shallow character descriptions that fail to sustain coherent character behavior across extended interactions. We introduce Deep Persona, a psychologically grounded, three-layered architecture that organizes personas into hierarchical levels of observable expression, latent beliefs, and core motivational drives, for constructing highly convincing role-playing agents. Governed by the principles of scripted determinism and bounded agency, the architecture restricts the model to a reactive engine guided by a structured internal script. We further propose a reference-free evaluation framework that benchmarks dialogue naturalness against empirical human distributions using established psychological clinical instruments and adversarial stress-tests. Empirical evaluation reveals that while LLMs achieve high pragmatic fluency, they exhibit systematic limitations in emotional expression and joint attention. In addition, we present a case study of two Deep Personas and evaluate them using the proposed framework, demonstrating that structured personas can produce interactions that more closely align with human conversational behavior.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 16 of its 44 references that are in the map. First posted on arXiv 6 Sep 2026.

Builds on

16 of 44 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023Generative Agents: Interactive Simulacra of Human Behavior7 Apr

Other references · 15

  1. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  2. 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 820
  3. 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 649
  4. 2019GLTR: Statistical Detection and Visualization of Generated Textcited by 490
  5. 2024From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judgecited by 480
  6. 2023DetectLLM: Leveraging Log Rank Information for Zero-Shot Detection of Machine-Generated Textcited by 207
  7. 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalizationcited by 203
  8. 2020USR: An Unsupervised and Reference Free Evaluation Metric for Dialog Generationcited by 186
  9. 2024Quantifying the Persona Effect in LLM Simulationscited by 164
  10. 2024Hello Again! LLM-powered Personalized Agent for Long-term Dialoguecited by 121
  11. 2025The Alternative Annotator Test for LLM-as-a-Judge: How to Statistically Justify Replacing Human Annotators with LLMscited by 72
  12. 2024The opportunities and risks of large language models in mental healthcited by 54
3 more
  1. 2024HLB: Benchmarking LLMs' Humanlikeness in Language Usecited by 8
  2. 2024ChatGPT Role-play Dataset: Analysis of User Motives and Model Naturalnesscited by 7
  3. 2025Evaluating LLM-Generated Versus Human-Authored Responses in Role-Play Dialoguescited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025DPRF: A Generalizable Dynamic Persona Refinement Framework for Optimizing Behavior Alignment Between Personalized LLM Role-Playing Agents and Humans
  2. 2026A Three-Tier Persona Vector for Controllable User Simulation in Agentic Evaluation
  3. 2026Beyond Cooperative Simulators: Generating Realistic User Personas for Robust Evaluation of LLM Agents
  4. 2025DeepPersona: A Generative Engine for Scaling Deep Synthetic Personas
  5. 2024CharacterGPT: A Persona Reconstruction Framework for Role-Playing Agents
  6. 2024From Persona to Personalization: A Survey on Role-Playing Language Agents
  7. 2025TwinVoice: A Multi-dimensional Benchmark Towards Digital Twins via LLM Persona Simulation
  8. 2025PsyPlay: Personality-Infused Role-Playing Conversational Agents