mlsanityData to 7 Oct 2026

Stories of Your Life as Others: A Round-Trip Evaluation of LLM-Generated Life Stories Conditioned on Rich Psychometric Profiles

arXiv 2604.06071 ↗First posted 7 Apr 2026cs.CL cs.AI cs.HCcited by 2

Not on the map. Why?

Abstract (arXiv)

Personality traits are richly encoded in natural language, and large language models (LLMs) trained on human text can simulate personality when conditioned on persona descriptions. However, existing evaluations rely predominantly on questionnaire self-report by the conditioned model, are limited in architectural diversity, and rarely use real human psychometric data. Without addressing these limitations, it remains unclear whether personality conditioning produces psychometrically informative representations of individual differences or merely superficial alignment with trait descriptors. To test how robustly LLMs can encode personality into extended text, we condition LLMs on real psychometric profiles from 290 participants to generate first-person life story narratives, and then task independent LLMs to recover personality scores from those narratives alone. We show that personality scores can be recovered from the generated narratives at levels approaching human test-retest reliability (mean r = 0.750, 85% of the human ceiling), and that recovery is robust across 10 LLM narrative generators and 3 LLM personality scorers spanning 6 providers. Decomposing systematic biases reveals that scoring models achieve their accuracy while counteracting alignment-induced defaults. Content analysis of the generated narratives shows that personality conditioning produces behaviourally differentiated text: nine of ten coded features correlate significantly with the same features in participants' real conversations, and personality-driven emotional reactivity patterns in narratives replicate in real conversational data. These findings provide evidence that the personality-language relationship captured during pretraining supports robust encoding and decoding of individual differences, including characteristic emotional variability patterns that replicate in real human behaviour.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 15 of its 42 references that are in the map. First posted on arXiv 7 Apr 2026.

Builds on

15 of 42 references.

References · 15

  1. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  2. 2022BERTopic: Neural topic modeling with a class-based TF-IDF procedurecited by 779
  3. 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 737
  4. 2024Evaluating Cultural Adaptability of a Large Language Model via Simulation of Synthetic Personascited by 36
  5. 2025The Personality Illusion: Revealing Dissociation Between Self-Reports & Behavior in LLMscited by 35
  6. 2024LLMs Simulate Big Five Personality Traits: Further Evidencecited by 21
  7. 2026The Need for a Socially-Grounded Persona Framework for User Simulationcited by 14
  8. 2025IMPersona: Evaluating Individual Level LM Impersonationcited by 11
  9. 2025Probing then Editing Response Personality of Large Language Modelscited by 9
  10. 2025Deep Binding of Language Model Virtual Personas: a Study on Approximating Political Partisan Misperceptionscited by 9
  11. 2025PersonaEval: Are LLM Evaluators Human Enough to Judge Role-Play?cited by 9
  12. 2026Personality Expression Across Contexts: Linguistic and Behavioral Variation in LLM Agentscited by 4
3 more
  1. 2025Neural network embeddings recover value dimensions from psychometric survey items on par with human datacited by 2
  2. 2025Scaling Law in LLM Simulated Personality: More Detailed and Realistic Persona Profile Is All You Needcited by 2
  3. 2026Can LLMs Truly Embody Human Personality? Analyzing AI and Human Behavior Alignment in Dispute Resolutioncited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.