mlsanityData to 14 Oct 2026

PersonaTwin: A Multi-Tier Prompt Conditioning Framework for Generating and Evaluating Personalized Digital Twins

arXiv 2508.10906 ↗First posted 30 Jul 2025cs.CLcited by 5

Not on the map. Why?

Abstract (arXiv)

While large language models (LLMs) afford new possibilities for user modeling and approximation of human behaviors, they often fail to capture the multidimensional nuances of individual users. In this work, we introduce PersonaTwin, a multi-tier prompt conditioning framework that builds adaptive digital twins by integrating demographic, behavioral, and psychometric data. Using a comprehensive data set in the healthcare context of more than 8,500 individuals, we systematically benchmark PersonaTwin against standard LLM outputs, and our rigorous evaluation unites state-of-the-art text similarity metrics with dedicated demographic parity assessments, ensuring that generated responses remain accurate and unbiased. Experimental results show that our framework produces simulation fidelity on par with oracle settings. Moreover, downstream models trained on persona-twins approximate models trained on individuals in terms of prediction and fairness metrics across both GPT-4o-based and Llama-based models. Together, these findings underscore the potential for LLM digital twin-based approaches in producing realistic and emotionally nuanced user simulations, offering a powerful tool for personalized digital user modeling and behavior analysis.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 22 of its 48 references that are in the map. First posted on arXiv 30 Jul 2025.

Builds on

22 of 48 references.

References · 22

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  4. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  5. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  6. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  7. 2016Equality of Opportunity in Supervised Learningcited by 2,007
  8. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
  9. 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 981
  10. 2023Can Large Language Models Be an Alternative to Human Evaluations?cited by 734
  11. 2023LaMP: When Large Language Models Meet Personalizationcited by 437
  12. 2023Character-LLM: A Trainable Agent for Role-Playingcited by 339
10 more
  1. 2024TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Taskscited by 326
  2. 2024LLM Agents Grounded in Self-Reports Enable General-Purpose Simulation of Individualscited by 249
  3. 2023Faithful Persona-based Conversational Dataset Generation with Large Language Modelscited by 47
  4. 2023A Survey on Intersectional Fairness in Machine Learning: Notions, Mitigation, and Challengescited by 41
  5. 2024Beyond Demographics: Aligning Role-playing LLM-based Agents Using Human Belief Networkscited by 39
  6. 2020GRUEN for Evaluating Linguistic Quality of Generated Textcited by 37
  7. 2021CIDEr-R: Robust Consensus-based Image Description Evaluationcited by 22
  8. 2024Recent Trends in Personalized Dialogue Generation: A Review of Datasets, Methodologies, and Evaluationscited by 20
  9. 2024Soda-Eval: Open-Domain Dialogue Evaluation in the age of LLMscited by 10
  10. 2024Leveraging The Finite States of Emotion Processing to Study Late-Life Mental Healthcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 2.

5 papers.