mlsanityData to 7 Oct 2026

Self-assessment, Exhibition, and Recognition: a Review of Personality in Large Language Models

arXiv 2406.17624 ↗First posted 25 Jun 2024cs.CL cs.AIcited by 10

Not on the map. Why?

Abstract (arXiv)

As large language models (LLMs) appear to behave increasingly human-like in text-based interactions, more and more researchers become interested in investigating personality in LLMs. However, the diversity of psychological personality research and the rapid development of LLMs have led to a broad yet fragmented landscape of studies in this interdisciplinary field. Extensive studies across different research focuses, different personality psychometrics, and different LLMs make it challenging to have a holistic overview and further pose difficulties in applying findings to real-world applications. In this paper, we present a comprehensive review by categorizing current studies into three research problems: self-assessment, exhibition, and recognition, based on the intrinsic characteristics and external manifestations of personality in LLMs. For each problem, we provide a thorough analysis and conduct in-depth comparisons of their corresponding solutions. Besides, we summarize research findings and open challenges from current studies and further discuss their underlying causes. We also collect extensive publicly available resources to facilitate interested researchers and developers. Lastly, we discuss the potential future research directions and application scenarios. Our paper is the first comprehensive survey of up-to-date literature on personality in LLMs. By presenting a clear taxonomy, in-depth analysis, promising future directions, and extensive resource collections, we aim to provide a better understanding and facilitate further advancements in this emerging field.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 40 of its 99 references that are in the map. First posted on arXiv 25 Jun 2024.

Builds on

40 of 99 references.

References · 40

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2022Training language models to follow instructions with human feedbackcited by 15,712
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  5. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  6. 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,235
  7. 2023PersonaLLM: Investigating the Ability of Large Language Models to Express Personality Traitscited by 229
  8. 2024From Persona to Personalization: A Survey on Role-Playing Language Agentscited by 206
  9. 2023InCharacter: Evaluating Personality Fidelity in Role-Playing Agents through Psychological Interviewscited by 177
  10. 2021Understanding the Capabilities, Limitations, and Societal Impact of Large Language Modelscited by 159
  11. 2022Who is GPT-3? An Exploration of Personality, Values and Demographicscited by 112
  12. 2023Can ChatGPT Assess Human Personalities? A General Evaluation Frameworkcited by 69
28 more
  1. 2023Building Emotional Support Chatbots in the Era of LLMscited by 62
  2. 2023Large Language Models as Superpositions of Cultural Perspectivescited by 48
  3. 2023You don't need a personality test to know these models are unreliable: Assessing the Reliability of Large Language Models on Psychometric Instrumentscited by 48
  4. 2022Estimating the Personality of White-Box Language Modelscited by 47
  5. 2022Identifying and Manipulating the Personality Traits of Language Modelscited by 40
  6. 2023Self-Assessment Tests are Unreliable Measures of LLM Personalitycited by 39
  7. 2023Have Large Language Models Developed a Personality?: Applicability of Self-Assessment Tests in Measuring Personality in LLMscited by 32
  8. 2024Limited Ability of LLMs to Simulate Human Psychological Behaviours: a Psychometric Analysiscited by 30
  9. 2023Systematic Evaluation of GPT-3 for Zero-Shot Personality Estimationcited by 28
  10. 2023Who is ChatGPT? Benchmarking LLMs' Psychological Portrayal Using PsychoBenchcited by 28
  11. 2024PICLe: Eliciting Diverse Behaviors from Large Language Models with Persona In-Context Learningcited by 28
  12. 2024Large Language Models Show Human-like Social Desirability Biases in Survey Responsescited by 27
  13. 2023Is ChatGPT a Good Personality Recognizer? A Preliminary Studycited by 24
  14. 2023PsyCoT: Psychological Questionnaire as Powerful Chain-of-Thought for Personality Detectioncited by 21
  15. 2024LLMvsSmall Model? Large Language Model Based Text Augmentation Enhanced Personality Detection Modelcited by 21
  16. 2024LLMs with Personalities in Multi-issue Negotiation Gamescited by 21
  17. 2024Simulating Human Strategic Behavior: Comparing Single and Multi-agent LLMscited by 20
  18. 2024PHAnToM: Persona-based Prompting Has An Effect on Theory-of-Mind Reasoning in Large Language Modelscited by 16
  19. 2023Controlling Personality Style in Dialogue with Zero-Shot Prompt-Based Learningcited by 14
  20. 2024Academically intelligent LLMs are not necessarily socially intelligentcited by 12
  21. 2023AI Text-to-Behavior: A Study In Steerabilitycited by 11
  22. 2022Deep Lexical Hypothesis: Identifying personality structure in natural languagecited by 10
  23. 2023On the Effectiveness of Creating Conversational Agent Personalities Through Promptingcited by 10
  24. 2024Identifying Multiple Personalities in Large Language Models with External Evaluationcited by 10
  25. 2024Is Self-knowledge and Action Consistent or Not: Investigating Large Language Model's Personalitycited by 8
  26. 2024Affective-NLI: Towards Accurate and Interpretable Personality Recognition in Conversationcited by 7
  27. 2024Large Language Models Can Infer Personality from Free-Form User Interactionscited by 7
  28. 2024On the Psychology of GPT-4: Moderately anxious, slightly masculine, honest, and humblecited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 4; 2026: 3.

10 papers.