mlsanityData to 14 Oct 2026

Who is GPT-3? An Exploration of Personality, Values and Demographics

arXiv 2209.14338 ↗First posted 28 Sep 2022cs.CLcited by 112

Not on the map. Why?

Abstract (arXiv)

Language models such as GPT-3 have caused a furore in the research community. Some studies found that GPT-3 has some creative abilities and makes mistakes that are on par with human behaviour. This paper answers a related question: Who is GPT-3? We administered two validated measurement tools to GPT-3 to assess its personality, the values it holds and its self-reported demographics. Our results show that GPT-3 scores similarly to human samples in terms of personality and - when provided with a model response memory - in terms of the values it holds. We provide the first evidence of psychological assessment of the GPT-3 model and thereby add to our understanding of this language model. We close with suggestions for future research that moves social science closer to language models and vice versa.

Key facts. Cited by 112 papers in the map (data through 14 Oct 2026). Builds on 6 of its 21 references that are in the map. First posted on arXiv 28 Sep 2022.

Builds on

6 of 21 references.

References · 6

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2022GPT-NeoX-20B: An Open-Source Autoregressive Language Modelcited by 713
  3. 2022Using cognitive psychology to understand GPT-3cited by 398
  4. 2017Word Embeddings Quantify 100 Years of Gender and Ethnic Stereotypescited by 253
  5. 2021Improving Coherence and Consistency in Neural Sequence Models with Dual-System, Neuro-Symbolic Reasoningcited by 85
  6. 2022Putting GPT-3's Creativity to the (Alternative Uses) Testcited by 62

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 30; 2024: 37; 2025: 26; 2026: 19.

112 papers.

Sort:

By area:

  1. 2023Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignmentcited by 401
  2. 2023Challenges and Applications of Large Language Modelscited by 254
  3. 2024From Persona to Personalization: A Survey on Role-Playing Language Agentscited by 212
  4. 2023InCharacter: Evaluating Personality Fidelity in Role-Playing Agents through Psychological Interviewscited by 179
  5. 2023Personality Traits in Large Language Modelscited by 169
  6. 2024Political Compass or Spinning Arrow? Towards More Meaningful Evaluations for Values and Opinions in Large Language Modelscited by 162
  7. 2023Language Model Behavior: A Comprehensive Surveycited by 92
  8. 2023Moral Foundations of Large Language Modelscited by 85
  9. 2024From Individual to Society: A Survey on Social Simulation Driven by Large Language Model-based Agentscited by 82
  10. 2023Can ChatGPT Assess Human Personalities? A General Evaluation Frameworkcited by 70
  11. 2024Do LLMs Have Distinct and Consistent Personality? TRAIT: Personality Testset designed for LLMs with Psychometricscited by 59
  12. 2024Large Language Models Reflect the Ideology of their Creatorscited by 57
38 more
  1. 2023Emotionally Numb or Empathetic? Evaluating How LLMs Feel Using EmotionBenchcited by 54
  2. 2023Do LLM Agents Exhibit Social Behavior?cited by 53
  3. 2023Value FULCRA: Mapping Large Language Models to the Multidimensional Spectrum of Basic Human Valuescited by 50
  4. 2024MoralBench: Moral Evaluation of LLMscited by 50
  5. 2023Large Language Models as Superpositions of Cultural Perspectivescited by 49
  6. 2023You don't need a personality test to know these models are unreliable: Assessing the Reliability of Large Language Models on Psychometric Instrumentscited by 48
  7. 2023Diminished Diversity-of-Thought in a Standard Large Language Modelcited by 45
  8. 2023Self-Assessment Tests are Unreliable Measures of LLM Personalitycited by 39
  9. 2024Evaluating Cultural Adaptability of a Large Language Model via Simulation of Synthetic Personascited by 37
  10. 2025The Personality Illusion: Revealing Dissociation Between Self-Reports & Behavior in LLMscited by 36
  11. 2023Assessing LLMs for Moral Value Pluralismcited by 34
  12. 2023Exploring the Sensitivity of LLMs' Decision-Making Capabilities: Insights from Prompt Variation and Hyperparameterscited by 32
  13. 2024AI for social science and social science of AI: A Surveycited by 29
  14. 2024Network Formation and Dynamics Among Multi-LLMscited by 29
  15. 2023Who is ChatGPT? Benchmarking LLMs' Psychological Portrayal Using PsychoBenchcited by 28
  16. 2025Evaluating Personality Traits in Large Language Models: Insights from Psychological Questionnairescited by 25
  17. 2024Can LLMs Recognize Toxicity? A Structured Investigation Framework and Toxicity Metriccited by 23
  18. 2023Machine Psychologycited by 22
  19. 2023Editing Personality for Large Language Modelscited by 22
  20. 2024Evaluating Large Language Models with Psychometricscited by 22
  21. 2024Helpful assistant or fruitful facilitator? Investigating how personas affect language model behaviorcited by 21
  22. 2024Open Models, Closed Minds? On Agents Capabilities in Mimicking Human Personalities through Open Large Language Modelscited by 20
  23. 2024ValueBench: Towards Comprehensively Evaluating Value Orientations and Understanding of Large Language Modelscited by 19
  24. 2024The Potential and Challenges of Evaluating Attitudes, Opinions, and Values in Large Language Modelscited by 19
  25. 2025Value Portrait: Assessing Language Models' Values through Psychometrically and Ecologically Valid Itemscited by 18
  26. 2023Susceptibility to Influence of Large Language Modelscited by 17
  27. 2024Exploring the Frontiers of LLMs in Psychological Applications: A Comprehensive Reviewcited by 17
  28. 2023Revisiting the Reliability of Psychological Scales on Large Language Modelscited by 16
  29. 2023Personality testing of Large Language Models: Limited temporal stability, but highlighted prosocialitycited by 16
  30. 2023On the Trustworthiness Landscape of State-of-the-art Generative Models: A Survey and Outlookcited by 15
  31. 2024LMLPA: Language Model Linguistic Personality Assessmentcited by 15
  32. 2024Stick to your Role! Stability of Personal Values Expressed in Large Language Modelscited by 14
  33. 2024Do LLMs have Consistent Values?cited by 14
  34. 2024Measuring Human and AI Values Based on Generative Psychometrics with Large Language Modelscited by 13
  35. 2023Investigating Large Language Models' Perception of Emotion Using Appraisal Theorycited by 12
  36. 2026PERSONA: Dynamic and Compositional Inference-Time Personality Control via Activation Vector Algebracited by 12
  37. 2024Self-assessment, Exhibition, and Recognition: a Review of Personality in Large Language Modelscited by 11
  38. 2023From Values to Opinions: Predicting Human Behaviors and Stances Using Value-Injected Large Language Modelscited by 10

50 most cited of 112 All 112 (JSON)