Is Self-knowledge and Action Consistent or Not: Investigating Large Language Model's Personality
Not on the map. Why?
Abstract (arXiv)
In this study, we delve into the validity of conventional personality questionnaires in capturing the human-like personality traits of Large Language Models (LLMs). Our objective is to assess the congruence between the personality traits LLMs claim to possess and their demonstrated tendencies in real-world scenarios. By conducting an extensive examination of LLM outputs against observed human response patterns, we aim to understand the disjunction between self-knowledge and action in LLMs.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 5 of its 24 references that are in the map. First posted on arXiv 22 Feb 2024.
Builds on
5 of 24 references.
References · 5
- 2020Artificial Intelligence, Values and Alignmentcited by 443
- 2023Personality Traits in Large Language Modelscited by 166
- 2022Who is GPT-3? An Exploration of Personality, Values and Demographicscited by 112
- 2023Who is ChatGPT? Benchmarking LLMs' Psychological Portrayal Using PsychoBenchcited by 28
- 2023Revisiting the Reliability of Psychological Scales on Large Language Modelscited by 16
Built on by
Citing papers per year: 2024: 5; 2025: 3.
8 papers.
- 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systemscited by 125
- 2024Benchmarking Distributional Alignment of Large Language Modelscited by 58
- 2024Measuring Bargaining Abilities of LLMs: A Benchmark and A Buyer-Enhancement Methodcited by 44
- 2024Limited Ability of LLMs to Simulate Human Psychological Behaviours: a Psychometric Analysiscited by 30
- 2024The Better Angels of Machine Personality: How Personality Relates to LLM Safetycited by 21
- 2024Self-assessment, Exhibition, and Recognition: a Review of Personality in Large Language Modelscited by 10
- 2025Exploring Big Five Personality and AI Capability Effects in LLM-Simulated Negotiation Dialoguescited by 3
- 2025Human Psychometric Questionnaires Mischaracterize LLM Behaviorcited by 2
- 2025Human Psychometric Questionnaires Mischaracterize LLM Behavior12 Sep 2025
- 2025Exploring Big Five Personality and AI Capability Effects in LLM-Simulated Negotiation Dialogues19 Jun 2025
- 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systems31 Mar 2025
- 2024Benchmarking Distributional Alignment of Large Language Models8 Nov 2024
- 2024The Better Angels of Machine Personality: How Personality Relates to LLM Safety17 Jul 2024
- 2024Self-assessment, Exhibition, and Recognition: a Review of Personality in Large Language Models25 Jun 2024
- 2024Limited Ability of LLMs to Simulate Human Psychological Behaviours: a Psychometric Analysis12 May 2024
- 2024Measuring Bargaining Abilities of LLMs: A Benchmark and A Buyer-Enhancement Method24 Feb 2024