mlsanityData to 7 Oct 2026

Do LLMs Possess a Personality? Making the MBTI Test an Amazing Evaluation for Large Language Models

arXiv 2307.16180 ↗First posted 30 Jul 2023cs.CLcited by 54

Not on the map. Why?

Abstract (arXiv)

The field of large language models (LLMs) has made significant progress, and their knowledge storage capacity is approaching that of human beings. Furthermore, advanced techniques, such as prompt learning and reinforcement learning, are being employed to address ethical concerns and hallucination problems associated with LLMs, bringing them closer to aligning with human values. This situation naturally raises the question of whether LLMs with human-like abilities possess a human-like personality? In this paper, we aim to investigate the feasibility of using the Myers-Briggs Type Indicator (MBTI), a widespread human personality assessment tool, as an evaluation metric for LLMs. Specifically, extensive experiments will be conducted to explore: 1) the personality types of different LLMs, 2) the possibility of changing the personality types by prompt engineering, and 3) How does the training dataset affect the model's personality. Although the MBTI is not a rigorous assessment, it can still reflect the similarity between LLMs and human personality. In practice, the MBTI has the potential to serve as a rough indicator. Our codes are available at https://github.com/HarderThenHarder/transformers_tasks/tree/main/LLM/llms_mbti.

Key facts. Cited by 54 papers in the map (data through 7 Oct 2026). Builds on 16 of its 25 references that are in the map. First posted on arXiv 30 Jul 2023.

Builds on

16 of 25 references.

References · 16

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2017Proximal Policy Optimization Algorithmscited by 14,441
  3. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  4. 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,018
  5. 2023A Survey of Large Language Modelscited by 2,537
  6. 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,793
  7. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,767
  8. 2023C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Modelscited by 694
  9. 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 612
  10. 2022Language Models are Multilingual Chain-of-Thought Reasonerscited by 518
  11. 2023A Stitch in Time Saves Nine: Detecting and Mitigating Hallucinations of LLMs by Validating Low-Confidence Generationcited by 202
  12. 2023ExpertPrompting: Instructing Large Language Models to be Distinguished Expertscited by 140
4 more
  1. 2023Auditing large language models: a three-layered approachcited by 135
  2. 2023Can ChatGPT Assess Human Personalities? A General Evaluation Frameworkcited by 69
  3. 2020Ape210K: A Large-Scale and Template-Rich Dataset of Math Word Problemscited by 60
  4. 2022Evaluating Psychological Safety of Large Language Modelscited by 26

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 6; 2024: 26; 2025: 14; 2026: 8.

54 papers.

Sort:

By area:

  1. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
  2. 2024From Persona to Personalization: A Survey on Role-Playing Language Agentscited by 206
  3. 2023InCharacter: Evaluating Personality Fidelity in Role-Playing Agents through Psychological Interviewscited by 177
  4. 2024A Comprehensive Study of Knowledge Editing for Large Language Modelscited by 157
  5. 2024Bias and Unfairness in Information Retrieval Systems: New Challenges in the LLM Eracited by 97
  6. 2024From Individual to Society: A Survey on Social Simulation Driven by Large Language Model-based Agentscited by 76
  7. 2024BIG5-CHAT: Shaping LLM Personalities Through Training on Human-Grounded Datacited by 49
  8. 2025Values in the Wild: Discovering and Analyzing Values in Real-World Language Model Interactionscited by 47
  9. 2024Evaluating Cultural Adaptability of a Large Language Model via Simulation of Synthetic Personascited by 36
  10. 2024Personality Alignment of Large Language Modelscited by 36
  11. 2024VideoCoT: A Video Chain-of-Thought Dataset with Active Annotation Toolcited by 35
  12. 2024PICLe: Eliciting Diverse Behaviors from Large Language Models with Persona In-Context Learningcited by 28
38 more
  1. 2023Challenging the Validity of Personality Tests for Large Language Modelscited by 25
  2. 2023Editing Personality for Large Language Modelscited by 22
  3. 2024The Better Angels of Machine Personality: How Personality Relates to LLM Safetycited by 21
  4. 2024CloChat: Understanding How People Customize, Interact, and Experience Personas in Large Language Modelscited by 19
  5. 2023On the Trustworthiness Landscape of State-of-the-art Generative Models: A Survey and Outlookcited by 15
  6. 2024The Role of AI in Peer Support for Young People: A Study of Preferences for Human- and AI-Generated Responsescited by 15
  7. 2024LMLPA: Language Model Linguistic Personality Assessmentcited by 15
  8. 2024Measuring Human and AI Values Based on Generative Psychometrics with Large Language Modelscited by 13
  9. 2025CombatVLA: An Efficient Vision-Language-Action Model for Combat Tasks in 3D Action Role-Playing Gamescited by 13
  10. 2024Spontaneous Emergence of Agent Individuality through Social Interactions in LLM-Based Communitiescited by 12
  11. 2025Who's the Mole? Modeling and Detecting Intention-Hiding Malicious Agents in LLM-Based Multi-Agent Systemscited by 12
  12. 2026PERSONA: Dynamic and Compositional Inference-Time Personality Control via Activation Vector Algebracited by 11
  13. 2023Machine Mindset: An MBTI Exploration of Large Language Modelscited by 9
  14. 2024Your Large Language Model is Secretly a Fairness Proponent and You Should Prompt it Like Onecited by 9
  15. 2024Non-Linear Inference Time Intervention: Improving LLM Truthfulnesscited by 9
  16. 2024Neuron-based Personality Trait Induction in Large Language Modelscited by 9
  17. 2025Value Drifts: Tracing Value Alignment During LLM Post-Trainingcited by 9
  18. 2024AFSPP: Agent Framework for Shaping Preference and Personality with Large Language Modelscited by 7
  19. 2024Assessment and manipulation of latent constructs in pre-trained language models using psychometric scalescited by 7
  20. 2025Large Language Models as Virtual Survey Respondents: Evaluating Sociodemographic Response Generationcited by 7
  21. 2025Collaborate, Deliberate, Evaluate: How LLM Alignment Affects Coordinated Multi-Agent Outcomescited by 6
  22. 2024Enhancing Role-playing Systems through Aggressive Queries: Evaluation and Improvementcited by 5
  23. 2024Is persona enough for personality? Using ChatGPT to reconstruct an agent's latent personality from simple descriptionscited by 5
  24. 2024PsyDI: Towards a Personalized and Progressively In-depth Chatbot for Psychological Measurementscited by 5
  25. 2024ERABAL: Enhancing Role-Playing Agents through Boundary-Aware Learningcited by 5
  26. 2025Towards Understanding the Cognitive Habits of Large Reasoning Modelscited by 4
  27. 2024From Text to Emoji: How PEFT-Driven Personality Manipulation Unleashes the Emoji Potential in LLMscited by 3
  28. 2025Temperature and Persona Shape LLM Agent Consensus With Minimal Accuracy Gains in Qualitative Codingcited by 3
  29. 2025Toxicity in Online Platforms and AI Systems: A Survey of Needs, Challenges, Mitigations, and Future Directionscited by 3
  30. 2026AI-exhibited Personality Traits Can Shape Human Self-concept through Conversationscited by 3
  31. 2025Integrating Personality into Digital Humans: A Review of LLM-Driven Approaches for Virtual Realitycited by 2
  32. 2025SAC: A Framework for Measuring and Inducing Personality Traits in LLMs with Dynamic Intensity Controlcited by 2
  33. 2026FinPersona-Bench: A Benchmark for Longitudinal Psychometric Stability of Autonomous Financial Agentscited by 1
  34. 2024The Career Interests of Large Language Modelscited by 0
  35. 2025From Post To Personality: Harnessing LLMs for MBTI Prediction in Social Mediacited by 0
  36. 2025Large Language Model Agent Personality and Response Appropriateness: Evaluation by Human Linguistic Experts, LLM-as-Judge, and Natural Language Processing Modelcited by 0
  37. 2025Cognitive Alignment in Personality Reasoning: Leveraging Prototype Theory for MBTI Inferencecited by 0
  38. 2026Event-Centric Human Value Understanding in News-Domain Texts: An Actor-Conditioned, Multi-Granularity Benchmarkcited by 0

50 most cited of 54 All 54 (JSON)