mlsanityData to 14 Oct 2026

The use of GPT-4o and Other Large Language Models for the Improvement and Design of Self-Assessment Scales for Measurement of Interpersonal Communication Skills

arXiv 2409.14050 ↗First posted 21 Sep 2024cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

OpenAI's ChatGPT (GPT-4 and GPT-4o) and other Large Language Models (LLMs) like Microsoft's Copilot, Google's Gemini 1.5 Pro, and Antrophic's Claude 3.5 Sonnet can be effectively used in various phases of scientific research. Their performance in diverse verbal tasks and reasoning is close to or above the average human level and rapidly increasing, providing those models with a capacity that resembles a relatively high level of theory of mind. The current ability of LLMs to process information about human psychology and communication creates an opportunity for their scientific use in the fields of personality psychology and interpersonal communication skills. This article illustrates the possible uses of GPT-4o and other advanced LLMs for typical tasks in designing self-assessment scales for interpersonal communication skills measurement like the selection and improvement of scale items and evaluation of content validity of scales. The potential for automated item generation and application is illustrated as well. The case study examples are accompanied by prompts for LLMs that can be useful for these purposes. Finally, a summary is provided of the potential benefits of using LLMs in the process of evaluation, design, and improvement of interpersonal communication skills self-assessment scales.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 39 of its 129 references that are in the map. First posted on arXiv 21 Sep 2024.

Builds on

39 of 129 references.

References · 39

  1. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
  2. 2023Instruction Tuning for Large Language Models: A Surveycited by 623
  3. 2023How Good Are GPT Models at Machine Translation? A Comprehensive Evaluationcited by 348
  4. 2022Emergent Analogical Reasoning in Large Language Modelscited by 240
  5. 2023ChatGPT: Jack of all trades, master of nonecited by 204
  6. 2023Is ChatGPT A Good Translator? Yes With GPT-4 As The Enginecited by 176
  7. 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systemscited by 170
  8. 2024Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviewscited by 164
  9. 2022Thinking Fast and Slow in Large Language Modelscited by 137
  10. 2023Copyright Violations and Large Language Modelscited by 108
  11. 2023A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-4cited by 81
  12. 2024MT-Eval: A Multi-Turn Capabilities Evaluation Benchmark for Large Language Modelscited by 81
27 more
  1. 2024A Survey on Large Language Models for Critical Societal Domains: Finance, Healthcare, and Lawcited by 74
  2. 2023Can ChatGPT Assess Human Personalities? A General Evaluation Frameworkcited by 70
  3. 2023Emotional Intelligence of Large Language Modelscited by 58
  4. 2024The opportunities and risks of large language models in mental healthcited by 54
  5. 2024"We Need Structured Output": Towards User-centered Constraints on Large Language Model Outputcited by 46
  6. 2023A Comparative Study of AI-Generated (GPT-4) and Human-crafted MCQs in Programming Educationcited by 35
  7. 2024CopyBench: Measuring Literal and Non-Literal Reproduction of Copyright-Protected Text in Language Model Generationcited by 35
  8. 2024Artificial Intelligence for Literature Reviews: Opportunities and Challengescited by 30
  9. 2023Large Language Models Can Infer Psychological Dispositions of Social Media Userscited by 29
  10. 2023Is ChatGPT a Good Personality Recognizer? A Preliminary Studycited by 26
  11. 2024Evaluating Large Language Models with Grid-Based Game Competitions: An Extensible LLM Benchmark and Leaderboardcited by 22
  12. 2024ChatGPT as Research Scientist: Probing GPT's Capabilities as a Research Librarian, Research Ethicist, Data Generator and Data Predictorcited by 21
  13. 2024GPT-4 vs. Human Translators: A Comprehensive Evaluation of Translation Quality Across Languages, Domains, and Expertise Levelscited by 21
  14. 2024Exploring the Frontiers of LLMs in Psychological Applications: A Comprehensive Reviewcited by 17
  15. 2024Shortcomings of LLMs for Low-Resource Translation: Retrieval and Understanding are Both the Problemcited by 17
  16. 2024Large Language Model for Mental Health: A Systematic Reviewcited by 14
  17. 2024Assessing Empathy in Large Language Models with Real-World Physician-Patient Interactionscited by 13
  18. 2024Academically intelligent LLMs are not necessarily socially intelligentcited by 12
  19. 2024Self-assessment, Exhibition, and Recognition: a Review of Personality in Large Language Modelscited by 11
  20. 2024Is ChatGPT More Empathetic than Humans?cited by 8
  21. 2023On pitfalls (and advantages) of sophisticated large language modelscited by 7
  22. 2023Can ChatGPT Read Who You Are?cited by 5
  23. 2024Redefining "Hallucination" in LLMs: Towards a psychology-informed framework for mitigating misinformationcited by 5
  24. 2024Is persona enough for personality? Using ChatGPT to reconstruct an agent's latent personality from simple descriptionscited by 5
  25. 2024The global landscape of academic guidelines for generative AI and Large Language Modelscited by 4
  26. 2023Science in the Era of ChatGPT, Large Language Models and Generative AI: Challenges for Research Ethics and How to Respondcited by 2
  27. 2024The high dimensional psychological profile and cultural bias of ChatGPTcited by 2

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.