The use of GPT-4o and Other Large Language Models for the Improvement and Design of Self-Assessment Scales for Measurement of Interpersonal Communication Skills
Not on the map. Why?
Abstract (arXiv)
OpenAI's ChatGPT (GPT-4 and GPT-4o) and other Large Language Models (LLMs) like Microsoft's Copilot, Google's Gemini 1.5 Pro, and Antrophic's Claude 3.5 Sonnet can be effectively used in various phases of scientific research. Their performance in diverse verbal tasks and reasoning is close to or above the average human level and rapidly increasing, providing those models with a capacity that resembles a relatively high level of theory of mind. The current ability of LLMs to process information about human psychology and communication creates an opportunity for their scientific use in the fields of personality psychology and interpersonal communication skills. This article illustrates the possible uses of GPT-4o and other advanced LLMs for typical tasks in designing self-assessment scales for interpersonal communication skills measurement like the selection and improvement of scale items and evaluation of content validity of scales. The potential for automated item generation and application is illustrated as well. The case study examples are accompanied by prompts for LLMs that can be useful for these purposes. Finally, a summary is provided of the potential benefits of using LLMs in the process of evaluation, design, and improvement of interpersonal communication skills self-assessment scales.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 39 of its 129 references that are in the map. First posted on arXiv 21 Sep 2024.
Builds on
39 of 129 references.
References · 39
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
- 2023Instruction Tuning for Large Language Models: A Surveycited by 623
- 2023How Good Are GPT Models at Machine Translation? A Comprehensive Evaluationcited by 348
- 2022Emergent Analogical Reasoning in Large Language Modelscited by 240
- 2023ChatGPT: Jack of all trades, master of nonecited by 204
- 2023Is ChatGPT A Good Translator? Yes With GPT-4 As The Enginecited by 176
- 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systemscited by 170
- 2024Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviewscited by 164
- 2022Thinking Fast and Slow in Large Language Modelscited by 137
- 2023Copyright Violations and Large Language Modelscited by 108
- 2023A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-4cited by 81
- 2024MT-Eval: A Multi-Turn Capabilities Evaluation Benchmark for Large Language Modelscited by 81
27 more
- 2024A Survey on Large Language Models for Critical Societal Domains: Finance, Healthcare, and Lawcited by 74
- 2023Can ChatGPT Assess Human Personalities? A General Evaluation Frameworkcited by 70
- 2023Emotional Intelligence of Large Language Modelscited by 58
- 2024The opportunities and risks of large language models in mental healthcited by 54
- 2024"We Need Structured Output": Towards User-centered Constraints on Large Language Model Outputcited by 46
- 2023A Comparative Study of AI-Generated (GPT-4) and Human-crafted MCQs in Programming Educationcited by 35
- 2024CopyBench: Measuring Literal and Non-Literal Reproduction of Copyright-Protected Text in Language Model Generationcited by 35
- 2024Artificial Intelligence for Literature Reviews: Opportunities and Challengescited by 30
- 2023Large Language Models Can Infer Psychological Dispositions of Social Media Userscited by 29
- 2023Is ChatGPT a Good Personality Recognizer? A Preliminary Studycited by 26
- 2024Evaluating Large Language Models with Grid-Based Game Competitions: An Extensible LLM Benchmark and Leaderboardcited by 22
- 2024ChatGPT as Research Scientist: Probing GPT's Capabilities as a Research Librarian, Research Ethicist, Data Generator and Data Predictorcited by 21
- 2024GPT-4 vs. Human Translators: A Comprehensive Evaluation of Translation Quality Across Languages, Domains, and Expertise Levelscited by 21
- 2024Exploring the Frontiers of LLMs in Psychological Applications: A Comprehensive Reviewcited by 17
- 2024Shortcomings of LLMs for Low-Resource Translation: Retrieval and Understanding are Both the Problemcited by 17
- 2024Large Language Model for Mental Health: A Systematic Reviewcited by 14
- 2024Assessing Empathy in Large Language Models with Real-World Physician-Patient Interactionscited by 13
- 2024Academically intelligent LLMs are not necessarily socially intelligentcited by 12
- 2024Self-assessment, Exhibition, and Recognition: a Review of Personality in Large Language Modelscited by 11
- 2024Is ChatGPT More Empathetic than Humans?cited by 8
- 2023On pitfalls (and advantages) of sophisticated large language modelscited by 7
- 2023Can ChatGPT Read Who You Are?cited by 5
- 2024Redefining "Hallucination" in LLMs: Towards a psychology-informed framework for mitigating misinformationcited by 5
- 2024Is persona enough for personality? Using ChatGPT to reconstruct an agent's latent personality from simple descriptionscited by 5
- 2024The global landscape of academic guidelines for generative AI and Large Language Modelscited by 4
- 2023Science in the Era of ChatGPT, Large Language Models and Generative AI: Challenges for Research Ethics and How to Respondcited by 2
- 2024The high dimensional psychological profile and cultural bias of ChatGPTcited by 2
Built on by
Citing papers per year: 2025: 1.
1 paper.