The Illusion of Empathy: How AI Chatbots Shape Conversation Perception
Not on the map. Why?
Abstract (arXiv)
As AI chatbots increasingly incorporate empathy, understanding user-centered perceptions of chatbot empathy and its impact on conversation quality remains essential yet under-explored. This study examines how chatbot identity and perceived empathy influence users' overall conversation experience. Analyzing 155 conversations from two datasets, we found that while GPT-based chatbots were rated significantly higher in conversational quality, they were consistently perceived as less empathetic than human conversational partners. Empathy ratings from GPT-4o annotations aligned with user ratings, reinforcing the perception of lower empathy in chatbots compared to humans. Our findings underscore the critical role of perceived empathy in shaping conversation quality, revealing that achieving high-quality human-AI interactions requires more than simply embedding empathetic language; it necessitates addressing the nuanced ways users interpret and experience empathy in conversations with chatbots.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 12 of its 50 references that are in the map. First posted on arXiv 19 Nov 2024.
Builds on
12 of 50 references.
References · 12
- 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 651
- 2020MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual Transfercited by 443
- 2020A Computational Approach to Understanding Empathy Expressed in Text-Based Mental Health Supportcited by 182
- 2020MIME: MIMicking Emotions for Empathetic Response Generationcited by 114
- 2020Recognizing Emotion Cause in Conversationscited by 66
- 2023Harnessing the Power of Large Language Models for Empathetic Response Generation: Empirical Investigations and Improvementscited by 42
- 2024Large Language Models Produce Responses Perceived to be Empathiccited by 36
- 2020Effects of Persuasive Dialogues: Testing Bot Identities and Inquiry Strategiescited by 29
- 2022Empathic Conversations: A Multi-level Dataset of Contextualized Conversationscited by 20
- 2024Are Large Language Models More Empathetic than Humans?cited by 18
- 2024Multi-dimensional Evaluation of Empathetic Dialog Responsescited by 10
- 2022Computer says "No": The Case Against Empathetic Conversational AIcited by 9
Built on by
Citing papers per year: 2025: 2; 2026: 10.
12 papers.
- 2025Humanizing Machines: Rethinking LLM Anthropomorphism Through a Multi-Level Framework of Designcited by 11
- 2025SENSE-7: Taxonomy and Dataset for Measuring User Perceptions of Empathy in Sustained Human-AI Conversationscited by 8
- 2026PERM: Psychology-grounded Empathetic Reward Modeling for Large Language Modelscited by 5
- 2026MICA: Multi-granularity Intertemporal Credit Assignment for Long-Horizon Emotional Support Dialoguecited by 2
- 2026Discourse Diversity in Multi-Turn Empathic Dialoguecited by 1
- 2026Dynamic In-Group Persona Generation for Enhancing Human-AI Rapportcited by 1
- 2026RE-LLM: Refining Empathetic Speech-LLM Responses by Integrating Emotion Nuancecited by 0
- 2026EthicMind: A Risk-Aware Framework for Ethical-Emotional Alignment in Multi-Turn Dialoguecited by 0
- 2026Appropriateness of Empathy in AI: A Signal-Cost Perspectivecited by 0
- 2026TA-RAG: Tone-Aware Retrieval-Augmented Generation for Peer-Support Health Communicationcited by 0
- 2026TA-RAG: Tone Awareness as a Design Imperative for Retrieval-Augmented Generationcited by 0
- 2026How to Run Statistics over LLM Judges and Trust the Results: Calibrated Inference for Small-Sample AI Evaluation with evalstatscited by 0
- 2026How to Run Statistics over LLM Judges and Trust the Results: Calibrated Inference for Small-Sample AI Evaluation with evalstats20 Sep 2026
- 2026TA-RAG: Tone Awareness as a Design Imperative for Retrieval-Augmented Generation7 Aug 2026
- 2026TA-RAG: Tone-Aware Retrieval-Augmented Generation for Peer-Support Health Communication5 Jun 2026
- 2026Appropriateness of Empathy in AI: A Signal-Cost Perspective29 May 2026
- 2026Dynamic In-Group Persona Generation for Enhancing Human-AI Rapport5 May 2026
- 2026Discourse Diversity in Multi-Turn Empathic Dialogue13 Apr 2026
- 2026EthicMind: A Risk-Aware Framework for Ethical-Emotional Alignment in Multi-Turn Dialogue10 Apr 2026
- 2026MICA: Multi-granularity Intertemporal Credit Assignment for Long-Horizon Emotional Support Dialogue6 Mar 2026
- 2026RE-LLM: Refining Empathetic Speech-LLM Responses by Integrating Emotion Nuance11 Feb 2026
- 2026PERM: Psychology-grounded Empathetic Reward Modeling for Large Language Models15 Jan 2026
- 2025SENSE-7: Taxonomy and Dataset for Measuring User Perceptions of Empathy in Sustained Human-AI Conversations19 Sep 2025
- 2025Humanizing Machines: Rethinking LLM Anthropomorphism Through a Multi-Level Framework of Design25 Aug 2025