What Makes a Good Conversation? Challenges in Designing Truly Conversational Agents
Not on the map. Why?
Abstract (arXiv)
Conversational agents promise conversational interaction but fail to deliver. Efforts often emulate functional rules from human speech, without considering key characteristics that conversation must encapsulate. Given its potential in supporting long-term human-agent relationships, it is paramount that HCI focuses efforts on delivering this promise. We aim to understand what people value in conversation and how this should manifest in agents. Findings from a series of semi-structured interviews show people make a clear dichotomy between social and functional roles of conversation, emphasising the long-term dynamics of bond and trust along with the importance of context and relationship stage in the types of conversations they have. People fundamentally questioned the need for bond and common ground in agent communication, shifting to more utilitarian definitions of conversational qualities. Drawing on these findings we discuss key challenges for conversational agent design, most notably the need to redefine the design parameters for conversational agent interaction.
Key facts. Cited by 42 papers in the map (data through 14 Oct 2026). First posted on arXiv 19 Jan 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 2; 2023: 4; 2024: 15; 2025: 10; 2026: 9.
42 papers.
Sort:
By area:
- 2021Ask what's missing and what's useful: Improving Clarification Question Generation using Global Knowledgecited by 40
- 2022CounterGeDi: A controllable approach to generate polite, detoxified and emotional counterspeechcited by 29
- 2025MMRC: A Large-Scale Benchmark for Understanding Multimodal Large Language Model in Real-World Conversationcited by 29
- 2025Multi-turn Evaluation of Anthropomorphic Behaviours in Large Language Modelscited by 25
- 2024Learning Agent-based Modeling with LLM Companions: Experiences of Novices and Experts Using ChatGPT & NetLogo Chatcited by 23
- 2023Impact of Guidance and Interaction Strategies for LLM Use on Learner Performance and Perceptioncited by 19
- 2022Mutual Theory of Mind for Human-AI Communicationcited by 15
- 2023History-Aware Hierarchical Transformer for Multi-session Open-domain Dialogue Systemcited by 15
- 2025LLM Agent Meets Agentic AI: Can LLM Agents Simulate Customers to Evaluate Agentic-AI-based Shopping Assistants?cited by 15
- 2025Forgetful but Faithful: A Cognitive Memory Architecture and Benchmark for Privacy-Aware Generative Agentscited by 13
- 2026HEART: A Unified Benchmark for Assessing Humans and LLMs in Emotional Support Dialoguecited by 13
- 2024Characterizing and modeling harms from interactions with design patterns in AI interfacescited by 11
30 more
- 2024Understanding Public Perceptions of AI Conversational Agents: A Cross-Cultural Analysiscited by 7
- 2023Rewriting the Script: Adapting Text Instructions for Voice Interactioncited by 5
- 2024"I Like Sunnie More Than I Expected!": Exploring User Expectation and Perception of an Anthropomorphic LLM-based Conversational Agent for Well-Being Supportcited by 5
- 2024Beyond Discrete Personas: Personality Modeling Through Journal Intensive Conversationscited by 5
- 2025Echoes of Discord: Forecasting Hater Reactions to Counterspeechcited by 5
- 2023I Was Blind but Now I See: Implementing Vision-Enabled Dialogue in Social Robotscited by 4
- 2024Coimagining the Future of Voice Assistants with Cultural Sensitivitycited by 3
- 2024A Cause-Effect Look at Alleviating Hallucination of Knowledge-grounded Dialogue Generationcited by 3
- 2024Expressivity and Speech Synthesiscited by 3
- 2024The Interaction Layer: An Exploration for Co-Designing User-LLM Interactions in Parental Wellbeing Support Systemscited by 3
- 2021LGBTQ-AI? Exploring Expressions of Gender and Sexual Orientation in Chatbotscited by 2
- 2025Design and Evaluation of Generative Agent-based Platform for Human-Assistant Interaction Research: A Tale of 10 User Studiescited by 2
- 2026DialToM: A Theory of Mind Benchmark for Forecasting State-Driven Dialogue Trajectoriescited by 2
- 2024Leveraging Interesting Facts to Enhance User Engagement with Conversational Interfacescited by 1
- 2024Qualitative Approaches to Voice UXcited by 1
- 2024From Human-to-Human to Human-to-Bot Conversations in Software Engineeringcited by 1
- 2024LLM-Mediated Domain-Specific Voice Agents: The Case of TextileBotcited by 1
- 2024Introducing MeMo: A Multimodal Dataset for Memory Modelling in Multiparty Conversationscited by 1
- 2025Designing Smarter Conversational Agents for Kids: Lessons from Cognitive Work and Means-Ends Analysescited by 1
- 2026Polite But Boring? Trade-offs Between Engagement and Psychological Reactance to Chatbot Feedback Stylescited by 1
- 2024Advancing Explainable AI Toward Human-Like Intelligence: Forging the Path to Artificial Braincited by 0
- 2025The Value of Gen-AI Conversations: A bottom-up Framework for AI Value Alignmentcited by 0
- 2025Dialogue Systems Engineering: A Survey and Future Directionscited by 0
- 2025Living the Novel: A System for Generating Self-Training Timeline-Aware Conversational Agents from Novelscited by 0
- 2026From SERPs to Sound: How Search Engine Result Pages and AI-generated Podcasts Interact to Influence User Attitudes on Controversial Topicscited by 0
- 2026After Talking with 1,000 Personas: Learning Preference-Aligned Proactive Assistants From Large-Scale Persona Interactionscited by 0
- 2026A Methodology for Identifying Evaluation Items for Practical Dialogue Systems Based on Business-Dialogue System Alignment Modelscited by 0
- 2026PuppetChat: Fostering Intimate Communication through Bidirectional Actions and Micronarrativescited by 0
- 2026Understanding How International Students in the U.S. Are Using Conversational AI to Support Cross-Cultural Adaptationcited by 0
- 2026SpheriCity: Designing Trustworthy Conversational AI for Sustainability Decision Supportcited by 0
- 2026SpheriCity: Designing Trustworthy Conversational AI for Sustainability Decision Support11 Jun 2026
- 2026Understanding How International Students in the U.S. Are Using Conversational AI to Support Cross-Cultural Adaptation14 May 2026
- 2026DialToM: A Theory of Mind Benchmark for Forecasting State-Driven Dialogue Trajectories22 Apr 2026
- 2026PuppetChat: Fostering Intimate Communication through Bidirectional Actions and Micronarratives23 Feb 2026
- 2026After Talking with 1,000 Personas: Learning Preference-Aligned Proactive Assistants From Large-Scale Persona Interactions3 Feb 2026
- 2026Polite But Boring? Trade-offs Between Engagement and Psychological Reactance to Chatbot Feedback Styles28 Jan 2026
- 2026From SERPs to Sound: How Search Engine Result Pages and AI-generated Podcasts Interact to Influence User Attitudes on Controversial Topics16 Jan 2026
- 2026A Methodology for Identifying Evaluation Items for Practical Dialogue Systems Based on Business-Dialogue System Alignment Models10 Jan 2026
- 2026HEART: A Unified Benchmark for Assessing Humans and LLMs in Emotional Support Dialogue9 Jan 2026
- 2025Forgetful but Faithful: A Cognitive Memory Architecture and Benchmark for Privacy-Aware Generative Agents14 Dec 2025
- 2025Living the Novel: A System for Generating Self-Training Timeline-Aware Conversational Agents from Novels8 Dec 2025
- 2025LLM Agent Meets Agentic AI: Can LLM Agents Simulate Customers to Evaluate Agentic-AI-based Shopping Assistants?25 Sep 2025
30 more
- 2025Designing Smarter Conversational Agents for Kids: Lessons from Cognitive Work and Means-Ends Analyses28 Aug 2025
- 2025Dialogue Systems Engineering: A Survey and Future Directions4 Aug 2025
- 2025The Value of Gen-AI Conversations: A bottom-up Framework for AI Value Alignment26 Jun 2025
- 2025Design and Evaluation of Generative Agent-based Platform for Human-Assistant Interaction Research: A Tale of 10 User Studies15 May 2025
- 2025MMRC: A Large-Scale Benchmark for Understanding Multimodal Large Language Model in Real-World Conversation17 Feb 2025
- 2025Multi-turn Evaluation of Anthropomorphic Behaviours in Large Language Models10 Feb 2025
- 2025Echoes of Discord: Forecasting Hater Reactions to Counterspeech27 Jan 2025
- 2024Beyond Discrete Personas: Personality Modeling Through Journal Intensive Conversations15 Dec 2024
- 2024The Interaction Layer: An Exploration for Co-Designing User-LLM Interactions in Parental Wellbeing Support Systems2 Nov 2024
- 2024Introducing MeMo: A Multimodal Dataset for Memory Modelling in Multiparty Conversations7 Sep 2024
- 2024LLM-Mediated Domain-Specific Voice Agents: The Case of TextileBot15 Jun 2024
- 2024"I Like Sunnie More Than I Expected!": Exploring User Expectation and Perception of an Anthropomorphic LLM-based Conversational Agent for Well-Being Support22 May 2024
- 2024From Human-to-Human to Human-to-Bot Conversations in Software Engineering21 May 2024
- 2024Expressivity and Speech Synthesis30 Apr 2024
- 2024Qualitative Approaches to Voice UX23 Apr 2024
- 2024Characterizing and modeling harms from interactions with design patterns in AI interfaces17 Apr 2024
- 2024Leveraging Interesting Facts to Enhance User Engagement with Conversational Interfaces9 Apr 2024
- 2024A Cause-Effect Look at Alleviating Hallucination of Knowledge-grounded Dialogue Generation4 Apr 2024
- 2024Coimagining the Future of Voice Assistants with Cultural Sensitivity26 Mar 2024
- 2024Understanding Public Perceptions of AI Conversational Agents: A Cross-Cultural Analysis25 Feb 2024
- 2024Advancing Explainable AI Toward Human-Like Intelligence: Forging the Path to Artificial Brain7 Feb 2024
- 2024Learning Agent-based Modeling with LLM Companions: Experiences of Novices and Experts Using ChatGPT & NetLogo Chat30 Jan 2024
- 2023I Was Blind but Now I See: Implementing Vision-Enabled Dialogue in Social Robots15 Nov 2023
- 2023Impact of Guidance and Interaction Strategies for LLM Use on Learner Performance and Perception13 Oct 2023
- 2023Rewriting the Script: Adapting Text Instructions for Voice Interaction16 Jun 2023
- 2023History-Aware Hierarchical Transformer for Multi-session Open-domain Dialogue System2 Feb 2023
- 2022Mutual Theory of Mind for Human-AI Communication7 Oct 2022
- 2022CounterGeDi: A controllable approach to generate polite, detoxified and emotional counterspeech9 May 2022
- 2021LGBTQ-AI? Exploring Expressions of Gender and Sexual Orientation in Chatbots3 Jun 2021
- 2021Ask what's missing and what's useful: Improving Clarification Question Generation using Global Knowledge14 Apr 2021
- 2024Learning Agent-based Modeling with LLM Companions: Experiences of Novices and Experts Using ChatGPT & NetLogo Chatcited by 23
- 2025LLM Agent Meets Agentic AI: Can LLM Agents Simulate Customers to Evaluate Agentic-AI-based Shopping Assistants?cited by 15
- 2025Forgetful but Faithful: A Cognitive Memory Architecture and Benchmark for Privacy-Aware Generative Agentscited by 13
- 2025Design and Evaluation of Generative Agent-based Platform for Human-Assistant Interaction Research: A Tale of 10 User Studiescited by 2
- 2024LLM-Mediated Domain-Specific Voice Agents: The Case of TextileBotcited by 1
- 2025Designing Smarter Conversational Agents for Kids: Lessons from Cognitive Work and Means-Ends Analysescited by 1
- 2025Living the Novel: A System for Generating Self-Training Timeline-Aware Conversational Agents from Novelscited by 0
- 2025Forgetful but Faithful: A Cognitive Memory Architecture and Benchmark for Privacy-Aware Generative Agents14 Dec 2025
- 2025Living the Novel: A System for Generating Self-Training Timeline-Aware Conversational Agents from Novels8 Dec 2025
- 2025LLM Agent Meets Agentic AI: Can LLM Agents Simulate Customers to Evaluate Agentic-AI-based Shopping Assistants?25 Sep 2025
- 2025Designing Smarter Conversational Agents for Kids: Lessons from Cognitive Work and Means-Ends Analyses28 Aug 2025
- 2025Design and Evaluation of Generative Agent-based Platform for Human-Assistant Interaction Research: A Tale of 10 User Studies15 May 2025
- 2024LLM-Mediated Domain-Specific Voice Agents: The Case of TextileBot15 Jun 2024
- 2024Learning Agent-based Modeling with LLM Companions: Experiences of Novices and Experts Using ChatGPT & NetLogo Chat30 Jan 2024
- 2021Ask what's missing and what's useful: Improving Clarification Question Generation using Global Knowledgecited by 40
- 2022CounterGeDi: A controllable approach to generate polite, detoxified and emotional counterspeechcited by 29
- 2025Multi-turn Evaluation of Anthropomorphic Behaviours in Large Language Modelscited by 25
- 2023Impact of Guidance and Interaction Strategies for LLM Use on Learner Performance and Perceptioncited by 19
- 2022Mutual Theory of Mind for Human-AI Communicationcited by 15
- 2023History-Aware Hierarchical Transformer for Multi-session Open-domain Dialogue Systemcited by 15
- 2026HEART: A Unified Benchmark for Assessing Humans and LLMs in Emotional Support Dialoguecited by 13
- 2024Characterizing and modeling harms from interactions with design patterns in AI interfacescited by 11
- 2024Understanding Public Perceptions of AI Conversational Agents: A Cross-Cultural Analysiscited by 7
- 2023Rewriting the Script: Adapting Text Instructions for Voice Interactioncited by 5
- 2024"I Like Sunnie More Than I Expected!": Exploring User Expectation and Perception of an Anthropomorphic LLM-based Conversational Agent for Well-Being Supportcited by 5
- 2024Beyond Discrete Personas: Personality Modeling Through Journal Intensive Conversationscited by 5
12 most cited of 32 All 32 (JSON)
- 2026SpheriCity: Designing Trustworthy Conversational AI for Sustainability Decision Support11 Jun 2026
- 2026Understanding How International Students in the U.S. Are Using Conversational AI to Support Cross-Cultural Adaptation14 May 2026
- 2026DialToM: A Theory of Mind Benchmark for Forecasting State-Driven Dialogue Trajectories22 Apr 2026
- 2026PuppetChat: Fostering Intimate Communication through Bidirectional Actions and Micronarratives23 Feb 2026
- 2026Polite But Boring? Trade-offs Between Engagement and Psychological Reactance to Chatbot Feedback Styles28 Jan 2026
- 2026From SERPs to Sound: How Search Engine Result Pages and AI-generated Podcasts Interact to Influence User Attitudes on Controversial Topics16 Jan 2026
- 2026A Methodology for Identifying Evaluation Items for Practical Dialogue Systems Based on Business-Dialogue System Alignment Models10 Jan 2026
- 2026HEART: A Unified Benchmark for Assessing Humans and LLMs in Emotional Support Dialogue9 Jan 2026
- 2025Dialogue Systems Engineering: A Survey and Future Directions4 Aug 2025
- 2025Multi-turn Evaluation of Anthropomorphic Behaviours in Large Language Models10 Feb 2025
- 2025Echoes of Discord: Forecasting Hater Reactions to Counterspeech27 Jan 2025
- 2024Beyond Discrete Personas: Personality Modeling Through Journal Intensive Conversations15 Dec 2024
12 newest of 32 All 32 (JSON)