Topical-Chat: Towards Knowledge-Grounded Open-Domain Conversations
Not on the map. Why?
Abstract (arXiv)
Building socialbots that can have deep, engaging open-domain conversations with humans is one of the grand challenges of artificial intelligence (AI). To this end, bots need to be able to leverage world knowledge spanning several domains effectively when conversing with humans who have their own world knowledge. Existing knowledge-grounded conversation datasets are primarily stylized with explicit roles for conversation partners. These datasets also do not explore depth or breadth of topical coverage with transitions in conversations. We introduce Topical-Chat, a knowledge-grounded human-human conversation dataset where the underlying knowledge spans 8 broad topics and conversation partners don't have explicitly defined roles, to help further research in open-domain conversational AI. We also train several state-of-the-art encoder-decoder conversational models on Topical-Chat and perform automated and human evaluation for benchmarking.
Key facts. Cited by 88 papers in the map (data through 7 Oct 2026). Builds on 13 of its 21 references that are in the map. First posted on arXiv 23 Aug 2023.
Builds on
13 of 21 references.
References · 13
- 2017Attention Is All You Needcited by 59,932
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
- 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 820
- 2018Wizard of Wikipedia: Knowledge-Powered Conversational agentscited by 530
- 2017Deal or No Deal? End-to-End Learning for Negotiation Dialoguescited by 202
- 2015A Neural Conversational Modelcited by 195
- 2019What makes a good conversation? How controllable attributes affect human judgmentscited by 140
- 2017ParlAI: A Dialog Research Software Platformcited by 139
- 2017A Knowledge-Grounded Neural Conversation Modelcited by 136
- 2018A Dataset for Document Grounded Conversationscited by 104
- 2018Towards Exploiting Background Knowledge for Building Conversation Systemscited by 57
- 2018Advancing the State of the Art in Open Domain Dialog Systems through the Alexa Prizecited by 29
1 more
- 2016Dialog-based Language Learningcited by 21
Built on by
Citing papers per year: 2023: 12; 2024: 40; 2025: 24; 2026: 12.
88 papers.
Sort:
By area:
- 2024LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methodscited by 451
- 2024LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Taskscited by 236
- 2024Is LLM-as-a-Judge Robust? Investigating Universal Adversarial Attacks on Zero-shot LLM Assessmentcited by 117
- 2024CheckEval: A reliable LLM-as-a-Judge framework for evaluating text generation using checklistscited by 87
- 2023EvalLM: Interactive Evaluation of Large Language Model Prompts on User-Defined Criteriacited by 73
- 2025Evaluating LLM-based Agents for Multi-Turn Conversations: A Surveycited by 56
- 2024Designing a Dashboard for Transparency and Control of Conversational AIcited by 43
- 2025Stop Overvaluing Multi-Agent Debate -- We Must Rethink Evaluation and Embrace Model Heterogeneitycited by 43
- 2024Let's Go Real Talk: Spoken Dialogue Model for Face-to-Face Conversationcited by 40
- 2024Leveraging Large Language Models for NLG Evaluation: Advances and Challengescited by 37
- 2024PerLTQA: A Personal Long-Term Memory Dataset for Memory Classification, Retrieval, and Synthesis in Question Answeringcited by 34
- 2024Evaluating the Evaluator: Measuring LLMs' Adherence to Task Evaluation Instructionscited by 34
38 more
- 2024HD-Eval: Aligning Large Language Model Evaluators Through Hierarchical Criteria Decompositioncited by 33
- 2023X-Eval: Generalizable Multi-aspect Text Evaluation via Augmented Instruction Tuning with Auxiliary Evaluation Aspectscited by 28
- 2024A Survey on Recent Advances in Conversational Data Generationcited by 23
- 2023Improving Factual Consistency for Knowledge-Grounded Dialogue Systems via Knowledge Enhancement and Alignmentcited by 19
- 2024Themis: A Reference-free NLG Evaluation Language Model with Flexibility and Interpretabilitycited by 19
- 2023A Closer Look into Automatic Evaluation Using Large Language Modelscited by 17
- 2025Principled Personas: Defining and Measuring the Intended Effects of Persona Prompting on Task Performancecited by 17
- 2025When AIs Judge AIs: The Rise of Agent-as-a-Judge Evaluation for LLMscited by 16
- 2024LLM Roleplay: Simulating Human-Chatbot Interactioncited by 15
- 2024PairEval: Open-domain Dialogue Evaluation with Pairwise Comparisoncited by 11
- 2024SLIDE: A Framework Integrating Small and Large Language Models for Open-Domain Dialogues Evaluationcited by 11
- 2025A Scalable Framework for Evaluating Health Language Modelscited by 11
- 2024On the Benchmarking of LLMs for Open-Domain Dialogue Evaluationcited by 10
- 2024Soda-Eval: Open-Domain Dialogue Evaluation in the age of LLMscited by 10
- 2023textitDial BeInfo for Faithfulness: Improving Factuality of Information-Seeking Dialogue via Behavioural Fine-Tuningcited by 9
- 2024StreamingDialogue: Prolonged Dialogue Learning via Long Context Compression with Minimal Lossescited by 9
- 2023Multi-Stage Pre-training Enhanced by ChatGPT for Multi-Scenario Multi-Domain Dialogue Summarizationcited by 7
- 2024A Survey of Automatic Hallucination Evaluation on Natural Language Generationcited by 7
- 2024Should We Fine-Tune or RAG? Evaluating Different Techniques to Adapt LLMs for Dialoguecited by 7
- 2025Attribution, Citation, and Quotation: A Survey of Evidence-based Text Generation with Large Language Modelscited by 7
- 2024Efficient Data Generation for Source-grounded Information-seeking Dialogs: A Use Case for Meeting Transcriptscited by 6
- 2025RAGVA: Engineering Retrieval Augmented Generation-based Virtual Assistants in Practicecited by 6
- 2025Evaluating Evaluation Metrics -- The Mirage of Hallucination Detectioncited by 6
- 2023Sequence-Level Certainty Reduces Hallucination In Knowledge-Grounded Dialogue Generationcited by 5
- 2024Enhancing Hallucination Detection through Perturbation-Based Synthetic Data Generation in System Responsescited by 5
- 2025HPSS: Heuristic Prompting Strategy Search for LLM Evaluatorscited by 5
- 2026JEV vs. LLMs as Rubric Judges: Cheaper, Faster, and Wrong in the Same Placescited by 5
- 2024Improving Linguistic Diversity of Large Language Models with Possibility Exploration Fine-Tuningcited by 4
- 2025CSEval: Towards Automated, Multi-Dimensional, and Reference-Free Counterspeech Evaluation using Auto-Calibrated LLMscited by 4
- 2025OpeNLGauge: An Explainable Metric for NLG Evaluation with Open-Weights LLMscited by 4
- 2025Dr.Copilot: A Multi-Agent Prompt Optimized Assistant for Improving Patient-Doctor Communication in Romaniancited by 4
- 2026Belief in Authority: Impact of Authority in Multi-Agent Evaluation Frameworkcited by 4
- 2023UniPCM: Universal Pre-trained Conversation Model with Task-aware Automatic Promptcited by 3
- 2023Multi-User MultiWOZ: Task-Oriented Dialogues among Multiple Userscited by 3
- 2024A Cause-Effect Look at Alleviating Hallucination of Knowledge-grounded Dialogue Generationcited by 3
- 2024ComperDial: Commonsense Persona-grounded Dialogue Dataset and Benchmarkcited by 3
- 2024Large Language Models for Automatic Detection of Sensitive Topicscited by 3
- 2024From Pixels to Personas: Investigating and Modeling Self-Anthropomorphism in Human-Robot Dialoguescited by 3
50 most cited of 88 All 88 (JSON)
- 2026JEV vs. LLMs as Rubric Judges: Cheaper, Faster, and Wrong in the Same Places24 Sep 2026
- 2026TalkFa: A Unified Benchmark for Farsi Dialogue Generation and Understanding1 Sep 2026
- 2026Does task decomposition improve automatic NLG evaluation?1 Sep 2026
- 2026Inter-dimension Dependence for Multi-Dimensional Evaluation of Open-Ended Text24 Aug 2026
- 2026Evaluating Language Models in Realistic Conversational Contexts24 Jun 2026
- 2026MAPS: Modeling Co-Existing Subjective Perspectives and Shared Meaning in Multi-Agent Cognitive Dialogue7 May 2026
- 2026When Misinformation Speaks and Converses: Rethinking Fact-Checking in Audio Platforms18 Apr 2026
- 2026RelayS2S: A Dual-Path Speculative Generation for Real-Time Dialogue24 Mar 2026
- 2026PMIScore: An Unsupervised Approach to Quantify Dialogue Engagement14 Mar 2026
- 2026Fine-Refine: Iterative Fine-grained Refinement for Mitigating Dialogue Hallucination17 Feb 2026
- 2026Belief in Authority: Impact of Authority in Multi-Agent Evaluation Framework8 Jan 2026
- 2026Multi-Dimensional Prompt Chaining to Improve Open-Domain Dialogue Generation3 Jan 2026
38 more
- 2025When F1 Fails: Granularity-Aware Evaluation for Dialogue Topic Segmentation18 Dec 2025
- 2025Reasoning in Action: MCTS-Driven Knowledge Retrieval for Large Language Models28 Nov 2025
- 2025Social Simulations with Large Language Model Risk Utopian Illusion24 Oct 2025
- 2025Evaluating LLM-Generated Versus Human-Authored Responses in Role-Play Dialogues22 Sep 2025
- 2025Principled Personas: Defining and Measuring the Intended Effects of Persona Prompting on Task Performance27 Aug 2025
- 2025Attribution, Citation, and Quotation: A Survey of Evidence-based Text Generation with Large Language Models21 Aug 2025
- 2025When AIs Judge AIs: The Rise of Agent-as-a-Judge Evaluation for LLMs5 Aug 2025
- 2025Dr.Copilot: A Multi-Agent Prompt Optimized Assistant for Improving Patient-Doctor Communication in Romanian15 Jul 2025
- 2025ARF-RLHF: Adaptive Reward-Following for RLHF through Emotion-Driven Self-Supervision and Trace-Biased Dynamic Optimization3 Jul 2025
- 2025Commonsense Generation and Evaluation for Dialogue Systems using Large Language Models24 Jun 2025
- 2025DRE: An Effective Dual-Refined Method for Integrating Small and Large Language Models in Open-Domain Dialogue Evaluation4 Jun 2025
- 2025MEDAL: A Framework for Benchmarking LLMs as Multilingual Open-Domain Dialogue Evaluators28 May 2025
- 2025Reverse Engineering Human Preferences with Reinforcement Learning21 May 2025
- 2025Beyond One-Size-Fits-All: Inversion Learning for Highly Effective NLG Evaluation Prompts29 Apr 2025
- 2025Evaluating Evaluation Metrics -- The Mirage of Hallucination Detection25 Apr 2025
- 2025A Scalable Framework for Evaluating Health Language Models30 Mar 2025
- 2025Evaluating LLM-based Agents for Multi-Turn Conversations: A Survey28 Mar 2025
- 2025OpeNLGauge: An Explainable Metric for NLG Evaluation with Open-Weights LLMs14 Mar 2025
- 2025RAGVA: Engineering Retrieval Augmented Generation-based Virtual Assistants in Practice20 Feb 2025
- 2025HPSS: Heuristic Prompting Strategy Search for LLM Evaluators18 Feb 2025
- 2025Stop Overvaluing Multi-Agent Debate -- We Must Rethink Evaluation and Embrace Model Heterogeneity12 Feb 2025
- 2025Grammar Control in Dialogue Response Generation for Language Learning Chatbots11 Feb 2025
- 2025CSEval: Towards Automated, Multi-Dimensional, and Reference-Free Counterspeech Evaluation using Auto-Calibrated LLMs29 Jan 2025
- 2025Measuring the Robustness of Reference-Free Dialogue Evaluation Systems12 Jan 2025
- 2024Empathetic Response in Audio-Visual Conversations Using Emotion Preference Optimization and MambaCompressor23 Dec 2024
- 2024LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods7 Dec 2024
- 2024Improving Linguistic Diversity of Large Language Models with Possibility Exploration Fine-Tuning4 Dec 2024
- 2024Unstructured Text Enhanced Open-domain Dialogue System: A Systematic Survey14 Nov 2024
- 2024Policy-driven Knowledge Selection and Response Generation for Document-grounded Dialogue21 Oct 2024
- 2024Multi-Facet Counterfactual Learning for Content Quality Evaluation10 Oct 2024
- 2024From Pixels to Personas: Investigating and Modeling Self-Anthropomorphism in Human-Robot Dialogues4 Oct 2024
- 2024Pre-trained Language Models Return Distinguishable Probability Distributions to Unfaithfully Hallucinated Texts25 Sep 2024
- 2024Large Language Models for Automatic Detection of Sensitive Topics2 Sep 2024
- 2024Soda-Eval: Open-Domain Dialogue Evaluation in the age of LLMs20 Aug 2024
- 2024Evaluating the Evaluator: Measuring LLMs' Adherence to Task Evaluation Instructions16 Aug 2024
- 2024ReFeR: Improving Evaluation and Reasoning through Hierarchy of Models16 Jul 2024
- 2024Enhancing Hallucination Detection through Perturbation-Based Synthetic Data Generation in System Responses7 Jul 2024
- 2024LLM Roleplay: Simulating Human-Chatbot Interaction4 Jul 2024
50 newest of 88 All 88 (JSON)
- 2025Evaluating LLM-based Agents for Multi-Turn Conversations: A Surveycited by 56
- 2025When AIs Judge AIs: The Rise of Agent-as-a-Judge Evaluation for LLMscited by 16
- 2025Dr.Copilot: A Multi-Agent Prompt Optimized Assistant for Improving Patient-Doctor Communication in Romaniancited by 4
- 2026Belief in Authority: Impact of Authority in Multi-Agent Evaluation Frameworkcited by 4
- 2026Belief in Authority: Impact of Authority in Multi-Agent Evaluation Framework8 Jan 2026
- 2025When AIs Judge AIs: The Rise of Agent-as-a-Judge Evaluation for LLMs5 Aug 2025
- 2025Dr.Copilot: A Multi-Agent Prompt Optimized Assistant for Improving Patient-Doctor Communication in Romanian15 Jul 2025
- 2025Evaluating LLM-based Agents for Multi-Turn Conversations: A Survey28 Mar 2025
- 2024HD-Eval: Aligning Large Language Model Evaluators Through Hierarchical Criteria Decompositioncited by 33
- 2025Reverse Engineering Human Preferences with Reinforcement Learningcited by 3
- 2024Empathetic Response in Audio-Visual Conversations Using Emotion Preference Optimization and MambaCompressorcited by 1
- 2025ARF-RLHF: Adaptive Reward-Following for RLHF through Emotion-Driven Self-Supervision and Trace-Biased Dynamic Optimizationcited by 0
- 2025ARF-RLHF: Adaptive Reward-Following for RLHF through Emotion-Driven Self-Supervision and Trace-Biased Dynamic Optimization3 Jul 2025
- 2025Reverse Engineering Human Preferences with Reinforcement Learning21 May 2025
- 2024Empathetic Response in Audio-Visual Conversations Using Emotion Preference Optimization and MambaCompressor23 Dec 2024
- 2024HD-Eval: Aligning Large Language Model Evaluators Through Hierarchical Criteria Decomposition24 Feb 2024
- 2024LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methodscited by 451
- 2024LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Taskscited by 236
- 2024Is LLM-as-a-Judge Robust? Investigating Universal Adversarial Attacks on Zero-shot LLM Assessmentcited by 117
- 2024CheckEval: A reliable LLM-as-a-Judge framework for evaluating text generation using checklistscited by 87
- 2023EvalLM: Interactive Evaluation of Large Language Model Prompts on User-Defined Criteriacited by 73
- 2024Designing a Dashboard for Transparency and Control of Conversational AIcited by 43
- 2024Let's Go Real Talk: Spoken Dialogue Model for Face-to-Face Conversationcited by 40
- 2024Leveraging Large Language Models for NLG Evaluation: Advances and Challengescited by 37
- 2024PerLTQA: A Personal Long-Term Memory Dataset for Memory Classification, Retrieval, and Synthesis in Question Answeringcited by 34
- 2024Evaluating the Evaluator: Measuring LLMs' Adherence to Task Evaluation Instructionscited by 34
- 2023X-Eval: Generalizable Multi-aspect Text Evaluation via Augmented Instruction Tuning with Auxiliary Evaluation Aspectscited by 28
- 2024A Survey on Recent Advances in Conversational Data Generationcited by 23
12 most cited of 74 All 74 (JSON)
- 2026JEV vs. LLMs as Rubric Judges: Cheaper, Faster, and Wrong in the Same Places24 Sep 2026
- 2026TalkFa: A Unified Benchmark for Farsi Dialogue Generation and Understanding1 Sep 2026
- 2026Does task decomposition improve automatic NLG evaluation?1 Sep 2026
- 2026Inter-dimension Dependence for Multi-Dimensional Evaluation of Open-Ended Text24 Aug 2026
- 2026Evaluating Language Models in Realistic Conversational Contexts24 Jun 2026
- 2026MAPS: Modeling Co-Existing Subjective Perspectives and Shared Meaning in Multi-Agent Cognitive Dialogue7 May 2026
- 2026When Misinformation Speaks and Converses: Rethinking Fact-Checking in Audio Platforms18 Apr 2026
- 2026RelayS2S: A Dual-Path Speculative Generation for Real-Time Dialogue24 Mar 2026
- 2026PMIScore: An Unsupervised Approach to Quantify Dialogue Engagement14 Mar 2026
- 2026Fine-Refine: Iterative Fine-grained Refinement for Mitigating Dialogue Hallucination17 Feb 2026
- 2026Multi-Dimensional Prompt Chaining to Improve Open-Domain Dialogue Generation3 Jan 2026
- 2025When F1 Fails: Granularity-Aware Evaluation for Dialogue Topic Segmentation18 Dec 2025
12 newest of 74 All 74 (JSON)