The Ubuntu Dialogue Corpus: A Large Dataset for Research in Unstructured Multi-Turn Dialogue Systems
Not on the map. Why?
Abstract (arXiv)
This paper introduces the Ubuntu Dialogue Corpus, a dataset containing almost 1 million multi-turn dialogues, with a total of over 7 million utterances and 100 million words. This provides a unique resource for research into building dialogue managers based on neural language models that can make use of large amounts of unlabeled data. The dataset has both the multi-turn property of conversations in the Dialog State Tracking Challenge datasets, and the unstructured nature of interactions from microblog services such as Twitter. We also describe two neural learning architectures suitable for analyzing this dataset, and provide benchmark performance on the task of selecting the best next response.
Key facts. Cited by 172 papers in the map (data through 14 Oct 2026). First posted on arXiv 30 Jun 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 60; 2022: 43; 2023: 34; 2024: 16; 2025: 15; 2026: 4.
172 papers.
Sort:
By area:
- 2023Is ChatGPT a General-Purpose Natural Language Processing Task Solver?cited by 488
- 2023LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Datasetcited by 461
- 2021A Survey on Deep Semi-supervised Learningcited by 251
- 2021The GEM Benchmark: Natural Language Generation, its Evaluation and Metricscited by 239
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
- 2021MediaSum: A Large-scale Media Interview Dataset for Dialogue Summarizationcited by 104
- 2024Model Editing Harms General Abilities of Large Language Models: Regularization to the Rescuecited by 103
- 2021QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehensioncited by 91
- 2021A Comprehensive Assessment of Dialog Evaluation Metricscited by 90
- 2024LLM-Rubric: A Multidimensional, Calibrated Approach to Automated Evaluation of Natural Language Textscited by 87
- 2023PLACES: Prompting Language Models for Social Conversation Synthesiscited by 72
- 2023Multi-Party Chat: Conversational Agents in Group Settings with Humans and Modelscited by 54
38 more
- 2021Domain-matched Pre-training Tasks for Dense Retrievalcited by 53
- 2024The Oscars of AI Theater: A Survey on Role-Playing with Language Modelscited by 48
- 2022Datasheet for the Pilecited by 43
- 2024Let's Go Real Talk: Spoken Dialogue Model for Face-to-Face Conversationcited by 41
- 2021Ask what's missing and what's useful: Improving Clarification Question Generation using Global Knowledgecited by 40
- 2023ChatGPT Evaluation on Sentence Level Relations: A Focus on Temporal, Causal, and Discourse Relationscited by 40
- 2021MPC-BERT: A Pre-Trained Language Model for Multi-Party Conversation Understandingcited by 36
- 2021Call for Customized Conversation: Customized Conversation Grounding Persona and Knowledgecited by 30
- 2022DialogueNeRF: Towards Realistic Avatar Face-to-Face Conversation Video Generationcited by 30
- 2021ConditionalQA: A Complex Reading Comprehension Dataset with Conditional Answerscited by 29
- 2022Rethinking and Refining the Distinct Metriccited by 27
- 2022Varifocal Question Generation for Fact-checkingcited by 27
- 2023LiveChat: A Large-Scale Personalized Dialogue Dataset Automatically Constructed from Live Streamingcited by 27
- 2022CPED: A Large-Scale Chinese Personalized and Emotional Dialogue Dataset for Conversational AIcited by 26
- 2022DEAM: Dialogue Coherence Evaluation using AMR-based Semantic Manipulationscited by 25
- 2023Uncovering the Potential of ChatGPT for Discourse Analysis in Dialogue: An Empirical Studycited by 24
- 2021Structural Pre-training for Dialogue Comprehensioncited by 20
- 2021Investigating Robustness of Dialog Models to Popular Figurative Language Constructscited by 19
- 2023Robust Prompt Optimization for Large Language Models Against Distribution Shiftscited by 19
- 2021QAConv: Question Answering on Informative Conversationscited by 17
- 2021DADgraph: A Discourse-aware Dialogue Graph Neural Network for Multiparty Dialogue Machine Reading Comprehensioncited by 16
- 2021OpenViDial 2.0: A Larger-Scale, Open-Domain Dialogue Generation Dataset with Visual Contextscited by 16
- 2022HeterMPC: A Heterogeneous Graph Neural Network for Response Generation in Multi-Party Conversationscited by 16
- 2021Partner Matters! An Empirical Study on Fusing Personas for Personalized Response Selection in Retrieval-Based Chatbotscited by 15
- 2021Learning to Select Context in a Hierarchical and Global Perspective for Open-domain Dialogue Generationcited by 14
- 2021Dialogue History Matters! Personalized Response Selectionin Multi-turn Retrieval-based Chatbotscited by 14
- 2021Self- and Pseudo-self-supervised Prediction of Speaker and Key-utterance for Multi-party Dialogue Reading Comprehensioncited by 13
- 2021Enhanced Speaker-aware Multi-party Multi-turn Dialogue Comprehensioncited by 13
- 2021A Survey of Natural Language Generationcited by 13
- 2021Advances in Multi-turn Dialogue Comprehension: A Surveycited by 12
- 2021ParaQA: A Question Answering Dataset with Paraphrase Responses for Single-Turn Conversationcited by 12
- 2021Learning Implicit User Profiles for Personalized Retrieval-Based Chatbotcited by 12
- 2023Long-Horizon Dialogue Understanding for Role Identification in the Game of Avalon with Large Language Modelscited by 12
- 2021Exploring Dense Retrieval for Dialogue Response Selectioncited by 11
- 2022Unsupervised Slot Schema Induction for Task-oriented Dialogcited by 11
- 2024Data, Data Everywhere: A Guide for Pretraining Dataset Constructioncited by 11
- 2021Content Selection Network for Document-grounded Retrieval-based Chatbotscited by 10
- 2021Multi-turn Dialogue Reading Comprehension with Pivot Turns and Knowledgecited by 10
50 most cited of 172 All 172 (JSON)
- 2026ProEvent: An Event-centric Benchmark for Proactive Agents20 Jul 2026
- 2026Evaluating Language Models in Realistic Conversational Contexts24 Jun 2026
- 2026Accommodation Goes Both Ways: Studying Linguistic Convergence Between Humans and Language Models28 May 2026
- 2026When Misinformation Speaks and Converses: Rethinking Fact-Checking in Audio Platforms18 Apr 2026
- 2025Adaptive Multi-Agent Response Refinement in Conversational Systems11 Nov 2025
- 2025Learning to Detect Relevant Contexts and Knowledge for Response Selection in Retrieval-based Dialogue Systems26 Sep 2025
- 2025Dialogue Systems Engineering: A Survey and Future Directions4 Aug 2025
- 2025Chat-Ghosting: A Comparative Study of Methods for Auto-Completion in Dialog Systems8 Jul 2025
- 2025On the Effectiveness of Integration Methods for Multimodal Dialogue Response Retrieval13 Jun 2025
- 2025Multi-Party Conversational Agents: A Survey24 May 2025
- 2025Enhancing Dialogue Systems with Discourse-Level Understanding Using Deep Canonical Correlation Analysis12 Apr 2025
- 2025A Multi-view Discourse Framework for Integrating Semantic and Syntactic Features in Dialog Agents12 Apr 2025
38 more
- 2025Understanding Common Ground Misalignment in Goal-Oriented Dialog: A Case-Study with Ubuntu Chat Logs16 Mar 2025
- 2025OpeNLGauge: An Explainable Metric for NLG Evaluation with Open-Weights LLMs14 Mar 2025
- 2025A Diverse and Effective Retrieval-Based Debt Collection System with Expert Knowledge3 Mar 2025
- 2025SS-MPC: A Sequence-Structured Multi-Party Conversation System24 Feb 2025
- 2025DELMAN: Dynamic Defense Against Large Language Model Jailbreaking with Model Editing17 Feb 2025
- 2025Advancing Multi-Party Dialogue Framework with Speaker-ware Contrastive Learning20 Jan 2025
- 2025Can MLLMs Generalize to Multi-Party dialog? Exploring Multilingual Response Generation in Complex Scenarios20 Jan 2025
- 2024LLM-Rubric: A Multidimensional, Calibrated Approach to Automated Evaluation of Natural Language Texts31 Dec 2024
- 2024Friends-MMC: A Dataset for Multi-modal Multi-party Conversation Understanding23 Dec 2024
- 2024Unstructured Text Enhanced Open-domain Dialogue System: A Systematic Survey14 Nov 2024
- 2024A Static and Dynamic Attention Framework for Multi Turn Dialogue Generation28 Oct 2024
- 2024Building Dialogue Understanding Models for Low-resource Language Indonesian from Scratch24 Oct 2024
- 2024Fostering Natural Conversation in Large Language Models with NICO: a Natural Interactive COnversation dataset18 Aug 2024
- 2024The Oscars of AI Theater: A Survey on Role-Playing with Language Models16 Jul 2024
- 2024Data, Data Everywhere: A Guide for Pretraining Dataset Construction8 Jul 2024
- 2024Llamipa: An Incremental Discourse Parser26 Jun 2024
- 2024Let's Go Real Talk: Spoken Dialogue Model for Face-to-Face Conversation12 Jun 2024
- 2024MEMoE: Enhancing Model Editing with Mixture of Experts Adaptors29 May 2024
- 2024Selecting Query-bag as Pseudo Relevance Feedback for Information-seeking Conversations22 Mar 2024
- 2024Integration of cognitive tasks into artificial general intelligence test for large models4 Feb 2024
- 2024Making a Long Story Short in Conversation Modeling31 Jan 2024
- 2024PersonalityChat: Conversation Distillation for Personalized Dialog Modeling with Facts and Traits14 Jan 2024
- 2024Model Editing Harms General Abilities of Large Language Models: Regularization to the Rescue9 Jan 2024
- 2023OmniDialog: An Omnipotent Pre-training Model for Task-Oriented Dialogue System28 Dec 2023
- 2023Dialogue Quality and Emotion Annotations for Customer Support Conversations23 Nov 2023
- 2023Dialogizer: Context-aware Conversational-QA Dataset Generation from Textual Sources9 Nov 2023
- 2023Long-Horizon Dialogue Understanding for Role Identification in the Game of Avalon with Large Language Models9 Nov 2023
- 2023P5: Plug-and-Play Persona Prompting for Personalized Response Selection10 Oct 2023
- 2023LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset21 Sep 2023
- 2023SYNDICOM: Improving Conversational Commonsense with Error-Injection and Natural Language Feedback18 Sep 2023
- 2023Multi-turn Dialogue Comprehension from a Topic-aware Perspective18 Sep 2023
- 2023Dialogue Agents 101: A Beginner's Guide to Critical Ingredients for Designing Effective Conversational Systems14 Jul 2023
- 2023Intent-calibrated Self-training for Answer Selection in Open-domain Dialogues13 Jul 2023
- 2023LiveChat: A Large-Scale Personalized Dialogue Dataset Automatically Constructed from Live Streaming14 Jun 2023
- 2023Dial-MAE: ConTextual Masked Auto-Encoder for Retrieval-based Dialogue Systems7 Jun 2023
- 2023A Conditional Generative Chatbot using Transformer Model3 Jun 2023
- 2023BIG-C: a Multimodal Multi-Purpose Dataset for Bemba26 May 2023
- 2023Pre-training Multi-party Dialogue Models with Latent Discourse Inference24 May 2023
50 newest of 172 All 172 (JSON)
- 2023Multi-Party Chat: Conversational Agents in Group Settings with Humans and Modelscited by 54
- 2023You Truly Understand What I Need: Intellectual and Friendly Dialogue Agents grounding Knowledge and Personacited by 8
- 2025Multi-Party Conversational Agents: A Surveycited by 7
- 2025Adaptive Multi-Agent Response Refinement in Conversational Systemscited by 2
- 2026ProEvent: An Event-centric Benchmark for Proactive Agentscited by 2
- 2023Dialogue Agents 101: A Beginner's Guide to Critical Ingredients for Designing Effective Conversational Systemscited by 1
- 2026ProEvent: An Event-centric Benchmark for Proactive Agents20 Jul 2026
- 2025Adaptive Multi-Agent Response Refinement in Conversational Systems11 Nov 2025
- 2025Multi-Party Conversational Agents: A Survey24 May 2025
- 2023Dialogue Agents 101: A Beginner's Guide to Critical Ingredients for Designing Effective Conversational Systems14 Jul 2023
- 2023Multi-Party Chat: Conversational Agents in Group Settings with Humans and Models26 Apr 2023
- 2023You Truly Understand What I Need: Intellectual and Friendly Dialogue Agents grounding Knowledge and Persona6 Jan 2023
- 2023Commonsense Reasoning for Conversational AI: A Survey of the State of the Artcited by 7
- 2023SYNDICOM: Improving Conversational Commonsense with Error-Injection and Natural Language Feedbackcited by 6
- 2022Discourse-Aware Graph Networks for Textual Logical Reasoningcited by 2
- 2022IRRGN: An Implicit Relational Reasoning Graph Network for Multi-turn Response Selectioncited by 2
- 2023SYNDICOM: Improving Conversational Commonsense with Error-Injection and Natural Language Feedback18 Sep 2023
- 2023Commonsense Reasoning for Conversational AI: A Survey of the State of the Art15 Feb 2023
- 2022IRRGN: An Implicit Relational Reasoning Graph Network for Multi-turn Response Selection1 Dec 2022
- 2022Discourse-Aware Graph Networks for Textual Logical Reasoning4 Jul 2022
- 2023Is ChatGPT a General-Purpose Natural Language Processing Task Solver?cited by 488
- 2023LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Datasetcited by 461
- 2021A Survey on Deep Semi-supervised Learningcited by 251
- 2021The GEM Benchmark: Natural Language Generation, its Evaluation and Metricscited by 239
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
- 2021MediaSum: A Large-scale Media Interview Dataset for Dialogue Summarizationcited by 104
- 2024Model Editing Harms General Abilities of Large Language Models: Regularization to the Rescuecited by 103
- 2021QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehensioncited by 91
- 2021A Comprehensive Assessment of Dialog Evaluation Metricscited by 90
- 2024LLM-Rubric: A Multidimensional, Calibrated Approach to Automated Evaluation of Natural Language Textscited by 87
- 2023PLACES: Prompting Language Models for Social Conversation Synthesiscited by 72
- 2021Domain-matched Pre-training Tasks for Dense Retrievalcited by 53
12 most cited of 160 All 160 (JSON)
- 2026Evaluating Language Models in Realistic Conversational Contexts24 Jun 2026
- 2026Accommodation Goes Both Ways: Studying Linguistic Convergence Between Humans and Language Models28 May 2026
- 2026When Misinformation Speaks and Converses: Rethinking Fact-Checking in Audio Platforms18 Apr 2026
- 2025Learning to Detect Relevant Contexts and Knowledge for Response Selection in Retrieval-based Dialogue Systems26 Sep 2025
- 2025Dialogue Systems Engineering: A Survey and Future Directions4 Aug 2025
- 2025Chat-Ghosting: A Comparative Study of Methods for Auto-Completion in Dialog Systems8 Jul 2025
- 2025On the Effectiveness of Integration Methods for Multimodal Dialogue Response Retrieval13 Jun 2025
- 2025Enhancing Dialogue Systems with Discourse-Level Understanding Using Deep Canonical Correlation Analysis12 Apr 2025
- 2025A Multi-view Discourse Framework for Integrating Semantic and Syntactic Features in Dialog Agents12 Apr 2025
- 2025Understanding Common Ground Misalignment in Goal-Oriented Dialog: A Case-Study with Ubuntu Chat Logs16 Mar 2025
- 2025OpeNLGauge: An Explainable Metric for NLG Evaluation with Open-Weights LLMs14 Mar 2025
- 2025A Diverse and Effective Retrieval-Based Debt Collection System with Expert Knowledge3 Mar 2025
12 newest of 160 All 160 (JSON)