A Repository of Conversational Datasets
Not on the map. Why?
Abstract (arXiv)
Progress in Machine Learning is often driven by the availability of large datasets, and consistent evaluation metrics for comparing modeling approaches. To this end, we present a repository of conversational datasets consisting of hundreds of millions of examples, and a standardised evaluation procedure for conversational response selection models using '1-of-100 accuracy'. The repository contains scripts that allow researchers to reproduce the standard datasets, or to adapt the pre-processing and data filtering steps to their needs. We introduce and evaluate several competitive baselines for conversational response selection, whose implementations are shared in the repository, as well as a neural encoder model that is trained on the entire training set.
Key facts. Cited by 45 papers in the map (data through 14 Oct 2026). First posted on arXiv 13 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 11; 2022: 14; 2023: 11; 2024: 3; 2025: 3; 2026: 2.
45 papers.
Sort:
By area:
- 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledgecited by 478
- 2023Survey of Vulnerabilities in Large Language Models Revealed by Adversarial Attackscited by 194
- 2021RedCaps: web-curated image-text data created by the people, for the peoplecited by 180
- 2020Dialogue Response Ranking Training with Large-Scale Human Feedback Datacited by 68
- 2021ConvFiT: Conversational Fine-Tuning of Pretrained Language Modelscited by 25
- 2021DS-TOD: Efficient Domain Specialization for Task Oriented Dialogcited by 21
- 2021AUGNLG: Few-shot Natural Language Generation using Self-trained Data Augmentationcited by 17
- 2021Identifying Untrustworthy Samples: Data Filtering for Open-domain Dialogues with Bayesian Optimizationcited by 15
- 2022A Survey of Intent Classification and Slot-Filling Datasets for Task-Oriented Dialogcited by 14
- 2022CGoDial: A Large-Scale Benchmark for Chinese Goal-oriented Dialog Evaluationcited by 9
- 2023Large Language Models Vote: Prompting for Rare Disease Identificationcited by 9
- 2022NLU++: A Multi-Label, Slot-Rich, Generalisable Dataset for Natural Language Understanding in Task-Oriented Dialoguecited by 8
33 more
- 2022AARGH! End-to-end Retrieval-Generation for Task-Oriented Dialogcited by 8
- 2026MultiBreak: A Scalable and Diverse Multi-turn Jailbreak Benchmark for Evaluating LLM Safetycited by 8
- 2022Combing for Credentials: Active Pattern Extraction from Smart Replycited by 7
- 2023Description-Based Text Similaritycited by 7
- 2023Multi-Stage Pre-training Enhanced by ChatGPT for Multi-Scenario Multi-Domain Dialogue Summarizationcited by 7
- 2023Learning From Free-Text Human Feedback -- Collect New Datasets Or Extend Existing Ones?cited by 7
- 2023PIPPA: A Partially Synthetic Conversational Datasetcited by 6
- 2023Revealing the Blind Spot of Sentence Encoder Evaluation by HEROScited by 5
- 2021Representation Learning for Conversational Data using Discourse Mutual Information Maximizationcited by 4
- 2022Post-Training Dialogue Summarization using Pseudo-Paraphrasingcited by 4
- 2023A Massive Scale Semantic Similarity Dataset of Historical Englishcited by 4
- 2025Decoding Human Preferences in Alignment: An Improved Approach to Inverse Constitutional AIcited by 4
- 2022Semantic-based Pre-training for Dialogue Understandingcited by 3
- 2024Linguistic-Based Mild Cognitive Impairment Detection Using Informative Losscited by 3
- 2025Citegeist: Automated Generation of Related Work Analysis on the arXiv Corpuscited by 3
- 2025On the Robustness of Verbal Confidence of LLMs in Adversarial Attackscited by 3
- 2022Mixed-effects transformers for hierarchical adaptationcited by 2
- 2021Emotion Eliciting Machine: Emotion Eliciting Conversation Generation based on Dual Generatorcited by 1
- 2021Context Matters in Semantically Controlled Language Generation for Task-oriented Dialogue Systemscited by 1
- 2023RSVP: Customer Intent Detection via Agent Response Contrastive and Generative Pre-Trainingcited by 1
- 2024Contrastive Learning and Mixture of Experts Enables Precise Vector Embeddingscited by 1
- 2024Real World Conversational Entity Linking Requires More Than Zeroshotscited by 1
- 2021SINGA-Easy: An Easy-to-Use Framework for MultiModal Analysiscited by 0
- 2021VisualTextRank: Unsupervised Graph-based Content Extraction for Automating Ad Text to Image Searchcited by 0
- 2021Text is NOT Enough: Integrating Visual Impressions into Open-domain Dialogue Generationcited by 0
- 2022Discovering Personalized Semantics for Soft Attributes in Recommender Systems using Concept Activation Vectorscited by 0
- 2022Reinforced MOOCs Concept Recommendation in Heterogeneous Information Networkscited by 0
- 2022Cross-stitched Multi-modal Encoderscited by 0
- 2022Explanation-Guided Fairness Testing through Genetic Algorithmcited by 0
- 2022Using Graph Neural Networks for Program Terminationcited by 0
- 2023Tribe or Not? Critical Inspection of Group Differences Using TribalGramcited by 0
- 2023Multi-View Zero-Shot Open Intent Induction from Dialogues: Multi Domain Batch and Proxy Gradient Transfercited by 0
- 2026DeliChess: A Multi-party Dialogue Dataset for Deliberation in Chess Puzzle Solvingcited by 0
- 2026DeliChess: A Multi-party Dialogue Dataset for Deliberation in Chess Puzzle Solving3 Jun 2026
- 2026MultiBreak: A Scalable and Diverse Multi-turn Jailbreak Benchmark for Evaluating LLM Safety3 May 2026
- 2025On the Robustness of Verbal Confidence of LLMs in Adversarial Attacks9 Jul 2025
- 2025Citegeist: Automated Generation of Related Work Analysis on the arXiv Corpus29 Mar 2025
- 2025Decoding Human Preferences in Alignment: An Improved Approach to Inverse Constitutional AI28 Jan 2025
- 2024Real World Conversational Entity Linking Requires More Than Zeroshots2 Sep 2024
- 2024Contrastive Learning and Mixture of Experts Enables Precise Vector Embeddings28 Jan 2024
- 2024Linguistic-Based Mild Cognitive Impairment Detection Using Informative Loss23 Jan 2024
- 2023Learning From Free-Text Human Feedback -- Collect New Datasets Or Extend Existing Ones?24 Oct 2023
- 2023Survey of Vulnerabilities in Large Language Models Revealed by Adversarial Attacks16 Oct 2023
- 2023Multi-Stage Pre-training Enhanced by ChatGPT for Multi-Scenario Multi-Domain Dialogue Summarization16 Oct 2023
- 2023RSVP: Customer Intent Detection via Agent Response Contrastive and Generative Pre-Training15 Oct 2023
33 more
- 2023Large Language Models Vote: Prompting for Rare Disease Identification24 Aug 2023
- 2023PIPPA: A Partially Synthetic Conversational Dataset11 Aug 2023
- 2023A Massive Scale Semantic Similarity Dataset of Historical English30 Jun 2023
- 2023Revealing the Blind Spot of Sentence Encoder Evaluation by HEROS8 Jun 2023
- 2023Description-Based Text Similarity21 May 2023
- 2023Multi-View Zero-Shot Open Intent Induction from Dialogues: Multi Domain Batch and Proxy Gradient Transfer23 Mar 2023
- 2023Tribe or Not? Critical Inspection of Group Differences Using TribalGram16 Mar 2023
- 2022CGoDial: A Large-Scale Benchmark for Chinese Goal-oriented Dialog Evaluation21 Nov 2022
- 2022Semantic-based Pre-training for Dialogue Understanding19 Sep 2022
- 2022AARGH! End-to-end Retrieval-Generation for Task-Oriented Dialog8 Sep 2022
- 2022Using Graph Neural Networks for Program Termination28 Jul 2022
- 2022A Survey of Intent Classification and Slot-Filling Datasets for Task-Oriented Dialog26 Jul 2022
- 2022Combing for Credentials: Active Pattern Extraction from Smart Reply14 Jul 2022
- 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge17 Jun 2022
- 2022Explanation-Guided Fairness Testing through Genetic Algorithm16 May 2022
- 2022Mixed-effects transformers for hierarchical adaptation3 May 2022
- 2022Post-Training Dialogue Summarization using Pseudo-Paraphrasing28 Apr 2022
- 2022NLU++: A Multi-Label, Slot-Rich, Generalisable Dataset for Natural Language Understanding in Task-Oriented Dialogue27 Apr 2022
- 2022Cross-stitched Multi-modal Encoders20 Apr 2022
- 2022Reinforced MOOCs Concept Recommendation in Heterogeneous Information Networks8 Mar 2022
- 2022Discovering Personalized Semantics for Soft Attributes in Recommender Systems using Concept Activation Vectors6 Feb 2022
- 2021Representation Learning for Conversational Data using Discourse Mutual Information Maximization4 Dec 2021
- 2021Context Matters in Semantically Controlled Language Generation for Task-oriented Dialogue Systems28 Nov 2021
- 2021RedCaps: web-curated image-text data created by the people, for the people22 Nov 2021
- 2021DS-TOD: Efficient Domain Specialization for Task Oriented Dialog15 Oct 2021
- 2021ConvFiT: Conversational Fine-Tuning of Pretrained Language Models21 Sep 2021
- 2021Identifying Untrustworthy Samples: Data Filtering for Open-domain Dialogues with Bayesian Optimization14 Sep 2021
- 2021Text is NOT Enough: Integrating Visual Impressions into Open-domain Dialogue Generation13 Sep 2021
- 2021VisualTextRank: Unsupervised Graph-based Content Extraction for Automating Ad Text to Image Search5 Aug 2021
- 2021SINGA-Easy: An Easy-to-Use Framework for MultiModal Analysis3 Aug 2021
- 2021AUGNLG: Few-shot Natural Language Generation using Self-trained Data Augmentation10 Jun 2021
- 2021Emotion Eliciting Machine: Emotion Eliciting Conversation Generation based on Dual Generator18 May 2021
- 2020Dialogue Response Ranking Training with Large-Scale Human Feedback Data15 Sep 2020
- 2021RedCaps: web-curated image-text data created by the people, for the peoplecited by 180
- 2021ConvFiT: Conversational Fine-Tuning of Pretrained Language Modelscited by 25
- 2021DS-TOD: Efficient Domain Specialization for Task Oriented Dialogcited by 21
- 2021AUGNLG: Few-shot Natural Language Generation using Self-trained Data Augmentationcited by 17
- 2021Identifying Untrustworthy Samples: Data Filtering for Open-domain Dialogues with Bayesian Optimizationcited by 15
- 2022A Survey of Intent Classification and Slot-Filling Datasets for Task-Oriented Dialogcited by 14
- 2022CGoDial: A Large-Scale Benchmark for Chinese Goal-oriented Dialog Evaluationcited by 9
- 2023Large Language Models Vote: Prompting for Rare Disease Identificationcited by 9
- 2022NLU++: A Multi-Label, Slot-Rich, Generalisable Dataset for Natural Language Understanding in Task-Oriented Dialoguecited by 8
- 2022AARGH! End-to-end Retrieval-Generation for Task-Oriented Dialogcited by 8
- 2022Combing for Credentials: Active Pattern Extraction from Smart Replycited by 7
- 2023Description-Based Text Similaritycited by 7
12 most cited of 37 All 37 (JSON)
- 2026DeliChess: A Multi-party Dialogue Dataset for Deliberation in Chess Puzzle Solving3 Jun 2026
- 2025On the Robustness of Verbal Confidence of LLMs in Adversarial Attacks9 Jul 2025
- 2025Citegeist: Automated Generation of Related Work Analysis on the arXiv Corpus29 Mar 2025
- 2024Real World Conversational Entity Linking Requires More Than Zeroshots2 Sep 2024
- 2024Linguistic-Based Mild Cognitive Impairment Detection Using Informative Loss23 Jan 2024
- 2023Multi-Stage Pre-training Enhanced by ChatGPT for Multi-Scenario Multi-Domain Dialogue Summarization16 Oct 2023
- 2023Large Language Models Vote: Prompting for Rare Disease Identification24 Aug 2023
- 2023PIPPA: A Partially Synthetic Conversational Dataset11 Aug 2023
- 2023A Massive Scale Semantic Similarity Dataset of Historical English30 Jun 2023
- 2023Revealing the Blind Spot of Sentence Encoder Evaluation by HEROS8 Jun 2023
- 2023Description-Based Text Similarity21 May 2023
- 2023Multi-View Zero-Shot Open Intent Induction from Dialogues: Multi Domain Batch and Proxy Gradient Transfer23 Mar 2023
12 newest of 37 All 37 (JSON)