mlsanityData to 7 Oct 2026

Action-Based Conversations Dataset: A Corpus for Building More In-Depth Task-Oriented Dialogue Systems

arXiv 2104.00783 ↗First posted 1 Apr 2021cs.CLcited by 73

Not on the map. Why?

Abstract (arXiv)

Existing goal-oriented dialogue datasets focus mainly on identifying slots and values. However, customer support interactions in reality often involve agents following multi-step procedures derived from explicitly-defined company policies as well. To study customer service dialogue systems in more realistic settings, we introduce the Action-Based Conversations Dataset (ABCD), a fully-labeled dataset with over 10K human-to-human dialogues containing 55 distinct user intents requiring unique sequences of actions constrained by policies to achieve task success. We propose two additional dialog tasks, Action State Tracking and Cascading Dialogue Success, and establish a series of baselines involving large-scale, pre-trained language models on this dataset. Empirical results demonstrate that while more sophisticated networks outperform simpler models, a considerable gap (50.8% absolute accuracy) still exists to reach human-level performance on ABCD.

Key facts. Cited by 73 papers in the map (data through 7 Oct 2026). Builds on 34 of its 46 references that are in the map. First posted on arXiv 1 Apr 2021.

Builds on

34 of 46 references.

References · 34

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  4. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
  5. 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
  6. 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 820
  7. 2019On the Variance of the Adaptive Learning Rate and Beyondcited by 763
  8. 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 760
  9. 2018Wizard of Wikipedia: Knowledge-Powered Conversational agentscited by 530
  10. 2019Towards Scalable Multi-domain Conversational Agents: The Schema-Guided Dialogue Datasetcited by 426
  11. 2016Visual Dialogcited by 377
  12. 2016How NOT To Evaluate Your Dialogue System: An Empirical Study of Unsupervised Evaluation Metrics for Dialogue Response Generationcited by 356
22 more
  1. 2020A Simple Language Model for Task-Oriented Dialoguecited by 331
  2. 2015Towards AI-Complete Question Answering: A Set of Prerequisite Toy Taskscited by 309
  3. 2019Transferable Multi-Domain State Generator for Task-Oriented Dialogue Systemscited by 215
  4. 2017Deal or No Deal? End-to-End Learning for Negotiation Dialoguescited by 202
  5. 2019TransferTransfo: A Transfer Learning Approach for Neural Network Based Conversational Agentscited by 188
  6. 2019Towards Multimodal Sarcasm Detection (An _Obviously_ Perfect Paper)cited by 173
  7. 2018Decoupling Strategy and Generation in Negotiation Dialoguescited by 156
  8. 2019Taskmaster-1: Toward a Realistic and Diverse Dialog Datasetcited by 139
  9. 2017Key-Value Retrieval Networks for Task-Oriented Dialoguecited by 137
  10. 2017A Knowledge-Grounded Neural Conversation Modelcited by 136
  11. 2016Learning End-to-End Goal-Oriented Dialogcited by 104
  12. 2017Learning Cooperative Visual Dialog Agents with Deep Reinforcement Learningcited by 70
  13. 2018Building a Conversational Agent Overnight with Dialogue Self-Playcited by 70
  14. 2019Executing Instructions in Situated Collaborative Interactionscited by 68
  15. 2017Learning Symmetric Collaborative Dialogue Agents with Dynamic Knowledge Graph Embeddingscited by 59
  16. 2019Training Neural Response Selection for Task-Oriented Dialogue Systemscited by 48
  17. 2020Schema-Guided Dialogue State Tracking Task at DSTC8cited by 32
  18. 2017Hybrid Code Networks: practical and efficient end-to-end dialog control with supervised and reinforcement learningcited by 31
  19. 2019An End-to-End Dialogue State Tracking System with Machine Reading Comprehension and Wide & Deep Classificationcited by 20
  20. 2019MOSS: End-to-End Dialog System Framework with Modular Supervisioncited by 19
  21. 2020Probing Task-Oriented Dialogue Representation from Language Modelscited by 15
  22. 2020Multipurpose Intelligent Process Automation via Conversational Assistantcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 3; 2022: 16; 2023: 17; 2024: 10; 2025: 13; 2026: 14.

73 papers.

Sort:

By area:

  1. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,280
  2. 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 558
  3. 2021GALAXY: A Generative Pre-trained Model for Task-Oriented Dialog with Semi-Supervised Learning and Explicit Policy Injectioncited by 102
  4. 2023Sentence Embedding Leaks More Information than You Expect: Generative Embedding Inversion Attack to Recover the Whole Sentencecited by 81
  5. 2023SpokenWOZ: A Large-Scale Speech-Text Benchmark for Spoken Task-Oriented Dialogue Agentscited by 71
  6. 2021BiToD: A Bilingual Multi-Domain Dataset For Task-Oriented Dialogue Modelingcited by 55
  7. 2023Zero-Shot Goal-Directed Dialogue via RL on Imagined Conversationscited by 38
  8. 2022SPACE-3: Unified Dialog Model Pre-training for Task-Oriented Dialog Understanding and Generationcited by 34
  9. 2024Bootstrapping LLM-based Task-Oriented Dialogue Agents via Self-Talkcited by 34
  10. 2022Just Fine-tune Twice: Selective Differential Privacy for Large Language Modelscited by 32
  11. 2022SPACE-2: Tree-Structured Semi-Supervised Contrastive Pre-training for Task-Oriented Dialog Understandingcited by 28
  12. 2022"Do you follow me?": A Survey of Recent Approaches in Dialogue State Trackingcited by 22
38 more
  1. 2023DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection for Conversational AIcited by 21
  2. 2024UQE: A Query Engine for Unstructured Databasescited by 18
  3. 2026A Survey on LLM-based Conversational User Simulationcited by 14
  4. 2022Where to Go for the Holidays: Towards Mixed-Type Dialogs for Clarification of User Goalscited by 12
  5. 2022Workflow Discovery from Dialogues in the Low Data Regimecited by 12
  6. 2025Evolutionary Perspectives on the Evaluation of LLM-Based AI Agents: A Comprehensive Surveycited by 12
  7. 2022Unsupervised Slot Schema Induction for Task-oriented Dialogcited by 11
  8. 2024FLAP: Flow-Adhering Planning with Constrained Decoding in LLMscited by 11
  9. 2024The Imperative of Conversation Analysis in the Era of LLMs: A Survey of Tasks, Techniques, and Trendscited by 11
  10. 2021DG2: Data Augmentation Through Document Grounded Dialogue Generationcited by 10
  11. 2022AnyTOD: A Programmable Task-Oriented Dialog Systemcited by 10
  12. 2023Intent Induction from Conversations for Task-Oriented Dialogue Track at DSTC 11cited by 10
  13. 2023Text Sanitization Beyond Specific Domains: Zero-Shot Redaction & Substitution with Large Language Modelscited by 10
  14. 2022CGoDial: A Large-Scale Benchmark for Chinese Goal-oriented Dialog Evaluationcited by 9
  15. 2025Follow-up Question Generation For Enhanced Patient-Provider Conversationscited by 9
  16. 2024Dialog2Flow: Pre-training Soft-Contrastive Action-Driven Sentence Embeddings for Automatic Dialog Flow Extractioncited by 8
  17. 2025DeepDialogue: A Multi-Turn Emotionally-Rich Spoken Dialogue Datasetcited by 8
  18. 2026CAR-bench: Evaluating the Consistency and Limit-Awareness of LLM Agents under Real-World Uncertaintycited by 8
  19. 2022Task2Dial: A Novel Task and Dataset for Commonsense enhanced Task-based Dialogue Grounded in Documentscited by 7
  20. 2023Stabilized In-Context Learning with Pre-trained Language Models for Few Shot Dialogue State Trackingcited by 6
  21. 2023The StatCan Dialogue Dataset: Retrieving Data Tables through Conversations with Genuine Intentscited by 6
  22. 2023On the Effectiveness of Offline RL for Dialogue Response Generationcited by 6
  23. 2022Long-term Control for Dialogue Generation: Methods and Evaluationcited by 5
  24. 2022Unsupervised Learning of Hierarchical Conversation Structurecited by 5
  25. 2023NatCS: Eliciting Natural Customer Support Dialoguescited by 5
  26. 2023Does Collaborative Human-LM Dialogue Generation Help Information Extraction from Human Dialogues?cited by 5
  27. 2025Turning Conversations into Workflows: A Framework to Extract and Evaluate Dialog Workflows for Service AI Agentscited by 5
  28. 2025Tournament of Prompts: Evolving LLM Instructions Through Structured Debates and Elo Ratingscited by 5
  29. 2022Learning as Conversation: Dialogue Systems Reinforced for Information Acquisitioncited by 4
  30. 2025VoiceAgentEval: A Dual-Dimensional Benchmark for Expert-Level Intelligent Voice-Agent Evaluation of Xbench's Professional-Aligned Seriescited by 4
  31. 2023Improving Generalization in Task-oriented Dialogues with Workflows and Action Planscited by 3
  32. 2023UniPCM: Universal Pre-trained Conversation Model with Task-aware Automatic Promptcited by 3
  33. 2024Unsupervised Extraction of Dialogue Policies from Conversationscited by 3
  34. 2025Agent WARPP: Workflow Adherence via Runtime Parallel Personalizationcited by 3
  35. 2026CirrusBench: Evaluating LLM-based Agents Beyond Correctness in Real-World Cloud Service Environmentscited by 3
  36. 2026ProActor: Timing-Aware Reinforcement Learning for Proactive Task Scheduling Agentscited by 3
  37. 2023Multi-Step Dialogue Workflow Action Predictioncited by 2
  38. 2025TOD-ProcBench: Benchmarking Complex Instruction-Following in Task-Oriented Dialoguescited by 2

50 most cited of 73 All 73 (JSON)