mlsanityData to 7 Oct 2026

DialoGLUE: A Natural Language Understanding Benchmark for Task-Oriented Dialogue

arXiv 2009.13570 ↗First posted 28 Sep 2020cs.CL cs.AIcited by 89

Not on the map. Why?

Abstract (arXiv)

A long-standing goal of task-oriented dialogue research is the ability to flexibly adapt dialogue models to new domains. To progress research in this direction, we introduce DialoGLUE (Dialogue Language Understanding Evaluation), a public benchmark consisting of 7 task-oriented dialogue datasets covering 4 distinct natural language understanding tasks, designed to encourage dialogue research in representation-based transfer, domain adaptation, and sample-efficient task learning. We release several strong baseline models, demonstrating performance improvements over a vanilla BERT architecture and state-of-the-art results on 5 out of 7 tasks, by pre-training on a large open-domain dialogue corpus and task-adaptive self-supervised training. Through the DialoGLUE benchmark, the baseline methods, and our evaluation scripts, we hope to facilitate progress towards the goal of developing more general task-oriented dialogue models.

Key facts. Cited by 89 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Sep 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 22; 2022: 28; 2023: 22; 2024: 8; 2025: 8; 2026: 1.

89 papers.

Sort:

By area:

  1. 2021ExT5: Towards Extreme Multi-Task Scaling for Transfer Learningcited by 161
  2. 2021AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processingcited by 131
  3. 2021KLUE: Korean Language Understanding Evaluationcited by 113
  4. 2021GALAXY: A Generative Pre-trained Model for Task-Oriented Dialog with Semi-Supervised Learning and Explicit Policy Injectioncited by 102
  5. 2025Evaluating LLM-based Agents for Multi-Turn Conversations: A Surveycited by 56
  6. 2021Zero-Shot Dialogue State Tracking via Cross-Task Transfercited by 52
  7. 2022In-Context Learning for Few-Shot Dialogue State Trackingcited by 47
  8. 2021Few-Shot Intent Detection via Contrastive Pre-Training and Fine-Tuningcited by 46
  9. 2021Preview, Attend and Review: Schema-Aware Curriculum Learning for Multi-Domain Dialog State Trackingcited by 35
  10. 2023In-Context Learning for Text Classification with Many Labelscited by 35
  11. 2022SPACE-3: Unified Dialog Model Pre-training for Task-Oriented Dialog Understanding and Generationcited by 34
  12. 2023DialogBench: Evaluating LLMs as Human-like Dialogue Systemscited by 31
38 more
  1. 2021"How Robust r u?": Evaluating Task-Oriented Dialogue Systems on Spoken Conversationscited by 30
  2. 2023Task-Optimized Adapters for an End-to-End Task-Oriented Dialogue Systemcited by 30
  3. 2022New Intent Discovery with Pre-training and Contrastive Learningcited by 28
  4. 2022SPACE-2: Tree-Structured Semi-Supervised Contrastive Pre-training for Task-Oriented Dialog Understandingcited by 28
  5. 2021Effectiveness of Pre-training for Few-shot Intent Classificationcited by 27
  6. 2021ConvFiT: Conversational Fine-Tuning of Pretrained Language Modelscited by 25
  7. 2023Grounded Entity-Landmark Adaptive Pre-training for Vision-and-Language Navigationcited by 25
  8. 2023Selective In-Context Data Augmentation for Intent Detection using Pointwise V-Informationcited by 24
  9. 2022Dialogue Summaries as Dialogue States (DS2), Template-Guided Summarization for Few-shot Dialogue State Trackingcited by 21
  10. 2021ReMeDi: Resources for Multi-domain, Multi-service, Medical Dialoguescited by 20
  11. 2022Fine-tuning Pre-trained Language Models for Few-shot Intent Detection: Supervised Pre-training and Isotropizationcited by 19
  12. 2021ProtAugment: Unsupervised diverse short-texts paraphrasing for intent detection meta-learningcited by 18
  13. 2022LAD: Language Models as Data for Zero-Shot Dialogcited by 18
  14. 2023ContrastNet: A Contrastive Learning Framework for Few-Shot Text Classificationcited by 17
  15. 2023Rethinking Semi-supervised Learning with Language Modelscited by 17
  16. 2021Crossing the Conversational Chasm: A Primer on Natural Language Processing for Multilingual Task-Oriented Dialogue Systemscited by 16
  17. 2021RETRONLU: Retrieval Augmented Task-Oriented Semantic Parsingcited by 15
  18. 2022Robust Dialogue State Tracking with Weak Supervision and Sparse Datacited by 15
  19. 2022A Survey of Intent Classification and Slot-Filling Datasets for Task-Oriented Dialogcited by 14
  20. 2022Task Compass: Scaling Multi-task Pre-training with Task Prefixcited by 14
  21. 2021Schema-Guided Paradigm for Zero-Shot Dialogcited by 13
  22. 2022Report from the NSF Future Directions Workshop on Automatic Evaluation of Dialog: Research Directions and Challengescited by 13
  23. 2025Simulating Society Requires Simulating Thoughtcited by 12
  24. 2021GenSF: Simultaneous Adaptation of Generative Pre-trained Models and Slot Fillingcited by 11
  25. 2022FETA: A Benchmark for Few-Sample Task Transfer in Open-Domain Dialoguecited by 11
  26. 2022Improved and Efficient Conversational Slot Labeling through Question Answeringcited by 10
  27. 2021Know Thy Strengths: Comprehensive Dialogue State Tracking Diagnosticscited by 9
  28. 2022UniDU: Towards A Unified Generative Dialogue Understanding Frameworkcited by 9
  29. 2022CGoDial: A Large-Scale Benchmark for Chinese Goal-oriented Dialog Evaluationcited by 9
  30. 2024MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systemscited by 7
  31. 2025ESPnet-SDS: Unified Toolkit and Demo for Spoken Dialogue Systemscited by 7
  32. 2021Dialogue State Tracking with Multi-Level Fusion of Predicted Dialogue States and Conversationscited by 6
  33. 2022LUNA: Learning Slot-Turn Alignment for Dialogue State Trackingcited by 6
  34. 2022Prescriptive Process Monitoring in Intelligent Process Automation with Chatbot Orchestrationcited by 6
  35. 2023PromptAttack: Probing Dialogue State Trackers with Adversarial Promptscited by 6
  36. 2024Dynamic Label Name Refinement for Few-Shot Dialogue Intent Classificationcited by 6
  37. 2022On Tracking Dialogue State by Inheriting Slot Values in Mentioned Slot Poolscited by 5
  38. 2022Multi-Sentence Knowledge Selection in Open-Domain Dialoguecited by 5

50 most cited of 89 All 89 (JSON)