Frames: A Corpus for Adding Memory to Goal-Oriented Dialogue Systems
Not on the map. Why?
Abstract (arXiv)
This paper presents the Frames dataset (Frames is available at http://datasets.maluuba.com/Frames), a corpus of 1369 human-human dialogues with an average of 15 turns per dialogue. We developed this dataset to study the role of memory in goal-oriented dialogue systems. Based on Frames, we introduce a task called frame tracking, which extends state tracking to a setting where several states are tracked simultaneously. We propose a baseline model for this task. We show that Frames can also be used to study memory in dialogue management and information presentation through natural language generation.
Key facts. Cited by 85 papers in the map (data through 14 Oct 2026). First posted on arXiv 31 Mar 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 23; 2022: 24; 2023: 15; 2024: 13; 2025: 3; 2026: 7.
85 papers.
Sort:
By area:
- 2021Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue Systemcited by 139
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
- 2021KLUE: Korean Language Understanding Evaluationcited by 114
- 2021GALAXY: A Generative Pre-trained Model for Task-Oriented Dialog with Semi-Supervised Learning and Explicit Policy Injectioncited by 102
- 2021QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehensioncited by 91
- 2021MultiWOZ 2.4: A Multi-Domain Task-Oriented Dialogue Dataset with Essential Annotation Corrections to Improve State Tracking Evaluationcited by 88
- 2022Human Evaluation of Conversations is an Open Problem: comparing the sensitivity of various methods for evaluating dialogue agentscited by 62
- 2022Rethinking Explainability as a Dialogue: A Practitioner's Perspectivecited by 52
- 2022Neural Approaches to Conversational Information Retrievalcited by 42
- 2022Controllable Dialogue Simulation with In-Context Learningcited by 42
- 2022InstructDial: Improving Zero and Few-shot Generalization in Dialogue through Instruction Tuningcited by 39
- 2022D4: a Chinese Dialogue Dataset for Depression-Diagnosis-Oriented Chatcited by 37
38 more
- 2022SPACE-3: Unified Dialog Model Pre-training for Task-Oriented Dialog Understanding and Generationcited by 34
- 2021GlobalWoZ: Globalizing MultiWoZ to Develop Multilingual Task-Oriented Dialogue Systemscited by 31
- 2021"How Robust r u?": Evaluating Task-Oriented Dialogue Systems on Spoken Conversationscited by 30
- 2022SPACE-2: Tree-Structured Semi-Supervised Contrastive Pre-training for Task-Oriented Dialog Understandingcited by 28
- 2023DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection for Conversational AIcited by 22
- 2024MediTOD: An English Dialogue Dataset for Medical History Taking with Comprehensive Annotationscited by 22
- 2021End-to-End Learning of Flowchart Grounded Task-Oriented Dialogscited by 20
- 2021ChainCQG: Flow-Aware Conversational Question Generationcited by 19
- 2021A Survey on Deep Reinforcement Learning for Audio-Based Applicationscited by 17
- 2022Learning Dialogue Representations from Consecutive Utterancescited by 17
- 2021NeuralWOZ: Learning to Collect Task-Oriented Dialogue via Model-Based Simulationcited by 16
- 2022MVP: Multi-task Supervised Pre-training for Natural Language Generationcited by 16
- 2023Multi3WOZ: A Multilingual, Multi-Domain, Multi-Parallel Dataset for Training and Evaluating Culturally Adapted Task-Oriented Dialog Systemscited by 16
- 2021Alexa Conversations: An Extensible Data-driven Approach for Building Task-oriented Dialogue Systemscited by 14
- 2022A Survey of Intent Classification and Slot-Filling Datasets for Task-Oriented Dialogcited by 14
- 2021Telling Stories through Multi-User Dialogue by Modeling Character Relationscited by 13
- 2022A Slot Is Not Built in One Utterance: Spoken Language Dialogs with Sub-Slotscited by 13
- 2021TOD-DA: Towards Boosting the Robustness of Task-oriented Dialogue Modeling on Spoken Conversationscited by 11
- 2022ASSIST: Towards Label Noise-Robust Dialogue State Trackingcited by 11
- 2021Situated Dialogue Learning through Procedural Environment Generationcited by 9
- 2022An Empirical Study on the Overlapping Problem of Open-Domain Dialogue Datasetscited by 8
- 2022NLU++: A Multi-Label, Slot-Rich, Generalisable Dataset for Natural Language Understanding in Task-Oriented Dialoguecited by 8
- 2024Dialog2Flow: Pre-training Soft-Contrastive Action-Driven Sentence Embeddings for Automatic Dialog Flow Extractioncited by 8
- 2024LUCID: LLM-Generated Utterances for Complex and Interesting Dialoguescited by 7
- 2024RECIPE4U: Student-ChatGPT Interaction Dataset in EFL Writing Educationcited by 7
- 2025Evaluating, Synthesizing, and Enhancing for Customer Support Conversationcited by 7
- 2025WebSeer: Training Deeper Search Agents through Reinforcement Learning with Self-Reflectioncited by 7
- 2021HyKnow: End-to-End Task-Oriented Dialog Modeling with Hybrid Knowledge Managementcited by 6
- 2024Simulating Task-Oriented Dialogues with State Transition Graphs and Large Language Modelscited by 6
- 2023NatCS: Eliciting Natural Customer Support Dialoguescited by 5
- 2023May I Ask a Follow-up Question? Understanding the Benefits of Conversations in Neural Network Explainabilitycited by 5
- 2021Different Strokes for Different Folks: Investigating Appropriate Further Pre-training Approaches for Diverse Dialogue Taskscited by 4
- 2022Information Extraction and Human-Robot Dialogue towards Real-life Tasks: A Baseline Study with the MobileCS Datasetcited by 4
- 2023Psychological Metrics for Dialog System Evaluationcited by 4
- 2023A Systematic Study of Performance Disparities in Multilingual Task-Oriented Dialogue Systemscited by 4
- 2023Dialogue Quality and Emotion Annotations for Customer Support Conversationscited by 4
- 2023OmniDialog: An Omnipotent Pre-training Model for Task-Oriented Dialogue Systemcited by 4
- 2024Exploring Conversational Agents as an Effective Tool for Measuring Cognitive Biases in Decision-Makingcited by 4
50 most cited of 85 All 85 (JSON)
- 2026CUEing User Simulators: Calibrated User Embeddings for Multi-Turn Benchmarking1 Oct 2026
- 2026IRWOZ 2.0: A Large Language Model-driven Dialogue Dataset for Industrial Robot Conversations3 Sep 2026
- 2026Building Korean linguistic resource for NLU data generation of banking app CS dialog system11 May 2026
- 2026Latent Preference Modeling for Multi-Session Personalized Tool Calling20 Apr 2026
- 2026Emulating Aggregate Human Choice Behavior and Biases with GPT Conversational Agents5 Feb 2026
- 2026Decomposed Prompting Does Not Fix Knowledge Gaps, But Helps Models Say "I Don't Know"4 Feb 2026
- 2026Predicting Biased Human Decision-Making with Large Language Models in Conversational Settings16 Jan 2026
- 2025WebSeer: Training Deeper Search Agents through Reinforcement Learning with Self-Reflection21 Oct 2025
- 2025Evaluating, Synthesizing, and Enhancing for Customer Support Conversation6 Aug 2025
- 2025Efficient Intent-Based Filtering for Multi-Party Conversations Using Knowledge Distillation from LLMs21 Mar 2025
- 2024Dialog2Flow: Pre-training Soft-Contrastive Action-Driven Sentence Embeddings for Automatic Dialog Flow Extraction24 Oct 2024
- 2024Building Dialogue Understanding Models for Low-resource Language Indonesian from Scratch24 Oct 2024
38 more
- 2024MediTOD: An English Dialogue Dataset for Medical History Taking with Comprehensive Annotations18 Oct 2024
- 2024Making Task-Oriented Dialogue Datasets More Natural by Synthetically Generating Indirect User Requests12 Jun 2024
- 2024Simulating Task-Oriented Dialogues with State Transition Graphs and Large Language Models23 Apr 2024
- 2024DivTOD: Unleashing the Power of LLMs for Diversifying Task-Oriented Dialogue Representations31 Mar 2024
- 2024JMultiWOZ: A Large-Scale Japanese Multi-Domain Task-Oriented Dialogue Dataset26 Mar 2024
- 2024RECIPE4U: Student-ChatGPT Interaction Dataset in EFL Writing Education13 Mar 2024
- 2024BootTOD: Bootstrap Task-oriented Dialogue Representations by Aligning Diverse Responses2 Mar 2024
- 2024LUCID: LLM-Generated Utterances for Complex and Interesting Dialogues1 Mar 2024
- 2024TOAD: Task-Oriented Automatic Dialogs with Diverse Response Styles15 Feb 2024
- 2024Exploring Conversational Agents as an Effective Tool for Measuring Cognitive Biases in Decision-Making8 Jan 2024
- 2024PerSHOP -- A Persian dataset for shopping dialogue systems modeling1 Jan 2024
- 2023OmniDialog: An Omnipotent Pre-training Model for Task-Oriented Dialogue System28 Dec 2023
- 2023CESAR: Automatic Induction of Compositional Instructions for Multi-turn Dialogs29 Nov 2023
- 2023Dialogue Quality and Emotion Annotations for Customer Support Conversations23 Nov 2023
- 2023A Systematic Study of Performance Disparities in Multilingual Task-Oriented Dialogue Systems19 Oct 2023
- 2023RSVP: Customer Intent Detection via Agent Response Contrastive and Generative Pre-Training15 Oct 2023
- 2023Lexical Entrainment for Conversational Systems14 Oct 2023
- 2023A Task-oriented Dialog Model with Task-progressive and Policy-aware Pre-training1 Oct 2023
- 2023May I Ask a Follow-up Question? Understanding the Benefits of Conversations in Neural Network Explainability25 Sep 2023
- 2023UniPCM: Universal Pre-trained Conversation Model with Task-aware Automatic Prompt20 Sep 2023
- 2023Multi3WOZ: A Multilingual, Multi-Domain, Multi-Parallel Dataset for Training and Evaluating Culturally Adapted Task-Oriented Dialog Systems26 Jul 2023
- 2023DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection for Conversational AI19 Jul 2023
- 2023FutureTOD: Teaching Future Knowledge to Pre-trained Language Model for Task-Oriented Dialogue17 Jun 2023
- 2023Improving Generalization in Task-oriented Dialogues with Workflows and Action Plans2 Jun 2023
- 2023Psychological Metrics for Dialog System Evaluation24 May 2023
- 2023NatCS: Eliciting Natural Customer Support Dialogues4 May 2023
- 2022Can Current Task-oriented Dialogue Models Automate Real-world Scenarios in the Wild?20 Dec 2022
- 2022Reranking Overgenerated Responses for End-to-End Task-Oriented Dialogue Systems7 Nov 2022
- 2022Human in the loop approaches in multi-modal conversational task guidance system development3 Nov 2022
- 2022Joint Reasoning on Hybrid-knowledge sources for Task-Oriented Dialog13 Oct 2022
- 2022Controllable Dialogue Simulation with In-Context Learning9 Oct 2022
- 2022Information Extraction and Human-Robot Dialogue towards Real-life Tasks: A Baseline Study with the MobileCS Dataset27 Sep 2022
- 2022SPACE-3: Unified Dialog Model Pre-training for Task-Oriented Dialog Understanding and Generation14 Sep 2022
- 2022SPACE-2: Tree-Structured Semi-Supervised Contrastive Pre-training for Task-Oriented Dialog Understanding14 Sep 2022
- 2022Manual-Guided Dialogue for Flexible Conversational Agents16 Aug 2022
- 2022A Survey of Intent Classification and Slot-Filling Datasets for Task-Oriented Dialog26 Jul 2022
- 2022Advancing Semi-Supervised Task Oriented Dialog Systems by JSA Learning of Discrete Latent Variable Models25 Jul 2022
- 2022MVP: Multi-task Supervised Pre-training for Natural Language Generation24 Jun 2022
50 newest of 85 All 85 (JSON)
- 2021Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue Systemcited by 139
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
- 2021KLUE: Korean Language Understanding Evaluationcited by 114
- 2021GALAXY: A Generative Pre-trained Model for Task-Oriented Dialog with Semi-Supervised Learning and Explicit Policy Injectioncited by 102
- 2021QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehensioncited by 91
- 2021MultiWOZ 2.4: A Multi-Domain Task-Oriented Dialogue Dataset with Essential Annotation Corrections to Improve State Tracking Evaluationcited by 88
- 2022Human Evaluation of Conversations is an Open Problem: comparing the sensitivity of various methods for evaluating dialogue agentscited by 62
- 2022Rethinking Explainability as a Dialogue: A Practitioner's Perspectivecited by 52
- 2022Neural Approaches to Conversational Information Retrievalcited by 42
- 2022Controllable Dialogue Simulation with In-Context Learningcited by 42
- 2022InstructDial: Improving Zero and Few-shot Generalization in Dialogue through Instruction Tuningcited by 39
- 2022D4: a Chinese Dialogue Dataset for Depression-Diagnosis-Oriented Chatcited by 37
12 most cited of 77 All 77 (JSON)
- 2026CUEing User Simulators: Calibrated User Embeddings for Multi-Turn Benchmarking1 Oct 2026
- 2026IRWOZ 2.0: A Large Language Model-driven Dialogue Dataset for Industrial Robot Conversations3 Sep 2026
- 2026Building Korean linguistic resource for NLU data generation of banking app CS dialog system11 May 2026
- 2026Decomposed Prompting Does Not Fix Knowledge Gaps, But Helps Models Say "I Don't Know"4 Feb 2026
- 2026Predicting Biased Human Decision-Making with Large Language Models in Conversational Settings16 Jan 2026
- 2025Evaluating, Synthesizing, and Enhancing for Customer Support Conversation6 Aug 2025
- 2024Dialog2Flow: Pre-training Soft-Contrastive Action-Driven Sentence Embeddings for Automatic Dialog Flow Extraction24 Oct 2024
- 2024Building Dialogue Understanding Models for Low-resource Language Indonesian from Scratch24 Oct 2024
- 2024MediTOD: An English Dialogue Dataset for Medical History Taking with Comprehensive Annotations18 Oct 2024
- 2024Making Task-Oriented Dialogue Datasets More Natural by Synthetically Generating Indirect User Requests12 Jun 2024
- 2024DivTOD: Unleashing the Power of LLMs for Diversifying Task-Oriented Dialogue Representations31 Mar 2024
- 2024JMultiWOZ: A Large-Scale Japanese Multi-Domain Task-Oriented Dialogue Dataset26 Mar 2024
12 newest of 77 All 77 (JSON)