Mem2Seq: Effectively Incorporating Knowledge Bases into End-to-End Task-Oriented Dialog Systems
Not on the map. Why?
Abstract (arXiv)
End-to-end task-oriented dialog systems usually suffer from the challenge of incorporating knowledge bases. In this paper, we propose a novel yet simple end-to-end differentiable model called memory-to-sequence (Mem2Seq) to address this issue. Mem2Seq is the first neural generative model that combines the multi-hop attention over memories with the idea of pointer network. We empirically show how Mem2Seq controls each generation step, and how its multi-hop attention mechanism helps in learning correlations between memories. In addition, our model is quite general without complicated task-specific designs. As a result, we show that Mem2Seq can be trained faster and attain the state-of-the-art performance on three different task-oriented dialog datasets.
Key facts. Cited by 70 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Apr 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 26; 2022: 17; 2023: 17; 2024: 5; 2025: 4; 2026: 1.
70 papers.
Sort:
By area:
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2022UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Modelscited by 231
- 2021Few-Shot Bot: Prompt-Based Learning for Dialogue Systemscited by 64
- 2021BiToD: A Bilingual Multi-Domain Dataset For Task-Oriented Dialogue Modelingcited by 55
- 2022HiURE: Hierarchical Exemplar Contrastive Learning for Unsupervised Relation Extractioncited by 32
- 2021MMChat: Multi-Modal Chat Dataset on Social Mediacited by 30
- 2023Ask an Expert: Leveraging Language Models to Improve Strategic Reasoning in Goal-Oriented Dialogue Modelscited by 30
- 2021Continual Learning for Task-oriented Dialogue System with Iterative Network Pruning, Expanding and Maskingcited by 22
- 2021DisenKGAT: Knowledge Graph Embedding with Disentangled Graph Attention Networkcited by 19
- 2021Learning to Remember Patterns: Pattern Matching Memory Networks for Traffic Forecastingcited by 19
- 2022DialoKG: Knowledge-Structure Aware Task-Oriented Dialogue Generationcited by 19
- 2021Don't be Contradicted with Anything! CI-ToD: Towards Benchmarking Consistency for Task-oriented Dialogue Systemcited by 18
38 more
- 2023End-to-end Task-oriented Dialogue: A Survey of Tasks, Methods, and Future Directionscited by 17
- 2021Crossing the Conversational Chasm: A Primer on Natural Language Processing for Multilingual Task-Oriented Dialogue Systemscited by 16
- 2021KECRS: Towards Knowledge-Enriched Conversational Recommendation Systemcited by 14
- 2021Task-Oriented Dialogue System as Natural Language Generationcited by 14
- 2023Dialogue Planning via Brownian Bridge Stochastic Process for Goal-directed Proactive Dialoguecited by 14
- 2026A Survey on LLM-based Conversational User Simulationcited by 14
- 2021Knowledge-driven Natural Language Understanding of English Text and its Applicationscited by 12
- 2021Prix-LM: Pretraining for Multilingual Knowledge Base Constructioncited by 12
- 2021Constraint based Knowledge Base Distillation in End-to-End Task Oriented Dialogscited by 11
- 2022Multimodal Dialog Systems with Dual Knowledge-enhanced Generative Pretrained Language Modelcited by 11
- 2022Towards Large-Scale Interpretable Knowledge Graph Reasoning for Dialogue Systemscited by 10
- 2021A Cooperative Memory Network for Personalized Task-oriented Dialogue Systems with Incomplete User Profilescited by 8
- 2021Grounding Dialogue Systems via Knowledge Graph Aware Decoding with Pre-trained Transformerscited by 8
- 2021Detecting Speaker Personas from Conversational Textscited by 8
- 2022Autoregressive Entity Generation for End-to-End Task-Oriented Dialogcited by 8
- 2022TILDE-Q: A Transformation Invariant Loss Function for Time-Series Forecastingcited by 8
- 2023Schema-Guided User Satisfaction Modeling for Task-Oriented Dialoguescited by 8
- 2022Fine-grained Contrastive Learning for Relation Extractioncited by 7
- 2023Personalizing Task-oriented Dialog Systems via Zero-shot Generalizable Reward Functioncited by 7
- 2023Towards Asking Clarification Questions for Information Seeking on Task-Oriented Dialoguescited by 7
- 2022RoMe: A Robust Metric for Evaluating Natural Language Generationcited by 6
- 2023Multi-Grained Knowledge Retrieval for End-to-End Task-Oriented Dialogcited by 6
- 2024Target-constrained Bidirectional Planning for Generation of Target-oriented Proactive Dialoguecited by 6
- 2021A Template-guided Hybrid Pointer Network for Knowledge-basedTask-oriented Dialogue Systemscited by 5
- 2022A Comparative Study on Language Models for Task-Oriented Dialogue Systemscited by 5
- 2022An Interpretable Neuro-Symbolic Reasoning Framework for Task-Oriented Dialogue Generationcited by 5
- 2023InstructTODS: Large Language Models for End-to-End Task-Oriented Dialogue Systemscited by 5
- 2022Robust Task-Oriented Dialogue Generation with Contrastive Pre-training and Adversarial Filteringcited by 4
- 2022Advanced Conditional Variational Autoencoders (A-CVAE): Towards interpreting open-domain conversation generation via disentangling latent feature representationcited by 4
- 2024Synergizing In-context Learning with Hints for End-to-end Task-oriented Dialog Systemscited by 4
- 2025Affective Multimodal Agents with Proactive Knowledge Grounding for Emotionally Aligned Marketing Dialoguecited by 4
- 2021High-Quality Diversification for Task-Oriented Dialogue Systemscited by 3
- 2023Retrieval-Generation Alignment for End-to-End Task-Oriented Dialogue Systemcited by 3
- 2023Dual-Feedback Knowledge Retrieval for Task-Oriented Dialogue Systemscited by 3
- 2021Meta-Learning with Variational Semantic Memory for Word Sense Disambiguationcited by 2
- 2021ARTA: Collection and Classification of Ambiguous Requests and Thoughtful Actionscited by 2
- 2021How to Evaluate Your Dialogue Models: A Review of Approachescited by 2
- 2021A Speaker-aware Parallel Hierarchical Attentive Encoder-Decoder Model for Multi-turn Dialogue Generationcited by 2
50 most cited of 70 All 70 (JSON)
- 2026A Survey on LLM-based Conversational User Simulation27 Apr 2026
- 2025Affective Multimodal Agents with Proactive Knowledge Grounding for Emotionally Aligned Marketing Dialogue21 Nov 2025
- 2025Improving LLM's Attachment to External Knowledge In Dialogue Generation Tasks Through Entity Anonymization14 Nov 2025
- 2025Dual Knowledge-Enhanced Two-Stage Reasoner for Multimodal Dialog Systems9 Sep 2025
- 2025Improving Multi-turn Task Completion in Task-Oriented Dialog Systems via Prompt Chaining and Fine-Grained Feedback18 Feb 2025
- 2024From Intents to Conversations: Generating Intent-Driven Dialogues with Contrastive Learning for Multi-Turn Classification21 Nov 2024
- 2024A Unified Data Augmentation Framework for Low-Resource Multi-Domain Dialogue Generation14 Jun 2024
- 2024Synergizing In-context Learning with Hints for End-to-end Task-oriented Dialog Systems24 May 2024
- 2024PhilHumans: Benchmarking Machine Learning for Personal Health4 May 2024
- 2024Target-constrained Bidirectional Planning for Generation of Target-oriented Proactive Dialogue10 Mar 2024
- 2023End-to-end Task-oriented Dialogue: A Survey of Tasks, Methods, and Future Directions15 Nov 2023
- 2023Salespeople vs SalesBot: Exploring the Role of Educational Value in Conversational Recommender Systems26 Oct 2023
38 more
- 2023Dual-Feedback Knowledge Retrieval for Task-Oriented Dialogue Systems23 Oct 2023
- 2023Retrieval-Augmented Neural Response Generation Using Logical Reasoning and Relevance Scoring20 Oct 2023
- 2023InstructTODS: Large Language Models for End-to-End Task-Oriented Dialogue Systems13 Oct 2023
- 2023Retrieval-Generation Alignment for End-to-End Task-Oriented Dialogue System13 Oct 2023
- 2023A Task-oriented Dialog Model with Task-progressive and Policy-aware Pre-training1 Oct 2023
- 2023Adapting Text-based Dialogue State Tracker for Spoken Dialogues29 Aug 2023
- 2023Open Set Relation Extraction via Unknown-Aware Training8 Jun 2023
- 2023Ask an Expert: Leveraging Language Models to Improve Strategic Reasoning in Goal-Oriented Dialogue Models29 May 2023
- 2023A Unified Framework for Slot based Response Generation in a Multimodal Dialogue System27 May 2023
- 2023Schema-Guided User Satisfaction Modeling for Task-Oriented Dialogues26 May 2023
- 2023DKAF: KB Arbitration for Learning Task-Oriented Dialog Systems with Dialog-KB Inconsistencies26 May 2023
- 2023Towards Asking Clarification Questions for Information Seeking on Task-Oriented Dialogues23 May 2023
- 2023Multi-Grained Knowledge Retrieval for End-to-End Task-Oriented Dialog17 May 2023
- 2023Dialogue Planning via Brownian Bridge Stochastic Process for Goal-directed Proactive Dialogue9 May 2023
- 2023Personalizing Task-oriented Dialog Systems via Zero-shot Generalizable Reward Function24 Mar 2023
- 2022Discovering Customer-Service Dialog System with Semi-Supervised Learning and Coarse-to-Fine Intent Detection23 Dec 2022
- 2022TILDE-Q: A Transformation Invariant Loss Function for Time-Series Forecasting26 Oct 2022
- 2022Autoregressive Entity Generation for End-to-End Task-Oriented Dialog19 Sep 2022
- 2022Advanced Conditional Variational Autoencoders (A-CVAE): Towards interpreting open-domain conversation generation via disentangling latent feature representation26 Jul 2022
- 2022Multimodal Dialog Systems with Dual Knowledge-enhanced Generative Pretrained Language Model16 Jul 2022
- 2022Fine-grained Contrastive Learning for Relation Extraction25 May 2022
- 2022Robust Task-Oriented Dialogue Generation with Contrastive Pre-training and Adversarial Filtering20 May 2022
- 2022Towards Explanation for Unsupervised Graph-Level Representation Learning20 May 2022
- 2022HiURE: Hierarchical Exemplar Contrastive Learning for Unsupervised Relation Extraction4 May 2022
- 2022DialoKG: Knowledge-Structure Aware Task-Oriented Dialogue Generation19 Apr 2022
- 2022Towards Large-Scale Interpretable Knowledge Graph Reasoning for Dialogue Systems20 Mar 2022
- 2022RoMe: A Robust Metric for Evaluating Natural Language Generation17 Mar 2022
- 2022An Interpretable Neuro-Symbolic Reasoning Framework for Task-Oriented Dialogue Generation11 Mar 2022
- 2022TraceNet: Tracing and Locating the Key Elements in Sentiment Analysis28 Feb 2022
- 2022Survey of Hallucination in Natural Language Generation8 Feb 2022
- 2022A Comparative Study on Language Models for Task-Oriented Dialogue Systems21 Jan 2022
- 2022UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Models16 Jan 2022
- 2021A Review of Dialogue Systems: From Trained Monkeys to Stochastic Parrots2 Nov 2021
- 2021Learning to Remember Patterns: Pattern Matching Memory Networks for Traffic Forecasting20 Oct 2021
- 2021Prix-LM: Pretraining for Multilingual Knowledge Base Construction16 Oct 2021
- 2021Few-Shot Bot: Prompt-Based Learning for Dialogue Systems15 Oct 2021
- 2021A Speaker-aware Parallel Hierarchical Attentive Encoder-Decoder Model for Multi-turn Dialogue Generation13 Oct 2021
- 2021Don't be Contradicted with Anything! CI-ToD: Towards Benchmarking Consistency for Task-oriented Dialogue System23 Sep 2021
50 newest of 70 All 70 (JSON)
- 2023Ask an Expert: Leveraging Language Models to Improve Strategic Reasoning in Goal-Oriented Dialogue Modelscited by 30
- 2022Towards Large-Scale Interpretable Knowledge Graph Reasoning for Dialogue Systemscited by 10
- 2022An Interpretable Neuro-Symbolic Reasoning Framework for Task-Oriented Dialogue Generationcited by 5
- 2023Retrieval-Augmented Neural Response Generation Using Logical Reasoning and Relevance Scoringcited by 1
- 2025Dual Knowledge-Enhanced Two-Stage Reasoner for Multimodal Dialog Systemscited by 0
- 2025Dual Knowledge-Enhanced Two-Stage Reasoner for Multimodal Dialog Systems9 Sep 2025
- 2023Retrieval-Augmented Neural Response Generation Using Logical Reasoning and Relevance Scoring20 Oct 2023
- 2023Ask an Expert: Leveraging Language Models to Improve Strategic Reasoning in Goal-Oriented Dialogue Models29 May 2023
- 2022Towards Large-Scale Interpretable Knowledge Graph Reasoning for Dialogue Systems20 Mar 2022
- 2022An Interpretable Neuro-Symbolic Reasoning Framework for Task-Oriented Dialogue Generation11 Mar 2022
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2022UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Modelscited by 231
- 2021Few-Shot Bot: Prompt-Based Learning for Dialogue Systemscited by 64
- 2021BiToD: A Bilingual Multi-Domain Dataset For Task-Oriented Dialogue Modelingcited by 55
- 2022HiURE: Hierarchical Exemplar Contrastive Learning for Unsupervised Relation Extractioncited by 32
- 2021MMChat: Multi-Modal Chat Dataset on Social Mediacited by 30
- 2021Continual Learning for Task-oriented Dialogue System with Iterative Network Pruning, Expanding and Maskingcited by 22
- 2021DisenKGAT: Knowledge Graph Embedding with Disentangled Graph Attention Networkcited by 19
- 2021Learning to Remember Patterns: Pattern Matching Memory Networks for Traffic Forecastingcited by 19
- 2022DialoKG: Knowledge-Structure Aware Task-Oriented Dialogue Generationcited by 19
- 2021Don't be Contradicted with Anything! CI-ToD: Towards Benchmarking Consistency for Task-oriented Dialogue Systemcited by 18
- 2023End-to-end Task-oriented Dialogue: A Survey of Tasks, Methods, and Future Directionscited by 17
12 most cited of 64 All 64 (JSON)
- 2026A Survey on LLM-based Conversational User Simulation27 Apr 2026
- 2025Improving LLM's Attachment to External Knowledge In Dialogue Generation Tasks Through Entity Anonymization14 Nov 2025
- 2025Improving Multi-turn Task Completion in Task-Oriented Dialog Systems via Prompt Chaining and Fine-Grained Feedback18 Feb 2025
- 2024From Intents to Conversations: Generating Intent-Driven Dialogues with Contrastive Learning for Multi-Turn Classification21 Nov 2024
- 2024A Unified Data Augmentation Framework for Low-Resource Multi-Domain Dialogue Generation14 Jun 2024
- 2024Synergizing In-context Learning with Hints for End-to-end Task-oriented Dialog Systems24 May 2024
- 2024PhilHumans: Benchmarking Machine Learning for Personal Health4 May 2024
- 2024Target-constrained Bidirectional Planning for Generation of Target-oriented Proactive Dialogue10 Mar 2024
- 2023End-to-end Task-oriented Dialogue: A Survey of Tasks, Methods, and Future Directions15 Nov 2023
- 2023Salespeople vs SalesBot: Exploring the Role of Educational Value in Conversational Recommender Systems26 Oct 2023
- 2023Dual-Feedback Knowledge Retrieval for Task-Oriented Dialogue Systems23 Oct 2023
- 2023InstructTODS: Large Language Models for End-to-End Task-Oriented Dialogue Systems13 Oct 2023
12 newest of 64 All 64 (JSON)