Building End-To-End Dialogue Systems Using Generative Hierarchical Neural Network Models
Not on the map. Why?
Abstract (arXiv)
We investigate the task of building open domain, conversational dialogue systems based on large dialogue corpora using generative models. Generative models produce system responses that are autonomously generated word-by-word, opening up the possibility for realistic, flexible interactions. In support of this goal, we extend the recently proposed hierarchical recurrent encoder-decoder neural network to the dialogue domain, and demonstrate that this model is competitive with state-of-the-art neural language models and back-off n-gram models. We investigate the limitations of this and similar approaches, and show how its performance can be improved by bootstrapping the learning from a larger question-answer pair corpus and from pretrained word embeddings.
Key facts. Cited by 207 papers in the map (data through 14 Oct 2026). First posted on arXiv 17 Jul 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2018: 1; 2019: 2; 2020: 1; 2021: 87; 2022: 56; 2023: 31; 2024: 13; 2025: 14; 2026: 2.
207 papers.
Sort:
By area:
- 2019Way Off-Policy Batch Deep Reinforcement Learning of Implicit Human Preferences in Dialogcited by 284
- 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systemscited by 170
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
- 2022Why Exposure Bias Matters: An Imitation Learning Perspective of Error Accumulation in Language Generationcited by 108
- 2021Neural Path Hunter: Reducing Hallucination in Dialogue Systems via Path Groundingcited by 106
- 2020Human-centric Dialog Training via Offline Reinforcement Learningcited by 93
- 2023On the Possibilities of AI-Generated Text Detectioncited by 88
- 2021Anticipating Safety Issues in E2E Conversational AI: Framework and Toolingcited by 78
- 2025A Survey of Personalized Large Language Models: Progress and Future Directionscited by 71
- 2022Latent Diffusion Energy-Based Model for Interpretable Text Modelingcited by 67
- 2022MMDialog: A Large-scale Multi-turn Dialogue Dataset Towards Multi-modal Open-domain Conversationcited by 56
- 2023Multi-Party Chat: Conversational Agents in Group Settings with Humans and Modelscited by 54
38 more
- 2022Less is More: Learning to Refine Dialogue History for Personalized Dialogue Generationcited by 47
- 2021Conversations Are Not Flat: Modeling the Dynamic Information Flow across Dialogue Utterancescited by 40
- 2021One Chatbot Per Person: Creating Personalized Chatbots based on Implicit User Profilescited by 39
- 2021MPC-BERT: A Pre-Trained Language Model for Multi-Party Conversation Understandingcited by 36
- 2021Transferable Dialogue Systems and User Simulatorscited by 36
- 2021CRSLab: An Open-Source Toolkit for Building Conversational Recommender Systemcited by 34
- 2021TWEETSUMM -- A Dialog Summarization Dataset for Customer Servicecited by 34
- 2024SALMONN-omni: A Codec-free LLM for Full-duplex Speech Understanding and Generationcited by 33
- 2021Multimodal Dialogue Response Generationcited by 32
- 2021Conversational Question Answering: A Surveycited by 31
- 2021Semi-Supervised Variational Reasoning for Medical Dialogue Generationcited by 30
- 2021Commonsense-Focused Dialogues for Response Generation: An Empirical Studycited by 30
- 2025SALMONN-omni: A Standalone Speech LLM without Codec Injection for Full-duplex Conversationcited by 27
- 2023RECAP: Retrieval-Enhanced Context-Aware Prefix Encoder for Personalized Dialogue Response Generationcited by 25
- 2021Conversational Question Answering over Knowledge Graphs with Transformer and Graph Attention Networkscited by 24
- 2022C2-CRS: Coarse-to-Fine Contrastive Learning for Conversational Recommender Systemcited by 24
- 2021Learning Neural Templates for Recommender Dialogue Systemcited by 22
- 2018Dialogue Generation: From Imitation Learning to Inverse Reinforcement Learningcited by 21
- 2021Emotion-aware Chat Machine: Automatic Emotional Response Generation for Human-like Emotional Interactioncited by 21
- 2021End-to-End Learning of Flowchart Grounded Task-Oriented Dialogscited by 20
- 2021Maria: A Visual Experience Powered Conversational Agentcited by 19
- 2021Investigating Robustness of Dialog Models to Popular Figurative Language Constructscited by 19
- 2022A Personalized Dialogue Generator with Implicit User Persona Detectioncited by 19
- 2022Why is constrained neural language generation particularly challenging?cited by 19
- 2021Generating Relevant and Coherent Dialogue Responses using Self-separated Conditional Variational AutoEncoderscited by 18
- 2022FADO: Feedback-Aware Double COntrolling Network for Emotional Support Conversationcited by 18
- 2021Crossing the Conversational Chasm: A Primer on Natural Language Processing for Multilingual Task-Oriented Dialogue Systemscited by 17
- 2021Thinking Clearly, Talking Fast: Concept-Guided Non-Autoregressive Generation for Open-Domain Dialogue Systemscited by 17
- 2021GTM: A Generative Triple-Wise Model for Conversational Question Generationcited by 16
- 2021Synthesizing Adversarial Negative Responses for Robust Response Ranking and Evaluationcited by 16
- 2022HeterMPC: A Heterogeneous Graph Neural Network for Response Generation in Multi-Party Conversationscited by 16
- 2022Multimodal Conversational AI: A Survey of Datasets and Approachescited by 16
- 2022A Mixture-of-Expert Approach to RL-based Dialogue Managementcited by 16
- 2022Measuring and Improving Semantic Diversity of Dialogue Generationcited by 16
- 2021TextBox: A Unified, Modularized, and Extensible Framework for Text Generationcited by 15
- 2021Partner Matters! An Empirical Study on Fusing Personas for Personalized Response Selection in Retrieval-Based Chatbotscited by 15
- 2021Automatically Select Emotion for Response via Personality-affected Emotion Transitioncited by 15
- 2021Latent Space Energy-Based Model of Symbol-Vector Coupling for Text Generation and Classificationcited by 15
50 most cited of 207 All 207 (JSON)
- 2026Multi-turn Conversational AI from Text to Multimodal Interaction: Data, Models, Evaluation, and Open Challenges18 Aug 2026
- 2026POS-ISP: Pipeline Optimization at the Sequence Level for Task-aware ISP8 Apr 2026
- 2025Towards Improving Interpretability of Language Model Generation through a Structured Knowledge Discovery Approach28 Nov 2025
- 2025Following the TRACE: A Structured Path to Empathetic Response Generation with Multi-Agent Models26 Sep 2025
- 2025MUSE: MCTS-Driven Red Teaming Framework for Enhanced Multi-Turn Dialogue Safety in Large Language Models18 Sep 2025
- 2025IMDMR: An Intelligent Multi-Dimensional Memory Retrieval System for Enhanced Conversational AI10 Sep 2025
- 2025Limitation Learning: Catching Adverse Dialog with GAIL15 Aug 2025
- 2025Chat-Ghosting: A Comparative Study of Methods for Auto-Completion in Dialog Systems8 Jul 2025
- 2025StorySage: Conversational Autobiography Writing Powered by a Multi-Agent Framework17 Jun 2025
- 2025Post Persona Alignment for Multi-Session Dialogue Generation13 Jun 2025
- 2025MEDAL: A Framework for Benchmarking LLMs as Multilingual Open-Domain Dialogue Evaluators28 May 2025
- 2025How Managers Perceive AI-Assisted Conversational Training for Workplace Communication20 May 2025
38 more
- 2025SALMONN-omni: A Standalone Speech LLM without Codec Injection for Full-duplex Conversation17 May 2025
- 2025OpeNLGauge: An Explainable Metric for NLG Evaluation with Open-Weights LLMs14 Mar 2025
- 2025Continuous Learning Conversational AI: A Personalized Agent Framework via A2C Reinforcement Learning18 Feb 2025
- 2025A Survey of Personalized Large Language Models: Progress and Future Directions17 Feb 2025
- 2024SALMONN-omni: A Codec-free LLM for Full-duplex Speech Understanding and Generation27 Nov 2024
- 2024From Intents to Conversations: Generating Intent-Driven Dialogues with Contrastive Learning for Multi-Turn Classification21 Nov 2024
- 2024A Static and Dynamic Attention Framework for Multi Turn Dialogue Generation28 Oct 2024
- 2024Soda-Eval: Open-Domain Dialogue Evaluation in the age of LLMs20 Aug 2024
- 2024ChatZero:Zero-shot Cross-Lingual Dialogue Generation via Pseudo-Target Language16 Aug 2024
- 2024On the Benchmarking of LLMs for Open-Domain Dialogue Evaluation4 Jul 2024
- 2024A Unified Data Augmentation Framework for Low-Resource Multi-Domain Dialogue Generation14 Jun 2024
- 2024Characteristic AI Agents via Large Language Models19 Mar 2024
- 2024MedKP: Medical Dialogue with Knowledge Enhancement and Clinical Pathway Encoding11 Mar 2024
- 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systems28 Feb 2024
- 2024CauESC: A Causal Aware Model for Emotional Support Conversation31 Jan 2024
- 2024Local and Global Contexts for Conversation31 Jan 2024
- 2024Improving the Robustness of Knowledge-Grounded Dialogue via Contrastive Learning9 Jan 2024
- 2023Knowledge Graphs and Pre-trained Language Models enhanced Representation Learning for Conversational Recommender Systems18 Dec 2023
- 2023Partially Randomizing Transformer Weights for Dialogue Response Diversity18 Nov 2023
- 2023DiQAD: A Benchmark Dataset for End-to-End Open-domain Dialogue Assessment25 Oct 2023
- 2023Continual Learning with Dirichlet Generative-based Rehearsal13 Sep 2023
- 2023Hi Model, generating 'nice' instead of 'good' is not as bad as generating 'rice'! Towards Context and Semantic Infused Dialogue Generation Loss Function and Evaluation Metric11 Sep 2023
- 2023Unsupervised Text Style Transfer with Deep Generative Models31 Aug 2023
- 2023Neural Conversation Models and How to Rein Them in: A Survey of Failures and Fixes11 Aug 2023
- 2023Marrying Dialogue Systems with Data Visualization: Interactive Data Visualization Generation from Natural Language Conversations29 Jul 2023
- 2023Towards a Neural Era in Dialogue Management for Collaboration: A Literature Survey18 Jul 2023
- 2023VOLTA: Improving Generative Diversity by Variational Mutual Information Maximizing Autoencoder3 Jul 2023
- 2023Description-Enhanced Label Embedding Contrastive Learning for Text Classification15 Jun 2023
- 2023RECAP: Retrieval-Enhanced Context-Aware Prefix Encoder for Personalized Dialogue Response Generation12 Jun 2023
- 2023Diverse and Faithful Knowledge-Grounded Dialogue Generation via Sequential Posterior Inference1 Jun 2023
- 2023A Call for Standardization and Validation of Text Style Transfer Evaluation1 Jun 2023
- 2023Medical Dialogue Generation via Dual Flow Modeling29 May 2023
- 2023A Unified Framework for Slot based Response Generation in a Multimodal Dialogue System27 May 2023
- 2023MADNet: Maximizing Addressee Deduction Expectation for Multi-Party Conversation Generation22 May 2023
- 2023Boosting Crop Classification by Hierarchically Fusing Satellite, Rotational, and Contextual Data19 May 2023
- 2023GIFT: Graph-Induced Fine-Tuning for Multi-Party Conversation Understanding16 May 2023
- 2023CADGE: Context-Aware Dialogue Generation Enhanced with Graph-Structured Knowledge Aggregation10 May 2023
- 2023Multi-Party Chat: Conversational Agents in Group Settings with Humans and Models26 Apr 2023
50 newest of 207 All 207 (JSON)
- 2023Multi-Party Chat: Conversational Agents in Group Settings with Humans and Modelscited by 54
- 2024Characteristic AI Agents via Large Language Modelscited by 5
- 2025Continuous Learning Conversational AI: A Personalized Agent Framework via A2C Reinforcement Learningcited by 1
- 2025Following the TRACE: A Structured Path to Empathetic Response Generation with Multi-Agent Modelscited by 0
- 2025Following the TRACE: A Structured Path to Empathetic Response Generation with Multi-Agent Models26 Sep 2025
- 2025Continuous Learning Conversational AI: A Personalized Agent Framework via A2C Reinforcement Learning18 Feb 2025
- 2024Characteristic AI Agents via Large Language Models19 Mar 2024
- 2023Multi-Party Chat: Conversational Agents in Group Settings with Humans and Models26 Apr 2023
- 2021Hierarchical Transformer-based Large-Context End-to-end ASR with Large-Context Knowledge Distillationcited by 12
- 2023Strategize Before Teaching: A Conversational Tutoring System with Pedagogy Self-Distillationcited by 11
- 2023Continual Learning with Dirichlet Generative-based Rehearsalcited by 7
- 2021Multi-View Feature Representation for Dialogue Generation with Bidirectional Distillationcited by 5
- 2023Continual Learning with Dirichlet Generative-based Rehearsal13 Sep 2023
- 2023Strategize Before Teaching: A Conversational Tutoring System with Pedagogy Self-Distillation27 Feb 2023
- 2021Multi-View Feature Representation for Dialogue Generation with Bidirectional Distillation22 Feb 2021
- 2021Hierarchical Transformer-based Large-Context End-to-end ASR with Large-Context Knowledge Distillation16 Feb 2021
- 2019Way Off-Policy Batch Deep Reinforcement Learning of Implicit Human Preferences in Dialogcited by 284
- 2020Human-centric Dialog Training via Offline Reinforcement Learningcited by 93
- 2018Dialogue Generation: From Imitation Learning to Inverse Reinforcement Learningcited by 21
- 2025Limitation Learning: Catching Adverse Dialog with GAILcited by 0
- 2025Limitation Learning: Catching Adverse Dialog with GAIL15 Aug 2025
- 2020Human-centric Dialog Training via Offline Reinforcement Learning12 Oct 2020
- 2019Way Off-Policy Batch Deep Reinforcement Learning of Implicit Human Preferences in Dialog30 Jun 2019
- 2018Dialogue Generation: From Imitation Learning to Inverse Reinforcement Learning9 Dec 2018
- 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systemscited by 170
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
- 2022Why Exposure Bias Matters: An Imitation Learning Perspective of Error Accumulation in Language Generationcited by 108
- 2021Neural Path Hunter: Reducing Hallucination in Dialogue Systems via Path Groundingcited by 106
- 2023On the Possibilities of AI-Generated Text Detectioncited by 88
- 2021Anticipating Safety Issues in E2E Conversational AI: Framework and Toolingcited by 78
- 2025A Survey of Personalized Large Language Models: Progress and Future Directionscited by 71
- 2022MMDialog: A Large-scale Multi-turn Dialogue Dataset Towards Multi-modal Open-domain Conversationcited by 56
- 2022Less is More: Learning to Refine Dialogue History for Personalized Dialogue Generationcited by 47
- 2021Conversations Are Not Flat: Modeling the Dynamic Information Flow across Dialogue Utterancescited by 40
- 2021One Chatbot Per Person: Creating Personalized Chatbots based on Implicit User Profilescited by 39
- 2021MPC-BERT: A Pre-Trained Language Model for Multi-Party Conversation Understandingcited by 36
12 most cited of 187 All 187 (JSON)
- 2026Multi-turn Conversational AI from Text to Multimodal Interaction: Data, Models, Evaluation, and Open Challenges18 Aug 2026
- 2026POS-ISP: Pipeline Optimization at the Sequence Level for Task-aware ISP8 Apr 2026
- 2025IMDMR: An Intelligent Multi-Dimensional Memory Retrieval System for Enhanced Conversational AI10 Sep 2025
- 2025Chat-Ghosting: A Comparative Study of Methods for Auto-Completion in Dialog Systems8 Jul 2025
- 2025StorySage: Conversational Autobiography Writing Powered by a Multi-Agent Framework17 Jun 2025
- 2025Post Persona Alignment for Multi-Session Dialogue Generation13 Jun 2025
- 2025MEDAL: A Framework for Benchmarking LLMs as Multilingual Open-Domain Dialogue Evaluators28 May 2025
- 2025How Managers Perceive AI-Assisted Conversational Training for Workplace Communication20 May 2025
- 2025SALMONN-omni: A Standalone Speech LLM without Codec Injection for Full-duplex Conversation17 May 2025
- 2025OpeNLGauge: An Explainable Metric for NLG Evaluation with Open-Weights LLMs14 Mar 2025
- 2025A Survey of Personalized Large Language Models: Progress and Future Directions17 Feb 2025
- 2024From Intents to Conversations: Generating Intent-Driven Dialogues with Contrastive Learning for Multi-Turn Classification21 Nov 2024
12 newest of 187 All 187 (JSON)