A Hierarchical Latent Variable Encoder-Decoder Model for Generating Dialogues
Not on the map. Why?
Abstract (arXiv)
Sequential data often possesses a hierarchical structure with complex dependencies between subsequences, such as found between the utterances in a dialogue. In an effort to model this kind of generative process, we propose a neural network-based generative architecture, with latent stochastic variables that span a variable number of time steps. We apply the proposed model to the task of dialogue response generation and compare it with recent neural network architectures. We evaluate the model performance through automatic evaluation metrics and by carrying out a human evaluation. The experiments demonstrate that our model improves upon recently proposed models and that the latent variables facilitate the generation of long outputs and maintain the context.
Key facts. Cited by 174 papers in the map (data through 14 Oct 2026). First posted on arXiv 19 May 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2018: 1; 2019: 1; 2020: 1; 2021: 64; 2022: 56; 2023: 29; 2024: 9; 2025: 7; 2026: 6.
174 papers.
Sort:
By area:
- 2019Way Off-Policy Batch Deep Reinforcement Learning of Implicit Human Preferences in Dialogcited by 284
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
- 2020Human-centric Dialog Training via Offline Reinforcement Learningcited by 93
- 2022Latent Diffusion Energy-Based Model for Interpretable Text Modelingcited by 67
- 2021Topic-Driven and Knowledge-Aware Transformer for Dialogue Emotion Detectioncited by 56
- 2021Clockwork Variational Autoencoderscited by 42
- 2021Generate, Prune, Select: A Pipeline for Counterspeech Generation against Online Hate Speechcited by 42
- 2021One Chatbot Per Person: Creating Personalized Chatbots based on Implicit User Profilescited by 39
- 2021Edge-Cloud Polarization and Collaboration: A Comprehensive Survey for AIcited by 39
- 2021MPC-BERT: A Pre-Trained Language Model for Multi-Party Conversation Understandingcited by 36
- 2021CoMPM: Context Modeling with Speaker's Pre-trained Memory Tracking for Emotion Recognition in Conversationcited by 35
- 2022DialogVED: A Pre-trained Latent Variable Encoder-Decoder Model for Dialog Response Generationcited by 35
38 more
- 2023Exploring the Trade-Offs: Unified Large Language Models vs Local Fine-Tuned Models for Highly-Specific Radiology NLI Taskcited by 32
- 2021Semi-Supervised Variational Reasoning for Medical Dialogue Generationcited by 30
- 2021Commonsense-Focused Dialogues for Response Generation: An Empirical Studycited by 30
- 2022User-Centric Conversational Recommendation with Multi-Aspect User Modelingcited by 29
- 2021Think Before You Speak: Explicitly Generating Implicit Commonsense Knowledge for Response Generationcited by 26
- 2021Semantic Representation for Dialogue Modelingcited by 24
- 2022C2-CRS: Coarse-to-Fine Contrastive Learning for Conversational Recommender Systemcited by 24
- 2021Learning Neural Templates for Recommender Dialogue Systemcited by 22
- 2022Reflect, Not Reflex: Inference-Based Common Ground Improves Dialogue Response Qualitycited by 22
- 2022Variational Reasoning over Incomplete Knowledge Graphs for Conversational Recommendationcited by 22
- 2018Dialogue Generation: From Imitation Learning to Inverse Reinforcement Learningcited by 21
- 2021Emotion-aware Chat Machine: Automatic Emotional Response Generation for Human-like Emotional Interactioncited by 21
- 2022Fuse It More Deeply! A Variational Transformer with Layer-Wise Latent Variable Inference for Text Generationcited by 20
- 2023Learning Manifold Dimensions with Conditional Variational Autoencoderscited by 20
- 2021Maria: A Visual Experience Powered Conversational Agentcited by 19
- 2022Why is constrained neural language generation particularly challenging?cited by 19
- 2021Generating Relevant and Coherent Dialogue Responses using Self-separated Conditional Variational AutoEncoderscited by 18
- 2021A Review of Text Style Transfer using Deep Learningcited by 18
- 2022Data-to-text Generation with Variational Sequential Planningcited by 17
- 2022A Variational Hierarchical Model for Neural Cross-Lingual Summarizationcited by 17
- 2021GTM: A Generative Triple-Wise Model for Conversational Question Generationcited by 16
- 2021Synthesizing Adversarial Negative Responses for Robust Response Ranking and Evaluationcited by 16
- 2021OpenViDial 2.0: A Larger-Scale, Open-Domain Dialogue Generation Dataset with Visual Contextscited by 16
- 2022A Mixture-of-Expert Approach to RL-based Dialogue Managementcited by 16
- 2022Measuring and Improving Semantic Diversity of Dialogue Generationcited by 16
- 2021EEGFuseNet: Hybrid Unsupervised Deep Feature Characterization and Fusion for High-Dimensional EEG with An Application to Emotion Recognitioncited by 15
- 2021Partner Matters! An Empirical Study on Fusing Personas for Personalized Response Selection in Retrieval-Based Chatbotscited by 15
- 2021Latent Space Energy-Based Model of Symbol-Vector Coupling for Text Generation and Classificationcited by 15
- 2021Identifying Untrustworthy Samples: Data Filtering for Open-domain Dialogues with Bayesian Optimizationcited by 15
- 2023History-Aware Hierarchical Transformer for Multi-session Open-domain Dialogue Systemcited by 15
- 2023TREA: Tree-Structure Reasoning Schema for Conversational Recommendationcited by 15
- 2021Learning to Select Context in a Hierarchical and Global Perspective for Open-domain Dialogue Generationcited by 14
- 2021Dialogue History Matters! Personalized Response Selectionin Multi-turn Retrieval-based Chatbotscited by 14
- 2021KECRS: Towards Knowledge-Enriched Conversational Recommendation Systemcited by 14
- 2021Unsupervised Enrichment of Persona-grounded Dialog with Background Storiescited by 14
- 2021DiscoDVT: Generating Long Text with Discourse-Aware Discrete Variational Transformercited by 14
- 2021RecInDial: A Unified Framework for Conversational Recommendation with Pretrained Language Modelscited by 14
- 2022Improving Contextual Coherence in Variational Personalized and Empathetic Dialogue Agentscited by 14
50 most cited of 174 All 174 (JSON)
- 2026Mixture of Decoders for Diverse Dialog Response Generation30 Sep 2026
- 2026RPPNet: Perceptually-Grouped Rhythm-Pitch Primitives for Long-Term Structure Melody Generation via Boundary-Aware Modeling22 Jul 2026
- 2026Uncovering Latent Reasoning Strategies in Language Models20 Jul 2026
- 2026Semantic Flow Regularization: Teaching LLMs to Generate Diverse Yet Coherent Responses27 May 2026
- 2026Uncertainty-quantified Pulse Signal Recovery from Facial Video using Regularized Stochastic Interpolants12 Apr 2026
- 2026Molecular Design beyond Training Data with Novel Extended Objective Functionals of Generative AI Models Driven by Quantum Annealing Computer17 Feb 2026
- 2025HAMLET: A Hierarchical and Adaptive Multi-Agent Framework for Live Embodied Theatrics21 Jul 2025
- 2025Chat-Ghosting: A Comparative Study of Methods for Auto-Completion in Dialog Systems8 Jul 2025
- 2025Latent Reasoning via Sentence Embedding Prediction28 May 2025
- 2025OpeNLGauge: An Explainable Metric for NLG Evaluation with Open-Weights LLMs14 Mar 2025
- 2025SAGE: Steering Dialog Generation with Future-Aware State-Action Augmentation4 Mar 2025
- 2025Reference-free Evaluation Metrics for Text Generation: A Survey21 Jan 2025
38 more
- 2025BoK: Introducing Bag-of-Keywords Loss for Interpretable Dialogue Response Generation17 Jan 2025
- 2024From Intents to Conversations: Generating Intent-Driven Dialogues with Contrastive Learning for Multi-Turn Classification21 Nov 2024
- 2024Is Our Chatbot Telling Lies? Assessing Correctness of an LLM-based Dutch Support Chatbot29 Oct 2024
- 2024A Static and Dynamic Attention Framework for Multi Turn Dialogue Generation28 Oct 2024
- 2024Improving Large Language Model (LLM) fidelity through context-aware grounding: A systematic approach to reliability and veracity7 Aug 2024
- 2024Rumor Detection on Social Media with Reinforcement Learning-based Key Propagation Graph Generator21 May 2024
- 2024DiffusionDialog: A Diffusion Model for Diverse Dialog Generation with Latent Space10 Apr 2024
- 2024Multi-party Response Generation with Relation Disentanglement16 Mar 2024
- 2024StreamingDialogue: Prolonged Dialogue Learning via Long Context Compression with Minimal Losses13 Mar 2024
- 2024Crafting a Good Prompt or Providing Exemplary Dialogues? A Study of In-Context Learning for Persona-based Dialogue Generation15 Feb 2024
- 2023Knowledge Graphs and Pre-trained Language Models enhanced Representation Learning for Conversational Recommender Systems18 Dec 2023
- 2023Partially Randomizing Transformer Weights for Dialogue Response Diversity18 Nov 2023
- 2023Boosting Summarization with Normalizing Flows and Aggressive Training1 Nov 2023
- 2023mathbbVD-mathbbGR: Boosting mathbbVisual mathbbDialog with Cascaded Spatial-Temporal Multi-Modal mathbbGRaphs25 Oct 2023
- 2023Multi-turn Dialogue Comprehension from a Topic-aware Perspective18 Sep 2023
- 2023Continual Learning with Dirichlet Generative-based Rehearsal13 Sep 2023
- 2023Unsupervised Text Style Transfer with Deep Generative Models31 Aug 2023
- 2023Investigating and Improving Latent Density Segmentation Models for Aleatoric Uncertainty Quantification in Medical Imaging31 Jul 2023
- 2023TREA: Tree-Structure Reasoning Schema for Conversational Recommendation20 Jul 2023
- 2023Towards a Neural Era in Dialogue Management for Collaboration: A Literature Survey18 Jul 2023
- 2023VOLTA: Improving Generative Diversity by Variational Mutual Information Maximizing Autoencoder3 Jul 2023
- 2023Subject clustering by IF-PCA and several recent methods8 Jun 2023
- 2023Revisiting Conversation Discourse for Dialogue Disentanglement6 Jun 2023
- 2023A Conditional Generative Chatbot using Transformer Model3 Jun 2023
- 2023A Unified Framework for Slot based Response Generation in a Multimodal Dialogue System27 May 2023
- 2023Evaluating Open-Domain Dialogues in Latent Space with Next Sentence Prediction and Mutual Information26 May 2023
- 2023Dior-CVAE: Pre-trained Language Models and Diffusion Priors for Variational Dialog Generation24 May 2023
- 2023Frugal Prompting for Dialog Models24 May 2023
- 2023ReSee: Responding through Seeing Fine-grained Visual Knowledge in Open-domain Dialogue23 May 2023
- 2023Turning Flowchart into Dialog: Augmenting Flowchart-grounded Troubleshooting Dialogs via Synthetic Data Generation2 May 2023
- 2023Exploring the Trade-Offs: Unified Large Language Models vs Local Fine-Tuned Models for Highly-Specific Radiology NLI Task18 Apr 2023
- 2023An Empirical Study of Multitask Learning to Improve Open Domain Dialogue Systems17 Apr 2023
- 2023InterviewBot: Real-Time End-to-End Dialogue System to Interview Students for College Admission27 Mar 2023
- 2023Variational Inference for Longitudinal Data Using Normalizing Flows24 Mar 2023
- 2023Heterogeneous-Branch Collaborative Learning for Dialogue Generation21 Mar 2023
- 2023Tribe or Not? Critical Inspection of Group Differences Using TribalGram16 Mar 2023
- 2023X-ReCoSa: Multi-Scale Context Aggregation For Multi-Turn Dialogue Generation14 Mar 2023
- 2023Learning Manifold Dimensions with Conditional Variational Autoencoders23 Feb 2023
50 newest of 174 All 174 (JSON)
- 2022Latent Diffusion Energy-Based Model for Interpretable Text Modelingcited by 67
- 2024DiffusionDialog: A Diffusion Model for Diverse Dialog Generation with Latent Spacecited by 6
- 2023Dior-CVAE: Pre-trained Language Models and Diffusion Priors for Variational Dialog Generationcited by 0
- 2026Semantic Flow Regularization: Teaching LLMs to Generate Diverse Yet Coherent Responsescited by 0
- 2026Semantic Flow Regularization: Teaching LLMs to Generate Diverse Yet Coherent Responses27 May 2026
- 2024DiffusionDialog: A Diffusion Model for Diverse Dialog Generation with Latent Space10 Apr 2024
- 2023Dior-CVAE: Pre-trained Language Models and Diffusion Priors for Variational Dialog Generation24 May 2023
- 2022Latent Diffusion Energy-Based Model for Interpretable Text Modeling13 Jun 2022
- 2019Way Off-Policy Batch Deep Reinforcement Learning of Implicit Human Preferences in Dialogcited by 284
- 2020Human-centric Dialog Training via Offline Reinforcement Learningcited by 93
- 2018Dialogue Generation: From Imitation Learning to Inverse Reinforcement Learningcited by 21
- 2021Uncertainty Estimation Using Riemannian Model Dynamics for Offline Reinforcement Learningcited by 10
- 2021Uncertainty Estimation Using Riemannian Model Dynamics for Offline Reinforcement Learning22 Feb 2021
- 2020Human-centric Dialog Training via Offline Reinforcement Learning12 Oct 2020
- 2019Way Off-Policy Batch Deep Reinforcement Learning of Implicit Human Preferences in Dialog30 Jun 2019
- 2018Dialogue Generation: From Imitation Learning to Inverse Reinforcement Learning9 Dec 2018
- 2025Latent Reasoning via Sentence Embedding Predictioncited by 1
- 2026Uncovering Latent Reasoning Strategies in Language Modelscited by 0
- 2026Uncovering Latent Reasoning Strategies in Language Models20 Jul 2026
- 2025Latent Reasoning via Sentence Embedding Prediction28 May 2025
- 2022A Mixture-of-Expert Approach to RL-based Dialogue Managementcited by 16
- 2022A Mixture-of-Expert Approach to RL-based Dialogue Management31 May 2022
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
- 2021Topic-Driven and Knowledge-Aware Transformer for Dialogue Emotion Detectioncited by 56
- 2021Clockwork Variational Autoencoderscited by 42
- 2021Generate, Prune, Select: A Pipeline for Counterspeech Generation against Online Hate Speechcited by 42
- 2021One Chatbot Per Person: Creating Personalized Chatbots based on Implicit User Profilescited by 39
- 2021Edge-Cloud Polarization and Collaboration: A Comprehensive Survey for AIcited by 39
- 2021MPC-BERT: A Pre-Trained Language Model for Multi-Party Conversation Understandingcited by 36
- 2021CoMPM: Context Modeling with Speaker's Pre-trained Memory Tracking for Emotion Recognition in Conversationcited by 35
- 2022DialogVED: A Pre-trained Latent Variable Encoder-Decoder Model for Dialog Response Generationcited by 35
- 2023Exploring the Trade-Offs: Unified Large Language Models vs Local Fine-Tuned Models for Highly-Specific Radiology NLI Taskcited by 32
- 2021Semi-Supervised Variational Reasoning for Medical Dialogue Generationcited by 30
- 2021Commonsense-Focused Dialogues for Response Generation: An Empirical Studycited by 30
12 most cited of 158 All 158 (JSON)
- 2026Mixture of Decoders for Diverse Dialog Response Generation30 Sep 2026
- 2026RPPNet: Perceptually-Grouped Rhythm-Pitch Primitives for Long-Term Structure Melody Generation via Boundary-Aware Modeling22 Jul 2026
- 2026Uncertainty-quantified Pulse Signal Recovery from Facial Video using Regularized Stochastic Interpolants12 Apr 2026
- 2026Molecular Design beyond Training Data with Novel Extended Objective Functionals of Generative AI Models Driven by Quantum Annealing Computer17 Feb 2026
- 2025Chat-Ghosting: A Comparative Study of Methods for Auto-Completion in Dialog Systems8 Jul 2025
- 2025OpeNLGauge: An Explainable Metric for NLG Evaluation with Open-Weights LLMs14 Mar 2025
- 2025SAGE: Steering Dialog Generation with Future-Aware State-Action Augmentation4 Mar 2025
- 2025Reference-free Evaluation Metrics for Text Generation: A Survey21 Jan 2025
- 2025BoK: Introducing Bag-of-Keywords Loss for Interpretable Dialogue Response Generation17 Jan 2025
- 2024From Intents to Conversations: Generating Intent-Driven Dialogues with Contrastive Learning for Multi-Turn Classification21 Nov 2024
- 2024Is Our Chatbot Telling Lies? Assessing Correctness of an LLM-based Dutch Support Chatbot29 Oct 2024
- 2024A Static and Dynamic Attention Framework for Multi Turn Dialogue Generation28 Oct 2024
12 newest of 158 All 158 (JSON)