Learning Discourse-level Diversity for Neural Dialog Models using Conditional Variational Autoencoders
Not on the map. Why?
Abstract (arXiv)
While recent neural encoder-decoder models have shown great promise in modeling open-domain conversations, they often generate dull and generic responses. Unlike past work that has focused on diversifying the output of the decoder at word-level to alleviate this problem, we present a novel framework based on conditional variational autoencoders that captures the discourse-level diversity in the encoder. Our model uses latent variables to learn a distribution over potential conversational intents and generates diverse responses using only greedy decoders. We have further developed a novel variant that is integrated with linguistic prior knowledge for better performance. Finally, the training procedure is improved by introducing a bag-of-word loss. Our proposed models have been validated to generate significantly more diverse responses than baseline approaches and exhibit competence in discourse-level decision-making.
Key facts. Cited by 222 papers in the map (data through 7 Oct 2026). First posted on arXiv 31 Mar 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 56; 2022: 74; 2023: 38; 2024: 32; 2025: 10; 2026: 11.
222 papers.
Sort:
By area:
- 2022DiffuSeq: Sequence to Sequence Text Generation with Diffusion Modelscited by 439
- 2022Long Time No See! Open-Domain Conversation with Long-Term Persona Memorycited by 107
- 2021A Comprehensive Assessment of Dialog Evaluation Metricscited by 90
- 2022MISC: A MIxed Strategy-Aware Model Integrating COMET for Emotional Support Conversationcited by 84
- 2021Machine Translationese: Effects of Algorithmic Bias on Linguistic Complexity in Machine Translationcited by 70
- 2020Dialogue Response Ranking Training with Large-Scale Human Feedback Datacited by 68
- 2022Latent Diffusion Energy-Based Model for Interpretable Text Modelingcited by 67
- 2021OpenMEVA: A Benchmark for Evaluating Open-ended Story Generation Metricscited by 61
- 2021IndoNLG: Benchmark and Resources for Evaluating Indonesian Natural Language Generationcited by 57
- 2023CAMS: CAnonicalized Manipulation Spaces for Category-Level Functional Hand-Object Manipulation Synthesiscited by 54
- 2022Less is More: Learning to Refine Dialogue History for Personalized Dialogue Generationcited by 47
- 2021Transformer-based Conditional Variational Autoencoder for Controllable Story Generationcited by 44
38 more
- 2021Generate, Prune, Select: A Pipeline for Counterspeech Generation against Online Hate Speechcited by 42
- 2021Probabilistic Modeling of Semantic Ambiguity for Scene Graph Generationcited by 35
- 2022DialogVED: A Pre-trained Latent Variable Encoder-Decoder Model for Dialog Response Generationcited by 35
- 2024MathVC: An LLM-Simulated Multi-Character Virtual Classroom for Mathematics Educationcited by 35
- 2021Multimodal Dialogue Response Generationcited by 32
- 2022Rethinking and Refining the Distinct Metriccited by 27
- 2021Think Before You Speak: Explicitly Generating Implicit Commonsense Knowledge for Response Generationcited by 26
- 2021Diversifying Dialog Generation via Adaptive Label Smoothingcited by 25
- 2021LOT: A Story-Centric Benchmark for Evaluating Chinese Long Text Understanding and Generationcited by 24
- 2022GLENet: Boosting 3D Object Detectors with Generative Label Uncertainty Estimationcited by 24
- 2023Enhancing Personalized Dialogue Generation with Contrastive Latent Variables: Combining Sparse and Dense Personacited by 24
- 2022Reflect, Not Reflex: Inference-Based Common Ground Improves Dialogue Response Qualitycited by 22
- 2023An Overview on Language Models: Recent Developments and Outlookcited by 22
- 2022COSPLAY: Concept Set Guided Personalized Dialogue Generation Across Both Party Personascited by 20
- 2022Fuse It More Deeply! A Variational Transformer with Layer-Wise Latent Variable Inference for Text Generationcited by 20
- 2021Investigating Robustness of Dialog Models to Popular Figurative Language Constructscited by 19
- 2022A Personalized Dialogue Generator with Implicit User Persona Detectioncited by 19
- 2024Recent Trends in Personalized Dialogue Generation: A Review of Datasets, Methodologies, and Evaluationscited by 19
- 2025Goal Alignment in LLM-Based User Simulators for Conversational AIcited by 19
- 2021Generating Relevant and Coherent Dialogue Responses using Self-separated Conditional Variational AutoEncoderscited by 18
- 2021Modeling Bilingual Conversational Characteristics for Neural Chat Translationcited by 18
- 2022Language modeling via stochastic processescited by 18
- 2022A Variational Hierarchical Model for Neural Cross-Lingual Summarizationcited by 17
- 2022Improving Personality Consistency in Conversation by Persona Extendingcited by 17
- 2023Learning to Memorize Entailment and Discourse Relations for Persona-Consistent Dialoguescited by 17
- 2021Learning to Select External Knowledge with Multi-Scale Negative Samplingcited by 16
- 2021Assessing Dialogue Systems with Distribution Distancescited by 16
- 2021GTM: A Generative Triple-Wise Model for Conversational Question Generationcited by 16
- 2021OpenViDial 2.0: A Larger-Scale, Open-Domain Dialogue Generation Dataset with Visual Contextscited by 16
- 2022A Corpus for Understanding and Generating Moral Storiescited by 16
- 2022Measuring and Improving Semantic Diversity of Dialogue Generationcited by 16
- 2021Automatically Select Emotion for Response via Personality-affected Emotion Transitioncited by 15
- 2021Identifying Untrustworthy Samples: Data Filtering for Open-domain Dialogues with Bayesian Optimizationcited by 15
- 2024SciDoc2Diagrammer-MAF: Towards Generation of Scientific Diagrams from Documents guided by Multi-Aspect Feedback Refinementcited by 15
- 2021KECRS: Towards Knowledge-Enriched Conversational Recommendation Systemcited by 14
- 2021Latent Space Energy-Based Model of Symbol-Vector Coupling for Text Generation and Classificationcited by 14
- 2021DiscoDVT: Generating Long Text with Discourse-Aware Discrete Variational Transformercited by 14
- 2022Improving Contextual Coherence in Variational Personalized and Empathetic Dialogue Agentscited by 14
50 most cited of 222 All 222 (JSON)
- 2026Mixture of Decoders for Diverse Dialog Response Generation30 Sep 2026
- 2026Uncovering Latent Reasoning Strategies in Language Models20 Jul 2026
- 2026Variational Inference for Bird's Eye View Segmentation in Autonomous Driving16 Jul 2026
- 2026Generative Bayesian Filtering for State Estimation9 Jul 2026
- 2026ECoSim: Data Efficient Fine-Tuning for Controllable Traffic Simulation1 Jul 2026
- 2026Multimodal Continuous Reasoning via Asymmetric Mutual Variational Learning1 Jul 2026
- 2026Semantic Flow Regularization: Teaching LLMs to Generate Diverse Yet Coherent Responses27 May 2026
- 2026Annotations Mitigate Post-Training Mode Collapse11 May 2026
- 2026Transition-Matrix Regularization for Next Dialogue Act Prediction in Counselling Conversations20 Apr 2026
- 2026ORACLE: Orchestrate NPC Daily Activities using Contrastive Learning with Transformer-CVAE25 Mar 2026
- 2026UpSkill: Mutual Information Skill Learning for Structured Response Diversity in LLMs25 Feb 2026
- 2025AI-in-the-Loop: Privacy Preserving Real-Time Scam Detection and Conversational Scambaiting by Leveraging LLMs and Federated Learning4 Sep 2025
38 more
- 2025Goal Alignment in LLM-Based User Simulators for Conversational AI27 Jul 2025
- 2025Chat-Ghosting: A Comparative Study of Methods for Auto-Completion in Dialog Systems8 Jul 2025
- 2025Modeling the One-to-Many Property in Open-Domain Dialogue with LLMs18 Jun 2025
- 2025When Humans Growl and Birds Speak: High-Fidelity Voice Conversion from Human to Animal and Designed Sounds30 May 2025
- 2025Latent Preference Coding: Aligning Large Language Models via Discrete Latent Codes8 May 2025
- 2025Att-Adapter: A Robust and Precise Domain-Specific Multi-Attributes T2I Diffusion Adapter via Conditional Variational Autoencoder15 Mar 2025
- 2025OpeNLGauge: An Explainable Metric for NLG Evaluation with Open-Weights LLMs14 Mar 2025
- 2025LACTOSE: Linear Array of Conditions, TOpologies with Separated Error-backpropagation -- The Differentiable "IF" Conditional for Differentiable Digital Signal Processing20 Feb 2025
- 2025A Diversity-Enhanced Knowledge Distillation Model for Practical Math Word Problem Solving7 Jan 2025
- 2024Disentangling Preference Representation and Text Generation for Efficient Individual Preference Alignment30 Dec 2024
- 2024Simulation-Free Hierarchical Latent Policy Planning for Proactive Dialogues19 Dec 2024
- 2024Unstructured Text Enhanced Open-domain Dialogue System: A Systematic Survey14 Nov 2024
- 2024Prove Your Point!: Bringing Proof-Enhancement Principles to Argumentative Essay Generation30 Oct 2024
- 2024A Static and Dynamic Attention Framework for Multi Turn Dialogue Generation28 Oct 2024
- 2024SciDoc2Diagrammer-MAF: Towards Generation of Scientific Diagrams from Documents guided by Multi-Aspect Feedback Refinement28 Sep 2024
- 2024DIVE: Towards Descriptive and Diverse Visual Commonsense Generation15 Aug 2024
- 2024MORPHEUS: Modeling Role from Personalized Dialogue History by Exploring and Utilizing Latent Space2 Jul 2024
- 2024Language Portability Strategies for Open-domain Dialogue with Pre-trained Language Models from High to Low Resource Languages1 Jul 2024
- 2024Leveraging LLMs for Dialogue Quality Measurement25 Jun 2024
- 2024CausalScore: An Automatic Reference-Free Metric for Assessing Response Relevance in Open-Domain Dialogue Systems25 Jun 2024
- 2024AutoPal: Autonomous Adaptation to Users for Personal AI Companionship20 Jun 2024
- 2024ComperDial: Commonsense Persona-grounded Dialogue Dataset and Benchmark17 Jun 2024
- 2024DenoiseRep: Denoising Model for Representation Learning13 Jun 2024
- 2024Recent Trends in Personalized Dialogue Generation: A Review of Datasets, Methodologies, and Evaluations28 May 2024
- 2024Rumor Detection on Social Media with Reinforcement Learning-based Key Propagation Graph Generator21 May 2024
- 2024FuXi-ENS: A machine learning model for medium-range ensemble weather forecasting9 May 2024
- 2024It Couldn't Help But Overhear: On the Limits of Modelling Meta-Communicative Grounding Acts with Supervised Learning2 May 2024
- 2024Sentiment-oriented Transformer-based Variational Autoencoder Network for Live Video Commenting19 Apr 2024
- 2024DiffusionDialog: A Diffusion Model for Diverse Dialog Generation with Latent Space10 Apr 2024
- 2024MathVC: An LLM-Simulated Multi-Character Virtual Classroom for Mathematics Education10 Apr 2024
- 2024Personality-affected Emotion Generation in Dialog Systems3 Apr 2024
- 2024Conditional Pseudo-Reversible Normalizing Flow for Surrogate Modeling in Quantifying Uncertainty Propagation31 Mar 2024
- 2024Causal Inference for Human-Language Model Collaboration30 Mar 2024
- 2024Using Domain Knowledge to Guide Dialog Structure Induction via Neural Probabilistic Soft Logic26 Mar 2024
- 2024Multi-party Response Generation with Relation Disentanglement16 Mar 2024
- 2024A Logical Pattern Memory Pre-trained Model for Entailment Tree Generation11 Mar 2024
- 2024MP2D: An Automated Topic Shift Dialogue Generation Framework Leveraging Knowledge Graphs9 Mar 2024
- 2024"In Dialogues We Learn": Towards Personalized Dialogue Without Pre-defined Profiles through In-Dialogue Learning5 Mar 2024
50 newest of 222 All 222 (JSON)
- 2022DiffuSeq: Sequence to Sequence Text Generation with Diffusion Modelscited by 439
- 2022Latent Diffusion Energy-Based Model for Interpretable Text Modelingcited by 67
- 2024DiffusionDialog: A Diffusion Model for Diverse Dialog Generation with Latent Spacecited by 6
- 2023RADiff: Controllable Diffusion Models for Radio Astronomical Maps Generationcited by 2
- 2023Dior-CVAE: Pre-trained Language Models and Diffusion Priors for Variational Dialog Generationcited by 0
- 2025Att-Adapter: A Robust and Precise Domain-Specific Multi-Attributes T2I Diffusion Adapter via Conditional Variational Autoencodercited by 0
- 2026Semantic Flow Regularization: Teaching LLMs to Generate Diverse Yet Coherent Responsescited by 0
- 2026Semantic Flow Regularization: Teaching LLMs to Generate Diverse Yet Coherent Responses27 May 2026
- 2025Att-Adapter: A Robust and Precise Domain-Specific Multi-Attributes T2I Diffusion Adapter via Conditional Variational Autoencoder15 Mar 2025
- 2024DiffusionDialog: A Diffusion Model for Diverse Dialog Generation with Latent Space10 Apr 2024
- 2023RADiff: Controllable Diffusion Models for Radio Astronomical Maps Generation5 Jul 2023
- 2023Dior-CVAE: Pre-trained Language Models and Diffusion Priors for Variational Dialog Generation24 May 2023
- 2022DiffuSeq: Sequence to Sequence Text Generation with Diffusion Models17 Oct 2022
- 2022Latent Diffusion Energy-Based Model for Interpretable Text Modeling13 Jun 2022
- 2022Collaborative Reasoning on Multi-Modal Semantic Graphs for Video-Grounded Dialogue Generationcited by 3
- 2026UpSkill: Mutual Information Skill Learning for Structured Response Diversity in LLMscited by 1
- 2026Multimodal Continuous Reasoning via Asymmetric Mutual Variational Learningcited by 1
- 2026Uncovering Latent Reasoning Strategies in Language Modelscited by 0
- 2026Uncovering Latent Reasoning Strategies in Language Models20 Jul 2026
- 2026Multimodal Continuous Reasoning via Asymmetric Mutual Variational Learning1 Jul 2026
- 2026UpSkill: Mutual Information Skill Learning for Structured Response Diversity in LLMs25 Feb 2026
- 2022Collaborative Reasoning on Multi-Modal Semantic Graphs for Video-Grounded Dialogue Generation22 Oct 2022
- 2020Dialogue Response Ranking Training with Large-Scale Human Feedback Datacited by 68
- 2025Latent Preference Coding: Aligning Large Language Models via Discrete Latent Codescited by 7
- 2024Disentangling Preference Representation and Text Generation for Efficient Individual Preference Alignmentcited by 4
- 2025Latent Preference Coding: Aligning Large Language Models via Discrete Latent Codes8 May 2025
- 2024Disentangling Preference Representation and Text Generation for Efficient Individual Preference Alignment30 Dec 2024
- 2020Dialogue Response Ranking Training with Large-Scale Human Feedback Data15 Sep 2020
- 2022Long Time No See! Open-Domain Conversation with Long-Term Persona Memorycited by 107
- 2021A Comprehensive Assessment of Dialog Evaluation Metricscited by 90
- 2022MISC: A MIxed Strategy-Aware Model Integrating COMET for Emotional Support Conversationcited by 84
- 2021Machine Translationese: Effects of Algorithmic Bias on Linguistic Complexity in Machine Translationcited by 70
- 2021OpenMEVA: A Benchmark for Evaluating Open-ended Story Generation Metricscited by 61
- 2021IndoNLG: Benchmark and Resources for Evaluating Indonesian Natural Language Generationcited by 57
- 2023CAMS: CAnonicalized Manipulation Spaces for Category-Level Functional Hand-Object Manipulation Synthesiscited by 54
- 2022Less is More: Learning to Refine Dialogue History for Personalized Dialogue Generationcited by 47
- 2021Transformer-based Conditional Variational Autoencoder for Controllable Story Generationcited by 44
- 2021Generate, Prune, Select: A Pipeline for Counterspeech Generation against Online Hate Speechcited by 42
- 2021Probabilistic Modeling of Semantic Ambiguity for Scene Graph Generationcited by 35
- 2022DialogVED: A Pre-trained Latent Variable Encoder-Decoder Model for Dialog Response Generationcited by 35
12 most cited of 207 All 207 (JSON)
- 2026Mixture of Decoders for Diverse Dialog Response Generation30 Sep 2026
- 2026Variational Inference for Bird's Eye View Segmentation in Autonomous Driving16 Jul 2026
- 2026Generative Bayesian Filtering for State Estimation9 Jul 2026
- 2026ECoSim: Data Efficient Fine-Tuning for Controllable Traffic Simulation1 Jul 2026
- 2026Annotations Mitigate Post-Training Mode Collapse11 May 2026
- 2026Transition-Matrix Regularization for Next Dialogue Act Prediction in Counselling Conversations20 Apr 2026
- 2026ORACLE: Orchestrate NPC Daily Activities using Contrastive Learning with Transformer-CVAE25 Mar 2026
- 2025AI-in-the-Loop: Privacy Preserving Real-Time Scam Detection and Conversational Scambaiting by Leveraging LLMs and Federated Learning4 Sep 2025
- 2025Goal Alignment in LLM-Based User Simulators for Conversational AI27 Jul 2025
- 2025Chat-Ghosting: A Comparative Study of Methods for Auto-Completion in Dialog Systems8 Jul 2025
- 2025Modeling the One-to-Many Property in Open-Domain Dialogue with LLMs18 Jun 2025
- 2025When Humans Growl and Birds Speak: High-Fidelity Voice Conversion from Human to Animal and Designed Sounds30 May 2025
12 newest of 207 All 207 (JSON)