mlsanityData to 7 Oct 2026

PLATO: Pre-trained Dialogue Generation Model with Discrete Latent Variable

arXiv 1910.07931 ↗First posted 17 Oct 2019cs.CLcited by 145

Not on the map. Why?

Abstract (arXiv)

Pre-training models have been proved effective for a wide range of natural language processing tasks. Inspired by this, we propose a novel dialogue generation pre-training framework to support various kinds of conversations, including chit-chat, knowledge grounded dialogues, and conversational question answering. In this framework, we adopt flexible attention mechanisms to fully leverage the bi-directional context and the uni-directional characteristic of language generation. We also introduce discrete latent variables to tackle the inherent one-to-many mapping problem in response generation. Two reciprocal tasks of response generation and latent act recognition are designed and carried out simultaneously within a shared network. Comprehensive experiments on three publicly available datasets verify the effectiveness and superiority of the proposed framework.

Key facts. Cited by 145 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 Oct 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 36; 2022: 48; 2023: 35; 2024: 20; 2025: 4; 2026: 2.

145 papers.

Sort:

By area:

  1. 2021Pre-Trained Models: Past, Present and Futurecited by 319
  2. 2021Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue Systemcited by 139
  3. 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
  4. 2022Pretrained Language Models for Text Generation: A Surveycited by 121
  5. 2023f-Divergence Minimization for Sequence-Level Knowledge Distillationcited by 112
  6. 2023Lift Yourself Up: Retrieval-augmented Text Generation with Self Memorycited by 103
  7. 2021GALAXY: A Generative Pre-trained Model for Task-Oriented Dialog with Semi-Supervised Learning and Explicit Policy Injectioncited by 102
  8. 2021A Comprehensive Assessment of Dialog Evaluation Metricscited by 90
  9. 2021DialogLM: Pre-trained Model for Long Dialogue Understanding and Summarizationcited by 72
  10. 2021Transformer-based Conditional Variational Autoencoder for Controllable Story Generationcited by 44
  11. 2022InstructDial: Improving Zero and Few-shot Generalization in Dialogue through Instruction Tuningcited by 39
  12. 2021PLATO-XL: Exploring the Large-scale Pre-training of Dialogue Generationcited by 37
38 more
  1. 2022DialogVED: A Pre-trained Latent Variable Encoder-Decoder Model for Dialog Response Generationcited by 35
  2. 2022SPACE-3: Unified Dialog Model Pre-training for Task-Oriented Dialog Understanding and Generationcited by 34
  3. 2024Selecting Large Language Model to Fine-tune via Rectified Scaling Lawcited by 33
  4. 2022A Unified Multi-task Learning Framework for Multi-goal Conversational Recommender Systemscited by 32
  5. 2021ProphetNet-X: Large-Scale Pre-training Models for English, Chinese, Multi-lingual, Dialog, and Code Generationcited by 31
  6. 2022EVA2.0: Investigating Open-Domain Chinese Dialogue Systems with Large-Scale Pre-Trainingcited by 31
  7. 2022Faithfulness in Natural Language Generation: A Systematic Survey of Analysis, Evaluation and Optimization Methodscited by 27
  8. 2023CHBias: Bias Evaluation and Mitigation of Chinese Conversational Language Modelscited by 25
  9. 2021Semantic Representation for Dialogue Modelingcited by 24
  10. 2023Enhancing Personalized Dialogue Generation with Contrastive Latent Variables: Combining Sparse and Dense Personacited by 24
  11. 2021Pretraining the Noisy Channel Model for Task-Oriented Dialoguecited by 23
  12. 2021DS-TOD: Efficient Domain Specialization for Task Oriented Dialogcited by 21
  13. 2021NER-BERT: A Pre-trained Model for Low-Resource Entity Taggingcited by 21
  14. 2021Structural Pre-training for Dialogue Comprehensioncited by 20
  15. 2022textitlatent-GLAT: Glancing at Latent Variables for Parallel Text Generationcited by 20
  16. 2021Maria: A Visual Experience Powered Conversational Agentcited by 19
  17. 2021Disentangling Generative Factors in Natural Language with Discrete Variational Autoencoderscited by 19
  18. 2022DialoKG: Knowledge-Structure Aware Task-Oriented Dialogue Generationcited by 19
  19. 2024Recent Trends in Personalized Dialogue Generation: A Review of Datasets, Methodologies, and Evaluationscited by 19
  20. 2024Text Generation: A Systematic Literature Review of Tasks, Evaluation, and Challengescited by 18
  21. 2022Learning Dialogue Representations from Consecutive Utterancescited by 17
  22. 2023Learning to Memorize Entailment and Discourse Relations for Persona-Consistent Dialoguescited by 17
  23. 2021Learning to Select External Knowledge with Multi-Scale Negative Samplingcited by 16
  24. 2021Towards an Online Empathetic Chatbot with Emotion Causescited by 16
  25. 2022Multimodal Conversational AI: A Survey of Datasets and Approachescited by 16
  26. 2022MVP: Multi-task Supervised Pre-training for Natural Language Generationcited by 16
  27. 2022Measuring and Improving Semantic Diversity of Dialogue Generationcited by 16
  28. 2025Adaptive Social Learning via Mode Policy Optimization for Language Agentscited by 15
  29. 2023ChatPLUG: Open-Domain Generative Dialogue System with Internet-Augmented Instruction Tuning for Digital Humancited by 14
  30. 2024Simulation-Free Hierarchical Latent Policy Planning for Proactive Dialoguescited by 14
  31. 2021Variational Latent-State GPT for Semi-Supervised Task-Oriented Dialog Systemscited by 13
  32. 2021A Survey of Natural Language Generationcited by 13
  33. 2023Speech-Text Dialog Pre-training for Spoken Dialog Understanding with Explicit Cross-Modal Alignmentcited by 13
  34. 2022Where to Go for the Holidays: Towards Mixed-Type Dialogs for Clarification of User Goalscited by 12
  35. 2024Outcome-Constrained Large Language Models for Countering Hate Speechcited by 12
  36. 2021Exploring Dense Retrieval for Dialogue Response Selectioncited by 11
  37. 2022An Equal-Size Hard EM Algorithm for Diverse Dialogue Generationcited by 11
  38. 2023SimOAP: Improve Coherence and Consistency in Persona-based Dialogue Generation via Over-sampling and Post-evaluationcited by 11

50 most cited of 145 All 145 (JSON)