# Regularizing Dialogue Generation by Imitating Implicit Scenarios

arXiv: https://arxiv.org/abs/2010.01893 · HTML: https://mlsanity.com/paper/2010.01893/

## Key facts

- Cited by 16 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 5 Oct 2020.

## Built on by (most cited first, 16 of 16)

- [Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Survey](https://mlsanity.com/paper/2105.04387/) (2021)
- [A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need?](https://mlsanity.com/paper/2303.11717/) (2023)
- [Generating Relevant and Coherent Dialogue Responses using Self-separated Conditional Variational AutoEncoders](https://mlsanity.com/paper/2106.03410/) (2021)
- [Probing Product Description Generation via Posterior Distillation](https://mlsanity.com/paper/2103.01594/) (2021)
- [Towards Standard Criteria for human evaluation of Chatbots: A Survey](https://mlsanity.com/paper/2105.11197/) (2021)
- [Multi-View Feature Representation for Dialogue Generation with Bidirectional Distillation](https://mlsanity.com/paper/2102.10780/) (2021)
- [Topic Shift Detection in Chinese Dialogues: Corpus and Benchmark](https://mlsanity.com/paper/2305.01195/) (2023)
- [Hierarchical Inductive Transfer for Continual Dialogue Learning](https://mlsanity.com/paper/2203.10484/) (2022)
- [Stop Filtering: Multi-View Attribute-Enhanced Dialogue Learning](https://mlsanity.com/paper/2205.11206/) (2022)
- [Improved Goal Oriented Dialogue via Utterance Generation and Look Ahead](https://mlsanity.com/paper/2110.12412/) (2021)
- [Modeling Complex Dialogue Mappings via Sentence Semantic Segmentation Guided Conditional Variational Auto-Encoder](https://mlsanity.com/paper/2212.00231/) (2022)
- [Heterogeneous-Branch Collaborative Learning for Dialogue Generation](https://mlsanity.com/paper/2303.11621/) (2023)
- [Transition-Matrix Regularization for Next Dialogue Act Prediction in Counselling Conversations](https://mlsanity.com/paper/2604.18539/) (2026)
- [Precognition in Task-oriented Dialogue Understanding: Posterior Regularization by Future Context](https://mlsanity.com/paper/2203.03244/) (2022)
- [DiQAD: A Benchmark Dataset for End-to-End Open-domain Dialogue Assessment](https://mlsanity.com/paper/2310.16319/) (2023)
- [Bridge the Gap between Past and Future: Siamese Model Optimization for Context-Aware Document Ranking](https://mlsanity.com/paper/2505.14180/) (2025)

## Abstract (arXiv)

Human dialogues are scenario-based and appropriate responses generally relate to the latent context knowledge entailed by the specific scenario. To enable responses that are more meaningful and context-specific, we propose to improve generative dialogue systems from the scenario perspective, where both dialogue history and future conversation are taken into account to implicitly reconstruct the scenario knowledge. More importantly, the conversation scenarios are further internalized using imitation learning framework, where the conventional dialogue model that has no access to future conversations is effectively regularized by transferring the scenario knowledge contained in hierarchical supervising signals from the scenario-based dialogue model, so that the future conversation is not required in actual inference. Extensive evaluations show that our approach significantly outperforms state-of-the-art baselines on diversity and relevance, and expresses scenario-specific knowledge.
