mlsanityData to 14 Oct 2026

From Intents to Conversations: Generating Intent-Driven Dialogues with Contrastive Learning for Multi-Turn Classification

arXiv 2411.14252 ↗First posted 21 Nov 2024cs.CL cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

In conversational AI systems, a critical challenge in training effective multi-turn intent classification models lies in the generation of large-scale, domain-specific, multilingual dialogue datasets. In this paper, we introduce Chain-of-Intent, a novel framework that integrates Hidden Markov Models (HMMs) with Large Language Models (LLMs) to generate intent-driven, context-aware dialogues through self-play. Our method first extracts domain-specific intent transition patterns from real-world e-commerce chat logs, which guide the modeling of turn-level dynamics and intent sequences. LLMs are then employed to parameterize the emission probabilities of HMMs, enabling the generation of natural, coherent utterances aligned with predicted intents and dialogue context. We also propose MINT-CL, a multi-task contrastive learning framework for multi-turn intent classification, which improves performance while reducing dependence on large-scale annotated datasets. Empirical results demonstrate that our approach outperforms competitive baselines in dialogue generation quality and classification accuracy, particularly in multilingual settings. To facilitate future research, we release MINT-E, a comprehensive, multilingual, intent-aware multi-turn dialogue corpus derived from the e-commerce domainfootnoteThe reproduced source code and dataset are available at https://github.com/junhua/chain-of-intent.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 42 of its 72 references that are in the map. First posted on arXiv 21 Nov 2024.

Builds on

42 of 72 references.

References · 42

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
  4. 2015A Diversity-Promoting Objective Function for Neural Conversation Modelscited by 1,077
  5. 2023Enhancing Chat Language Models by Scaling High-quality Instructional Conversationscited by 839
  6. 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 828
  7. 2017An Overview of Multi-Task Learning in Deep Neural Networkscited by 803
  8. 2019An Evaluation Dataset for Intent Classification and Out-of-Scope Predictioncited by 386
  9. 2015Building End-To-End Dialogue Systems Using Generative Hierarchical Neural Network Modelscited by 207
  10. 2016A Hierarchical Latent Variable Encoder-Decoder Model for Generating Dialoguescited by 174
  11. 2017Emotional Chatting Machine: Emotional Conversation Generation with Internal and External Memorycited by 167
  12. 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
30 more
  1. 2020A Survey of Knowledge-Enhanced Text Generationcited by 120
  2. 2018Mem2Seq: Effectively Incorporating Knowledge Bases into End-to-End Task-Oriented Dialog Systemscited by 70
  3. 2020Dialogue Response Ranking Training with Large-Scale Human Feedback Datacited by 68
  4. 2023Is ChatGPT Equipped with Emotional Dialogue Capabilities?cited by 54
  5. 2019The JDDC Corpus: A Large-Scale Multi-Turn Chinese Dialogue Dataset for E-commerce Customer Servicecited by 47
  6. 2018Analyzing and Characterizing User Intent in Information-seeking Conversationscited by 36
  7. 2021Transferable Dialogue Systems and User Simulatorscited by 36
  8. 2023PlatoLM: Teaching LLMs in Multi-Round Dialogue via a User Simulatorcited by 29
  9. 2019A Survey of Natural Language Generation Techniques with a Focus on Dialogue Systems - Past, Present and Future Directionscited by 26
  10. 2020Multi-Domain Dialogue Acts and Response Co-Generationcited by 26
  11. 2024A Survey on Recent Advances in Conversational Data Generationcited by 23
  12. 2022User Satisfaction Estimation with Sequential Dialogue Act Modeling in Goal-oriented Conversational Systemscited by 20
  13. 2019User Intent Prediction in Information-seeking Conversationscited by 19
  14. 2023In-Context Learning User Simulators for Task-Oriented Dialog Systemscited by 19
  15. 2024Self-seeding and Multi-intent Self-instructing LLMs for Generating Intent-aware Information-Seeking dialogscited by 18
  16. 2023HiTIN: Hierarchy-aware Tree Isomorphism Network for Hierarchical Text Classificationcited by 17
  17. 2016Multiresolution Recurrent Neural Networks: An Application to Dialogue Response Generationcited by 16
  18. 2019Improving Knowledge-aware Dialogue Generation via Knowledge Base Question Answeringcited by 15
  19. 2020Modeling Topical Relevance for Multi-Turn Dialogue Generationcited by 15
  20. 2024TeenyTinyLlama: open-source tiny language models trained in Brazilian Portuguesecited by 13
  21. 2024LARA: Linguistic-Adaptive Retrieval-Augmentation for Multi-Turn Intent Classificationcited by 10
  22. 2023DialoGPS: Dialogue Path Sampling in Continuous Semantic Space for Data Augmentation in Multi-Turn Conversationscited by 9
  23. 2021A Context-Aware Hierarchical BERT Fusion Network for Multi-turn Dialog Act Detectioncited by 5
  24. 2019DLGNet: A Transformer-based Model for Dialogue Response Generationcited by 4
  25. 2022Revision for Concision: A Constrained Paraphrase Generation Taskcited by 4
  26. 2023Data Augmentation for Conversational AIcited by 3
  27. 2024Responsible Multilingual Large Language Models: A Survey of Development, Applications, and Societal Impactcited by 3
  28. 2024Balancing Accuracy and Efficiency in Multi-Turn Intent Classification for LLM-Powered Dialog Systems in Productioncited by 3
  29. 2023IntentDial: An Intent Graph based Multi-Turn Dialogue System with Reasoning Path Visualizationcited by 2
  30. 2024Label-Free Topic-Focused Summarization Using Query Augmentationcited by 2

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.