mlsanityData to 7 Oct 2026

A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systems

arXiv 2402.18013 ↗First posted 28 Feb 2024cs.CL cs.AIcited by 170

Not on the map. Why?

Cited by 36 in LLM agents and tool use, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

This survey provides a comprehensive review of research on multi-turn dialogue systems, with a particular focus on multi-turn dialogue systems based on large language models (LLMs). This paper aims to (a) give a summary of existing LLMs and approaches for adapting LLMs to downstream tasks; (b) elaborate recent advances in multi-turn dialogue systems, covering both LLM-based open-domain dialogue (ODD) and task-oriented dialogue (TOD) systems, along with datasets and evaluation metrics; (c) discuss some future emphasis and recent research problems arising from the development of LLMs and the increasing demands on multi-turn dialogue systems.

Key facts. Cited by 170 papers in the map (data through 7 Oct 2026). Builds on 158 of its 204 references that are in the map. First posted on arXiv 28 Feb 2024.

Builds on

158 of 204 references.

References · 158

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2022Training language models to follow instructions with human feedbackcited by 15,712
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  6. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  7. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  8. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  9. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  10. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  11. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  12. 2020Scaling Laws for Neural Language Modelscited by 6,411
38 more
  1. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  2. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  3. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  4. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
  5. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  6. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  7. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  8. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
  9. 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
  10. 2022Training Compute-Optimal Large Language Modelscited by 2,927
  11. 2023A Survey of Large Language Modelscited by 2,537
  12. 2022Emergent Abilities of Large Language Modelscited by 2,483
  13. 2023Code Llama: Open Foundation Models for Codecited by 2,105
  14. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
  15. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  16. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,397
  17. 2021Improving language models by retrieving from trillions of tokenscited by 1,278
  18. 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,255
  19. 2023AWQ: Activation-aware Weight Quantization for LLM Compression and Accelerationcited by 1,234
  20. 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
  21. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
  22. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,203
  23. 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,199
  24. 2021What Makes Good In-Context Examples for GPT-3?cited by 1,184
  25. 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,143
  26. 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,122
  27. 2015A Diversity-Promoting Objective Function for Neural Conversation Modelscited by 1,068
  28. 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,026
  29. 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 934
  30. 2023ChatDev: Communicative Agents for Software Developmentcited by 893
  31. 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 837
  32. 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 820
  33. 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 760
  34. 2023Multimodal Chain-of-Thought Reasoning in Language Modelscited by 740
  35. 2021GPT Understands, Toocited by 715
  36. 2019Latent Retrieval for Weakly Supervised Open Domain Question Answeringcited by 691
  37. 2021P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Taskscited by 686
  38. 2022Automatic Chain of Thought Prompting in Large Language Modelscited by 684

50 most cited of 158 All 158 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 22; 2025: 90; 2026: 58.

170 papers.

Sort:

By area:

  1. 2024Ada-KV: Optimizing KV Cache Eviction by Adaptive Budget Allocation for Efficient LLM Inferencecited by 230
  2. 2024Know Your Limits: A Survey of Abstention in Large Language Modelscited by 116
  3. 2024Not All Heads Matter: A Head-Level KV Cache Compression Method with Integrated Retrieval and Reasoningcited by 96
  4. 2024Large Language Models for Cyber Security: A Systematic Literature Reviewcited by 65
  5. 2025Hierarchical Memory for High-Efficiency Long-Term Reasoning in LLM Agentscited by 60
  6. 2025Evaluating LLM-based Agents for Multi-Turn Conversations: A Surveycited by 56
  7. 2024HelloBench: Evaluating Long Text Generation Capabilities of Large Language Modelscited by 42
  8. 2025Implicit Reasoning in Large Language Models: A Comprehensive Surveycited by 42
  9. 2025Understanding the Information Propagation Effects of Communication Topologies in LLM-based Multi-Agent Systemscited by 39
  10. 2025A Survey of Direct Preference Optimizationcited by 35
  11. 2025The Homogenizing Effect of Large Language Models on Human Expression and Thoughtcited by 35
  12. 2025CriticalKV: Optimizing KV Cache Eviction from an Output Perturbation Perspectivecited by 28
38 more
  1. 2025A Survey on Parallel Text Generation: From Parallel Decoding to Diffusion Language Modelscited by 27
  2. 2024A Survey on Recent Advances in Conversational Data Generationcited by 23
  3. 2025Sotopia-RL: Reward Design for Social Intelligencecited by 20
  4. 2024Teaching Models to Balance Resisting and Accepting Persuasioncited by 19
  5. 2024BudgetMLAgent: A Cost-Effective LLM Multi-Agent system for Automating Machine Learning Taskscited by 19
  6. 2025LexRAG: Benchmarking Retrieval-Augmented Generation in Multi-Turn Legal Consultation Conversationcited by 19
  7. 2025A Personalized Conversational Benchmark: Towards Simulating Personalized Conversationscited by 16
  8. 2026Evaluating Long-Horizon Memory for Multi-Party Collaborative Dialoguescited by 16
  9. 2026G-Zero: Self-Play for Open-Ended Generation from Zero Datacited by 15
  10. 2025Autoencoding-Free Context Compression for LLMs via Contextual Semantic Anchorscited by 14
  11. 2025Taming the Fragility of KV Cache Eviction in LLM Inferencecited by 14
  12. 2025AutoForge: Automated Environment Synthesis for Agentic Reinforcement Learningcited by 14
  13. 2024PSLM: Parallel Generation of Text and Speech with LLMs for Low-Latency Spoken Dialogue Systemscited by 13
  14. 2025FastKV: Decoupling of Context Reduction and KV Cache Compression for Prefill-Decoding Accelerationcited by 13
  15. 2025LogitSpec: Accelerating Retrieval-based Speculative Decoding via Next Next Token Speculationcited by 13
  16. 2025Firm or Fickle? Evaluating Large Language Models Consistency in Sequential Interactionscited by 12
  17. 2025ClarifyMT-Bench: Benchmarking and Improving Multi-Turn Clarification for Conversational Large Language Modelscited by 12
  18. 2026Confidence Estimation for LLMs in Multi-turn Interactionscited by 12
  19. 2024ChatSOP: An SOP-Guided MCTS Planning Framework for Controllable LLM Dialogue Agentscited by 11
  20. 2025Improving LLM Reasoning through Interpretable Role-Playing Steeringcited by 11
  21. 2025FinResearchBench: A Logic Tree based Agent-as-a-Judge Evaluation Framework for Financial Research Agentscited by 11
  22. 2024ProductAgent: Benchmarking Conversational Product Search Agent with Asking Clarification Questionscited by 10
  23. 2025Leveraging Dual Process Theory in Language Agent Framework for Real-time Simultaneous Human-AI Collaborationcited by 10
  24. 2025A Survey of Scaling in Large Language Model Reasoningcited by 10
  25. 2025Revisiting Compositional Generalization Capability of Large Language Models Considering Instruction Following Abilitycited by 10
  26. 2025Too Good to be Bad: On the Failure of LLMs to Role-Play Villainscited by 10
  27. 2026The Five Ws of Multi-Agent Communication: Who Talks to Whom, When, What, and Why -- A Survey from MARL to Emergent Language and LLMscited by 10
  28. 2025Follow-up Question Generation For Enhanced Patient-Provider Conversationscited by 9
  29. 2025Toward Safe and Human-Aligned Game Conversational Recommendation via Multi-Agent Decompositioncited by 9
  30. 2025Evaluating the Sensitivity of LLMs to Prior Contextcited by 9
  31. 2025AutoTool: Efficient Tool Selection for Large Language Model Agentscited by 9
  32. 2024ELLMA-T: an Embodied LLM-agent for Supporting English Language Learning in Social VRcited by 8
  33. 2024Length Controlled Generation for Black-box LLMscited by 8
  34. 2025ZSMerge: Zero-Shot KV Cache Compression for Memory-Efficient Long-Context LLMscited by 8
  35. 2025BadMoE: Backdooring Mixture-of-Experts LLMs via Optimizing Routing Triggers and Infecting Dormant Expertscited by 8
  36. 2025MITS: Enhanced Tree Search Reasoning for LLMs via Pointwise Mutual Informationcited by 8
  37. 2025Simulating Viva Voce Examinations to Evaluate Clinical Reasoning in Large Language Modelscited by 8
  38. 2024Style-Talker: Finetuning Audio Language Model and Style-Based Text-to-Speech Model for Fast Spoken Dialogue Generationcited by 7

50 most cited of 170 All 170 (JSON)