A Survey on Multi-Turn Interaction Capabilities of Large Language Models
Not on the map. Why?
Abstract (arXiv)
Multi-turn interaction in the dialogue system research refers to a system's ability to maintain context across multiple dialogue turns, enabling it to generate coherent and contextually relevant responses. Recent advancements in large language models (LLMs) have significantly expanded the scope of multi-turn interaction, moving beyond chatbots to enable more dynamic agentic interactions with users or environments. In this paper, we provide a focused review of the multi-turn capabilities of LLMs, which are critical for a wide range of downstream applications, including conversational search and recommendation, consultation services, and interactive tutoring. This survey explores four key aspects: (1) the core model capabilities that contribute to effective multi-turn interaction, (2) how multi-turn interaction is evaluated in current practice, (3) the general algorithms used to enhance multi-turn interaction, and (4) potential future directions for research in this field.
Key facts. Cited by 30 papers in the map (data through 14 Oct 2026). First posted on arXiv 17 Jan 2025.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2025: 19; 2026: 11.
30 papers.
Sort:
By area:
- 2025CollabLLM: From Passive Responders to Active Collaboratorscited by 124
- 2025Evaluating LLM-based Agents for Multi-Turn Conversations: A Surveycited by 57
- 2025StoryBench: A Dynamic Benchmark for Evaluating Long-Term Memory with Multi Turnscited by 20
- 2025Autoencoding-Free Context Compression for LLMs via Contextual Semantic Anchorscited by 14
- 2026CM2: Reinforcement Learning with Checklist Rewards for Multi-Turn and Multi-Step Agentic Tool Usecited by 14
- 2025A Simple "Try Again" Can Elicit Multi-Turn LLM Reasoningcited by 11
- 2025Unlocking the Power of Multi-Agent LLM for Reasoning: From Lazy Agents to Deliberationcited by 11
- 2025Charts Are Not Images: On the Challenges of Scientific Chart Editingcited by 11
- 2025Multi-Turn Puzzles: Evaluating Interactive Reasoning and Strategic Dialogue in LLMscited by 10
- 2025A Desideratum for Conversational Agents: Capabilities, Challenges, and Future Directionscited by 9
- 2025Evaluating the Sensitivity of LLMs to Prior Contextcited by 9
- 2025Simulating Viva Voce Examinations to Evaluate Clinical Reasoning in Large Language Modelscited by 9
18 more
- 2025Beyond One-Way Influence: Bidirectional Opinion Dynamics in Multi-Turn Human-LLM Interactionscited by 6
- 2025ImageChain: Advancing Sequential Image-to-Text Reasoning in Multimodal Large Language Modelscited by 4
- 2026Feedback by Design: Understanding and Overcoming User Feedback Barriers in Conversational Agentscited by 4
- 2026State-Dependent Safety Failures in Multi-Turn Language Model Interactioncited by 4
- 2025HCAttention: Extreme KV Cache Compression via Heterogeneous Attention Computing for LLMscited by 3
- 2025Test-Time Policy Adaptation for Enhanced Multi-Turn Interactions with LLMscited by 3
- 2025A Principle-based Framework for the Development and Evaluation of Large Language Models for Health and Wellnesscited by 3
- 2026A Framework for Longitudinal Health AI Agentscited by 3
- 2026Useless but Safe? Benchmarking Utility Recovery with User Intent Clarification in Multi-Turn Conversationscited by 3
- 2026MT-JailBench: A Modular Benchmark for Understanding Multi-Turn Jailbreak Attackscited by 3
- 2025Rethinking Text-to-SQL: Dynamic Multi-turn SQL Interaction for Real-world Database Explorationcited by 2
- 2026Found in Conversation: LLMs Teach Themselves to Close the Multi-Turn Gapcited by 2
- 2025Attentive Reasoning Queries: A Systematic Method for Optimizing Instruction-Following in Large Language Modelscited by 1
- 2025KVNAND: Efficient On-Device Large Language Model Inference Using DRAM-Free In-Flash Computingcited by 1
- 2026Beyond In-Domain Detection: SpikeScore for Cross-Domain Hallucination Detectioncited by 1
- 2026Probing to Refine: Reinforcement Distillation of LLMs via Explanatory Inversioncited by 1
- 2026SoK: Intent-Oriented Systematization of Multi-Turn LLM Jailbreakscited by 1
- 2026ReCrit: Transition-Aware Reinforcement Learning for Scientific Critic Reasoningcited by 0
- 2026SoK: Intent-Oriented Systematization of Multi-Turn LLM Jailbreaks2 Aug 2026
- 2026Found in Conversation: LLMs Teach Themselves to Close the Multi-Turn Gap23 May 2026
- 2026ReCrit: Transition-Aware Reinforcement Learning for Scientific Critic Reasoning11 May 2026
- 2026MT-JailBench: A Modular Benchmark for Understanding Multi-Turn Jailbreak Attacks10 May 2026
- 2026Useless but Safe? Benchmarking Utility Recovery with User Intent Clarification in Multi-Turn Conversations29 Apr 2026
- 2026A Framework for Longitudinal Health AI Agents13 Apr 2026
- 2026State-Dependent Safety Failures in Multi-Turn Language Model Interaction15 Mar 2026
- 2026Probing to Refine: Reinforcement Distillation of LLMs via Explanatory Inversion26 Feb 2026
- 2026CM2: Reinforcement Learning with Checklist Rewards for Multi-Turn and Multi-Step Agentic Tool Use12 Feb 2026
- 2026Feedback by Design: Understanding and Overcoming User Feedback Barriers in Conversational Agents1 Feb 2026
- 2026Beyond In-Domain Detection: SpikeScore for Cross-Domain Hallucination Detection27 Jan 2026
- 2025KVNAND: Efficient On-Device Large Language Model Inference Using DRAM-Free In-Flash Computing3 Dec 2025
18 more
- 2025Charts Are Not Images: On the Challenges of Scientific Chart Editing30 Nov 2025
- 2025Unlocking the Power of Multi-Agent LLM for Reasoning: From Lazy Agents to Deliberation4 Nov 2025
- 2025Rethinking Text-to-SQL: Dynamic Multi-turn SQL Interaction for Real-world Database Exploration30 Oct 2025
- 2025A Principle-based Framework for the Development and Evaluation of Large Language Models for Health and Wellness23 Oct 2025
- 2025Beyond One-Way Influence: Bidirectional Opinion Dynamics in Multi-Turn Human-LLM Interactions22 Oct 2025
- 2025Simulating Viva Voce Examinations to Evaluate Clinical Reasoning in Large Language Models11 Oct 2025
- 2025Autoencoding-Free Context Compression for LLMs via Contextual Semantic Anchors10 Oct 2025
- 2025Test-Time Policy Adaptation for Enhanced Multi-Turn Interactions with LLMs27 Sep 2025
- 2025Multi-Turn Puzzles: Evaluating Interactive Reasoning and Strategic Dialogue in LLMs13 Aug 2025
- 2025HCAttention: Extreme KV Cache Compression via Heterogeneous Attention Computing for LLMs26 Jul 2025
- 2025A Simple "Try Again" Can Elicit Multi-Turn LLM Reasoning18 Jul 2025
- 2025StoryBench: A Dynamic Benchmark for Evaluating Long-Term Memory with Multi Turns16 Jun 2025
- 2025Evaluating the Sensitivity of LLMs to Prior Context29 May 2025
- 2025A Desideratum for Conversational Agents: Capabilities, Challenges, and Future Directions7 Apr 2025
- 2025Evaluating LLM-based Agents for Multi-Turn Conversations: A Survey28 Mar 2025
- 2025Attentive Reasoning Queries: A Systematic Method for Optimizing Instruction-Following in Large Language Models5 Mar 2025
- 2025ImageChain: Advancing Sequential Image-to-Text Reasoning in Multimodal Large Language Models26 Feb 2025
- 2025CollabLLM: From Passive Responders to Active Collaborators2 Feb 2025
- 2025A Simple "Try Again" Can Elicit Multi-Turn LLM Reasoningcited by 11
- 2025Unlocking the Power of Multi-Agent LLM for Reasoning: From Lazy Agents to Deliberationcited by 11
- 2025Multi-Turn Puzzles: Evaluating Interactive Reasoning and Strategic Dialogue in LLMscited by 10
- 2025Simulating Viva Voce Examinations to Evaluate Clinical Reasoning in Large Language Modelscited by 9
- 2025ImageChain: Advancing Sequential Image-to-Text Reasoning in Multimodal Large Language Modelscited by 4
- 2025Rethinking Text-to-SQL: Dynamic Multi-turn SQL Interaction for Real-world Database Explorationcited by 2
- 2025Attentive Reasoning Queries: A Systematic Method for Optimizing Instruction-Following in Large Language Modelscited by 1
- 2026Probing to Refine: Reinforcement Distillation of LLMs via Explanatory Inversioncited by 1
- 2026ReCrit: Transition-Aware Reinforcement Learning for Scientific Critic Reasoningcited by 0
- 2026ReCrit: Transition-Aware Reinforcement Learning for Scientific Critic Reasoning11 May 2026
- 2026Probing to Refine: Reinforcement Distillation of LLMs via Explanatory Inversion26 Feb 2026
- 2025Unlocking the Power of Multi-Agent LLM for Reasoning: From Lazy Agents to Deliberation4 Nov 2025
- 2025Rethinking Text-to-SQL: Dynamic Multi-turn SQL Interaction for Real-world Database Exploration30 Oct 2025
- 2025Simulating Viva Voce Examinations to Evaluate Clinical Reasoning in Large Language Models11 Oct 2025
- 2025Multi-Turn Puzzles: Evaluating Interactive Reasoning and Strategic Dialogue in LLMs13 Aug 2025
- 2025A Simple "Try Again" Can Elicit Multi-Turn LLM Reasoning18 Jul 2025
- 2025Attentive Reasoning Queries: A Systematic Method for Optimizing Instruction-Following in Large Language Models5 Mar 2025
- 2025ImageChain: Advancing Sequential Image-to-Text Reasoning in Multimodal Large Language Models26 Feb 2025
- 2025Evaluating LLM-based Agents for Multi-Turn Conversations: A Surveycited by 57
- 2026CM2: Reinforcement Learning with Checklist Rewards for Multi-Turn and Multi-Step Agentic Tool Usecited by 14
- 2025A Desideratum for Conversational Agents: Capabilities, Challenges, and Future Directionscited by 9
- 2026Feedback by Design: Understanding and Overcoming User Feedback Barriers in Conversational Agentscited by 4
- 2026CM2: Reinforcement Learning with Checklist Rewards for Multi-Turn and Multi-Step Agentic Tool Use12 Feb 2026
- 2026Feedback by Design: Understanding and Overcoming User Feedback Barriers in Conversational Agents1 Feb 2026
- 2025A Desideratum for Conversational Agents: Capabilities, Challenges, and Future Directions7 Apr 2025
- 2025Evaluating LLM-based Agents for Multi-Turn Conversations: A Survey28 Mar 2025
- 2025Autoencoding-Free Context Compression for LLMs via Contextual Semantic Anchorscited by 14
- 2025HCAttention: Extreme KV Cache Compression via Heterogeneous Attention Computing for LLMscited by 3
- 2025KVNAND: Efficient On-Device Large Language Model Inference Using DRAM-Free In-Flash Computingcited by 1
- 2025KVNAND: Efficient On-Device Large Language Model Inference Using DRAM-Free In-Flash Computing3 Dec 2025
- 2025Autoencoding-Free Context Compression for LLMs via Contextual Semantic Anchors10 Oct 2025
- 2025HCAttention: Extreme KV Cache Compression via Heterogeneous Attention Computing for LLMs26 Jul 2025
- 2025CollabLLM: From Passive Responders to Active Collaboratorscited by 124
- 2025StoryBench: A Dynamic Benchmark for Evaluating Long-Term Memory with Multi Turnscited by 20
- 2025Charts Are Not Images: On the Challenges of Scientific Chart Editingcited by 11
- 2025Evaluating the Sensitivity of LLMs to Prior Contextcited by 9
- 2025Beyond One-Way Influence: Bidirectional Opinion Dynamics in Multi-Turn Human-LLM Interactionscited by 6
- 2025Test-Time Policy Adaptation for Enhanced Multi-Turn Interactions with LLMscited by 3
- 2025A Principle-based Framework for the Development and Evaluation of Large Language Models for Health and Wellnesscited by 3
- 2026A Framework for Longitudinal Health AI Agentscited by 3
- 2026Found in Conversation: LLMs Teach Themselves to Close the Multi-Turn Gapcited by 2
- 2026Beyond In-Domain Detection: SpikeScore for Cross-Domain Hallucination Detectioncited by 1
- 2026Found in Conversation: LLMs Teach Themselves to Close the Multi-Turn Gap23 May 2026
- 2026A Framework for Longitudinal Health AI Agents13 Apr 2026
- 2026Beyond In-Domain Detection: SpikeScore for Cross-Domain Hallucination Detection27 Jan 2026
- 2025Charts Are Not Images: On the Challenges of Scientific Chart Editing30 Nov 2025
- 2025A Principle-based Framework for the Development and Evaluation of Large Language Models for Health and Wellness23 Oct 2025
- 2025Beyond One-Way Influence: Bidirectional Opinion Dynamics in Multi-Turn Human-LLM Interactions22 Oct 2025
- 2025Test-Time Policy Adaptation for Enhanced Multi-Turn Interactions with LLMs27 Sep 2025
- 2025StoryBench: A Dynamic Benchmark for Evaluating Long-Term Memory with Multi Turns16 Jun 2025
- 2025Evaluating the Sensitivity of LLMs to Prior Context29 May 2025
- 2025CollabLLM: From Passive Responders to Active Collaborators2 Feb 2025
Similar, not cited
Close in wording, no citation either way
- 2025Beyond Single-Turn: A Survey on Multi-Turn Interactions with Large Language Models
- 2026Beyond Continuity: Challenges of Context Switching in Multi-Turn Dialogue with LLMs
- 2025ClarifyMT-Bench: Benchmarking and Improving Multi-Turn Clarification for Conversational Large Language Models
- 2026SOMA: Efficient Multi-turn LLM Serving via Small Language Model
- 2023Parrot: Enhancing Multi-Turn Instruction Following for Large Language Models
- 2025MARS-Bench: A Multi-turn Athletic Real-world Scenario Benchmark for Dialogue Evaluation
- 2024Speak Out of Turn: Safety Vulnerability of Large Language Models in Multi-turn Dialogue
- 2025Can a Single Model Master Both Multi-turn Conversations and Tool Use? CoALM: A Unified Conversational Agentic Language Model