Intent Mismatch Causes LLMs to Get Lost in Multi-Turn Conversation
Not on the map. Why?
Abstract (arXiv)
Multi-turn conversation has emerged as a predominant interaction paradigm for Large Language Models (LLMs). Users often employ follow-up questions to refine their intent, expecting LLMs to adapt dynamically. However, recent research reveals that LLMs suffer a substantial performance drop in multi-turn settings compared to single-turn interactions with fully specified instructions, a phenomenon termed ``Lost in Conversation'' (LiC). While this prior work attributes LiC to model unreliability, we argue that the root cause lies in an intent alignment gap rather than intrinsic capability deficits. In this paper, we first demonstrate that LiC is not a failure of model capability but rather a breakdown in interaction between users and LLMs. We theoretically show that scaling model size or improving training alone cannot resolve this gap, as it arises from structural ambiguity in conversational context rather than representational limitations. To address this, we propose to decouple intent understanding from task execution through a Mediator-Assistant architecture. By utilizing an experience-driven Mediator to explicate user inputs into explicit, well-structured instructions based on historical interaction patterns, our approach effectively bridges the gap between vague user intent and model interpretation. Experimental results demonstrate that this method significantly mitigates performance degradation in multi-turn conversations across diverse LLMs.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 9 of its 17 references that are in the map. First posted on arXiv 7 Feb 2026.
Builds on
9 of 17 references.
References · 9
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2025A-MEM: Agentic Memory for LLM Agentscited by 1,000
- 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 800
- 2025LLMs Get Lost In Multi-Turn Conversationcited by 400
- 2020AmbigQA: Answering Ambiguous Open-domain Questionscited by 385
- 2024MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialoguescited by 247
- 2024On Overcoming Miscalibrated Conversational Priors in LLM-based Chatbotscited by 23
- 2025Mitigating Lost in Multi-turn Conversation via Curriculum RL with Verifiable Accuracy and Abstention Rewardscited by 6
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Benchmarking Multi-turn Medical Diagnosis: Hold, Lure, and Self-Correctioncited by 4
- 2026MAIGO: Mitigating Lost-in-Conversation with History-Cleaned On-Policy Self-Distillationcited by 3
- 2026Found in Conversation: LLMs Teach Themselves to Close the Multi-Turn Gapcited by 1
- 2026SeDT: Sentence-Transformer Decision-Transformer Conditioning for Multi-Turn Conversation Reliabilitycited by 1
- 2026Interaction Readiness: A Framework for Building and Evaluating AI Agents in Human Rolescited by 0
- 2026MemTrapBench: Benchmarking Cognitive Traps in LLM Memory Usecited by 0
- 2026What if LLMs Ate Their Words: Causal History Effects in Multi-Turn Interactioncited by 0
- 2026What if LLMs Ate Their Words: Causal History Effects in Multi-Turn Interaction5 Sep 2026
- 2026MemTrapBench: Benchmarking Cognitive Traps in LLM Memory Use20 Aug 2026
- 2026Interaction Readiness: A Framework for Building and Evaluating AI Agents in Human Roles4 Jul 2026
- 2026MAIGO: Mitigating Lost-in-Conversation with History-Cleaned On-Policy Self-Distillation26 May 2026
- 2026SeDT: Sentence-Transformer Decision-Transformer Conditioning for Multi-Turn Conversation Reliability26 May 2026
- 2026Found in Conversation: LLMs Teach Themselves to Close the Multi-Turn Gap23 May 2026
- 2026Benchmarking Multi-turn Medical Diagnosis: Hold, Lure, and Self-Correction6 Apr 2026