Clarification Is Not Correction: LLMs Fail to Let Go
Not on the map. Why?
Abstract (arXiv)
Dialogue failures in language models are usually framed as memory failures: context too long, summaries lossy, a constraint forgotten. We argue this misses a deeper problem: in many conversations the model does not forget, it commits too early. An ambiguous early turn collapses into a single hidden interpretation, and later clarification is filtered through that commitment. We call this early posterior collapse: unresolved user intent collapsing into a committed task state before ambiguity is resolved. We study it with controlled dialogue tasks in writing, planning, and coding using Gemini-2.5-Pro and Gemini-2.5-Flash. Across thousands of trials, the same information in different orders yields different outcomes, even when the final dialogue contains equivalent task-relevant information. This order effect suggests later clarification is treated as extra context rather than a corrective signal: it refines a stale task state without invalidating it. Coding tasks are especially vulnerable, suggesting early assumptions get embedded in structured artifacts such as interfaces and control flow. Standard prompting and memory strategies do not reliably help: summaries can collapse ambiguity, and chain-of-thought can reduce explicit wrong commitment in reasoning traces without improving final task success. These findings motivate uncertainty-preserving state management. If assistants cannot let go of early interpretations, robustness cannot rely on post hoc correction alone; it must keep ambiguous early turns from hardening into one task state. Assistants should hold tentative hypotheses while ambiguity remains, ask before executing when high-impact ambiguity persists, and rebuild from a revised state when later evidence invalidates an earlier reading. Rather than one prompting fix, we aim to redirect research for interactive LLMs from retaining more context toward preserving uncertainty.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 24 references that are in the map. First posted on arXiv 21 Sep 2026.
Builds on
19 of 24 references.
References · 19
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
- 2025LLMs Get Lost In Multi-Turn Conversationcited by 400
- 2020AmbigQA: Answering Ambiguous Open-domain Questionscited by 385
- 2019Asking Clarifying Questions in Open-Domain Information-Seeking Conversationscited by 136
- 2018Learning to Ask Good Questions: Ranking Clarification Questions using Neural Expected Value of Perfect Informationcited by 110
7 more
- 2025Structured Uncertainty guided Clarification for LLM Agentscited by 34
- 2025StructFlowBench: A Structured Flow Benchmark for Multi-turn Instruction Followingcited by 28
- 2025MTR-Bench: A Comprehensive Benchmark for Multi-Turn Reasoning Evaluationcited by 15
- 2025TurnBench-MS: A Benchmark for Evaluating Multi-Turn, Multi-Step Reasoning in Large Language Modelscited by 12
- 2026When and What to Ask: AskBench and Rubric-Guided RLVR for LLM Clarificationcited by 12
- 2026ClarEval: A Benchmark for Evaluating Clarification Skills of Code Agents under Ambiguous Instructionscited by 5
- 2026CLARITY: A Framework and Benchmark for Conversational Language Ambiguity and Unanswerability in Interactive NL2SQL Systemscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025ClarifyMT-Bench: Benchmarking and Improving Multi-Turn Clarification for Conversational Large Language Models
- 2026Remember, Verify, or Ask? Cross-Family Evaluation of Memory Commitment in LLM Agents
- 2026Reasoning Gets Harder for LLMs Inside A Dialogue
- 2026Reasoning Shift: How Context Silently Shortens LLM Reasoning
- 2025Forgetting as a Feature: Cognitive Alignment of Large Language Models
- 2025It Depends: Resolving Referential Ambiguity in Minimal Contexts with Commonsense Knowledge
- 2026"I May Not Have Articulated Myself Clearly": Diagnosing Dynamic Instability in LLM Reasoning at Inference Time
- 2026MemOps: Benchmarking Lifecycle Memory Operations in Long-Horizon Conversations