mlsanityData to 7 Oct 2026

When Users Change Their Minds: Measuring and Repairing Intent Drift in LLM Agents

arXiv 2609.32520 ↗First posted 26 Sep 2026cs.CL cs.AIcited by 0

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks also fits: Agent memory systems

Abstract (arXiv)

LLM agents often operate over multi-turn interactions in which user intent changes before execution. We study intent drift: the failure mode in which superseded parts of the user's intent continue to influence the final answer or tool action. We introduce IntentFlux, an executable benchmark that converts verifiable tasks into dialogues with controlled intent changes while preserving their original graders. In a 627-case calibration, mean task score falls from 0.476 to 0.384 as dialogues contain more superseded and withdrawn information. Across eight models, the rate of fully correct solutions is significantly lower when the same final task must be recovered from an evolving dialogue rather than given directly in a single turn. We further introduce StateForge, which explicitly maintains the active requirements before generation. On General-Test, it improves mean task score from 0.367 to 0.467. Providing the ground-truth final state improves performance further but still does not recover single-turn performance, indicating that state-estimation errors explain only part of the gap. These results establish intent drift as a measurable multi-turn failure mode and explicit state maintenance as a partial mitigation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 25 of its 27 references that are in the map. First posted on arXiv 26 Sep 2026.

Builds on

25 of 27 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025VitaBench: Benchmarking LLM Agents with Versatile Interactive Tasks in Real-world Applications30 Sep

Other references · 24

  1. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  2. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  3. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  4. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
  5. 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,120
  6. 2023On-Policy Distillation of Language Models: Learning from Self-Generated Mistakescited by 840
  7. 2023Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizescited by 710
  8. 2023LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compressioncited by 443
  9. 2025LLMs Get Lost In Multi-Turn Conversationcited by 400
  10. 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 349
  11. 2024Deliberative Alignment: Reasoning Enables Safer Language Modelscited by 292
  12. 2020ToTTo: A Controlled Table-To-Text Generation Datasetcited by 267
12 more
  1. 2025MultiChallenge: A Realistic Multi-Turn Conversation Evaluation Benchmark Challenging to Frontier LLMscited by 171
  2. 2024A Human-Inspired Reading Agent with Gist Memory of Very Long Contextscited by 140
  3. 2024Summary of a Haystack: A Challenge to Long-Context LLMs and RAG Systemscited by 87
  4. 2024MT-Eval: A Multi-Turn Capabilities Evaluation Benchmark for Large Language Modelscited by 78
  5. 2025MTRAG: A Multi-Turn Conversational Benchmark for Evaluating Retrieval-Augmented Generation Systemscited by 50
  6. 2023Entity Tracking in Language Modelscited by 44
  7. 2024Language Models Represent Beliefs of Self and Otherscited by 29
  8. 2026From Recall to Forgetting: Benchmarking Long-Term Memory for Personalized Agentscited by 29
  9. 2026Supersede: Diagnosing and Training the Memory-Update Gap in LLM Agentscited by 13
  10. 2026When Users Change Their Mind: Evaluating Interruptible Agents in Long-Horizon Web Navigationcited by 12
  11. 2025One Battle After Another: Probing LLMs' Limits on Multi-Turn Instruction Following with a Benchmark Evolving Frameworkcited by 9
  12. 2026LLMs Get Lost in Evolving User Intentcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Beyond Oracle Communication: Benchmarking Interactive Intent Alignment Under Miscommunication and Evolving User Intent
  2. 2026Intent-Driven Situation Tracking for User-Centric Multi-Turn Agents
  3. 2026Drift-Bench: Diagnosing Cooperative Breakdowns in LLM Agents under Input Faults via Multi-Turn Interaction
  4. 2026AgentAbstain: Do LLM Agents Know When Not to Act?
  5. 2026Beyond Task Completion: Revealing Corrupt Success in LLM Agents through Procedure-Aware Evaluation
  6. 2026INTENT-AS-A-TOOL Makes it Easy to Track Agentic Misalignment
  7. 2026Emerging from Ground: Addressing Intent Deviation in Tool-Using Agents via Deriving Real Calls into Virtual Trajectories
  8. 2026Toward Scalable Verifiable Reward: Proxy State-Based Evaluation for Multi-turn Tool-Calling LLM Agents