Inherited Goal Drift: Contextual Pressure Can Undermine Agentic Goals
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
The accelerating adoption of language models (LMs) as agents for deployment in long-context tasks motivates a thorough understanding of goal drift: agents' tendency to deviate from an original objective. While prior-generation language model agents have been shown to be susceptible to drift, the extent to which drift affects more recent models remains unclear. In this work, we provide an updated characterization of the extent and causes of goal drift. We investigate drift in state-of-the-art models within a simulated stock-trading environment (Arike et al., 2025). These models are largely shown to be robust even when subjected to adversarial pressure. We show, however, that this robustness is brittle: across multiple settings, the same models often inherit drift when conditioned on prefilled trajectories from weaker agents. The extent of conditioning-induced drift varies significantly by model family, with only GPT-5.1 maintaining consistent resilience among tested models. We find that drift behavior is inconsistent between prompt variations and correlates poorly with instruction hierarchy following behavior, with strong hierarchy following failing to reliably predict resistance to drift. Finally, we run analogous experiments in a new emergency room triage environment to show preliminary evidence for the transferability of our results across qualitatively different settings. Our findings underscore the continued vulnerability of modern LM agents to contextual pressures and the need for refined post-training techniques to mitigate this.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 9 of its 14 references that are in the map. First posted on arXiv 3 Mar 2026.
Builds on
9 of 14 references.
Closest ancestors · 1
Same direction, newest first
Other references · 8
- 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 651
- 2024The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructionscited by 441
- 2024Defending Against Indirect Prompt Injection Attacks With Spotlightingcited by 233
- 2024Pride and Prejudice: LLM Amplifies Self-Bias in Self-Refinementcited by 111
- 2025Large Language Models Often Know When They Are Being Evaluatedcited by 105
- 2024Instructional Segment Embedding: Improving LLM Safety with Instruction Hierarchycited by 62
- 2025Control Illusion: The Failure of Instruction Hierarchies in Large Language Modelscited by 31
- 2025Drift No More? Context Equilibria in Multi-Turn LLM Interactionscited by 21
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Signal-Driven Observation for Long-Horizon Web Agentscited by 0
- 2026A Taxonomy of Cognitive Capability Gaps in Generative and Agentic AIcited by 0
- 2026The LLM Proposes, the Executive Disposes: A Self-Verifying Agent Instrument that Dissociates Commitment Drift from Binding Drift in Long-Horizon Agentscited by 0
- 2026Same Facts, Different Updates: Inference Setup Shapes LLM Behavior in Medical Allocationcited by 0
- 2026Intent Drift at SME Scale: Deployment Practice, Not Model Capability, Determines Agentic Compliancecited by 0
- 2026When the Agent Becomes the Kernel: A Systematization of Security on the Path to AI-Native Operating Systemscited by 0
- 2026When the Agent Becomes the Kernel: A Systematization of Security on the Path to AI-Native Operating Systems20 Sep 2026
- 2026Intent Drift at SME Scale: Deployment Practice, Not Model Capability, Determines Agentic Compliance5 Sep 2026
- 2026The LLM Proposes, the Executive Disposes: A Self-Verifying Agent Instrument that Dissociates Commitment Drift from Binding Drift in Long-Horizon Agents4 Aug 2026
- 2026A Taxonomy of Cognitive Capability Gaps in Generative and Agentic AI3 Aug 2026
- 2026Same Facts, Different Updates: Inference Setup Shapes LLM Behavior in Medical Allocation10 Jun 2026
- 2026Signal-Driven Observation for Long-Horizon Web Agents4 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2025Technical Report: Evaluating Goal Drift in Language Model Agents
- 2026Large Language Model Agents Are Not Always Faithful Self-Evolvers
- 2026Capable but Unreliable: Canonical Path Deviation as a Causal Mechanism of Agent Failure in Long-Horizon Tasks
- 2026Evaluating and Understanding Scheming Propensity in LLM Agents
- 2026Language Model Goal Selection Differs from Humans' in a Self-Directed Learning Task
- 2025Do Large Language Models Know What They Are Capable Of?
- 2026On Language Drift during RLVR Post-Training
- 2025Mirage or Method? How Model-Task Alignment Induces Divergent RL Conclusions