mlsanityData to 14 Oct 2026

History Anchors: How Prior Behavior Steers LLM Decisions Toward Unsafe Actions

arXiv 2605.13825 ↗First posted 13 May 2026cs.AI cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Frontier LLMs are increasingly deployed as agents that pick the next action after a long log of prior tool calls produced by the same or a different model. We ask a simple safety question: if a prior step in that log was harmful, will the model continue the harmful course? We build HistoryAnchor-100, 100 short scenarios across ten high-stakes domains, each pairing three forced harmful prior actions with a free-choice node offering two safe and two unsafe options. Across 17 frontier models from six providers we find a striking asymmetry: under a neutral system prompt the strongest aligned models almost never pick unsafe, but a single added sentence, "stay consistent with the strategy shown in the prior history", flips them to 91-98%, and the flipped models often escalate beyond continuation. Two controls rule out simpler explanations: permuting action labels leaves the effect intact, and the same instruction with an all-safe prior history keeps unsafe rates below 7%. Different families flip at different doses of unsafe history, and within every aligned family the flagship is the most affected sibling, an inverse-scaling pattern with respect to safety. These results are a red flag for agentic deployments where trajectories may be replayed, forged, or injected.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 16 of its 20 references that are in the map. First posted on arXiv 13 May 2026.

Builds on

16 of 20 references.

References · 16

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2022Training language models to follow instructions with human feedbackcited by 15,971
  4. 2017Proximal Policy Optimization Algorithmscited by 15,215
  5. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  6. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  7. 2017Deep reinforcement learning from human preferencescited by 3,912
  8. 2020Learning to summarize from human feedbackcited by 2,588
  9. 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
  10. 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,434
  11. 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 836
  12. 2023Identifying the Risks of LM Agents with an LM-Emulated Sandboxcited by 548
4 more
  1. 2024Great, Now Write an Article About That: The Crescendo Multi-Turn LLM Jailbreak Attackcited by 390
  2. 2023Role-Play with Large Language Modelscited by 294
  3. 2023Inverse Scaling: When Bigger Isn't Bettercited by 207
  4. 2023Do the Rewards Justify the Means? Measuring Trade-Offs Between Rewards and Ethical Behavior in the MACHIAVELLI Benchmarkcited by 182

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Safety Paradox: How Enhanced Safety Awareness Leaves LLMs Vulnerable to Posterior Attack
  2. 2025Beyond Reactive Safety: Risk-Aware LLM Alignment via Long-Horizon Simulation
  3. 2026ToolAlignBench: Investigating Alignment Conflicts in Tool-Calling Enabled LLMs
  4. 2026PreAct-Bench: Benchmarking Predictive Monitoring in LLMs
  5. 2026When Context Flips, Safety Breaks: Diagnosing Brittle Safety in Aligned Language Models
  6. 2026The Causal Impact of Tool Affordance on Safety Alignment in LLM Agents
  7. 2026Mind the GAP: Text Safety Does Not Transfer to Tool-Call Safety in LLM Agents
  8. 2026Delegated Misalignment: How Multi-Agent Structures Amplify LLM Safety Risks