mlsanityData to 14 Oct 2026

Alignment Drift in Long-Term Human-LLM Interaction: A Mechanism-Oriented Framework

arXiv 2605.16516 ↗First posted 15 May 2026cs.HC cs.AI cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Long-term interaction with LLM-based systems may produce alignment drift: a gradual process in which system outputs become less constrained by the user's current message and more shaped by prior interaction history, while still appearing helpful, coherent, and responsive. This process is difficult to detect because the user's subjective experience may improve as the system becomes more familiar, useful, and attuned. Existing research on human-LLM interaction has largely focused on short-term task performance, isolated outputs, or single-instance alignment problems, leaving slow and cumulative interaction-level dynamics undercharacterized. This paper proposes a mechanism-oriented framework for describing alignment drift. The framework defines the distinction between signal A and signal B, explains how drift develops through feedback loops and sub-pattern selection, divides the process into three interactional regimes, and identifies boundary conditions for controlling drift. By framing alignment drift as a recursive interactional process rather than an isolated model-side failure, the paper provides a conceptual basis for studying long-term human-system interaction.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 5 of its 9 references that are in the map. First posted on arXiv 15 May 2026.

Builds on

5 of 9 references.

References · 5

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2017Deep reinforcement learning from human preferencescited by 3,912
  3. 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
  4. 2026Sycophantic Chatbots Cause Delusional Spiraling, Even in Ideal Bayesianscited by 21
  5. 2015The amplification of risk in experimental diffusion chainscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Stayin' Aligned Over Time: Towards Longitudinal Human-LLM Alignment via Contextual Reflection and Privacy-Preserving Behavioral Data
  2. 2026Agent Drift: Quantifying Behavioral Degradation in Multi-Agent LLM Systems Over Extended Interactions
  3. 2024Understanding the Learning Dynamics of Alignment with Human Feedback
  4. 2025Your LLM Agents are Temporally Blind: The Misalignment Between Tool Use Decisions and Human Time Perception
  5. 2025Enhancing User Engagement in Socially-Driven Dialogue through Interactive LLM Alignments
  6. 2025Collaborate, Deliberate, Evaluate: How LLM Alignment Affects Coordinated Multi-Agent Outcomes
  7. 2024Examining Identity Drift in Conversations of LLM Agents
  8. 2026Beyond Oracle Communication: Benchmarking Interactive Intent Alignment Under Miscommunication and Evolving User Intent