DRIFTLENS: Measuring Memory-Induced Reasoning Drift in Personalized Language Models
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Personalization changes what a model says to a user; we show that it can also change the reasoning trajectory used to justify the response. Modern LLMs personalize interactions by storing user attributes, preferences, and prior context, then injecting this information into future prompts. We study whether such memory reshapes reasoning on open-ended questions where no single ground-truth answer exists. To quantify this effect, we introduce DRIFTLENS, a ground-truth-free framework that maps each expressed reasoning step to a value category and measures divergence between a question's no-memory trajectory and its trajectory under injected user-attribute memory. We first validate that DRIFTLENS distinguishes content-free pragmatic noise from substantive reasoning changes. Across four LLMs and 10 user-attribute categories, including age, occupation, and disability, user-attribute memory induces medium-to-large reasoning drift above each model's pragmatic-noise floor, even when final answers remain fluent, on-topic, and plausible. We then evaluate GRPO- and DPO-based post-training methods for reducing drift. Both reduce drift, but neither uniformly dominates; effects on downstream capability, helpfulness, and instruction following are model-and reward-dependent. These results suggest that memory-induced reasoning drift is a measurable and only partly mitigated failure mode of personalized language models.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 11 of its 24 references that are in the map. First posted on arXiv 2 Jul 2026.
Builds on
11 of 24 references.
References · 11
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,928
- 2020Aligning AI With Shared Human Valuescited by 706
- 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 491
- 2025PersonaMem-v2: Towards Personalized Intelligence via Learning Implicit User Personas and Agentic Memorycited by 82
- 2024DailyDilemmas: Revealing Value Preferences of LLMs with Quandaries of Daily Lifecited by 57
- 2026Rethinking Rubric Generation for Improving LLM Judge and Reward Modeling for Open-ended Taskscited by 55
- 2025Values in the Wild: Discovering and Analyzing Values in Real-World Language Model Interactionscited by 47
- 2025Enabling Personalized Long-term Interactions in LLM-based Agents through Persistent Memory and User Profilescited by 16
- 2022Parameter-Efficient Legal Domain Adaptationcited by 12
- 2025The Personalization Trap: How User Memory Alters Emotional Reasoning in LLMscited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026MemoReason: Evaluating the Effect of Parametric Memory on Contextual Reasoning in LLMs
- 2026FinPerMA: A Theory-Informed, Event-Grounded Personalized-Memory Benchmark for LLM Agents
- 2026PRAGMA: Evaluating Personalized Guidance with Memory Alignment in Lifelong Conversations
- 2026MemOps: Benchmarking Lifecycle Memory Operations in Long-Horizon Conversations
- 2026Supersede: Diagnosing and Training the Memory-Update Gap in LLM Agents
- 2025The Reasoning-Memorization Interplay in Language Models Is Mediated by a Single Direction
- 2025On the Failure of Latent State Persistence in Large Language Models
- 2025Answer-Centric or Reasoning-Driven? Uncovering the Latent Memory Anchor in LLMs