mlsanityData to 14 Oct 2026

Defense-in-Depth for LLMs: Evaluating Memory Gates Against Activation-Induced and Memory-Induced Sycophancy

arXiv 2610.07403 ↗First posted 5 Oct 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Long-term memory allows Large Language Models (LLMs) to maintain personalized context across interactions, but retrieved user history can induce memory-induced sycophancy, causing models to favor stored user beliefs over objective evidence. Existing defenses primarily operate on retrieved context and are rarely evaluated jointly with internal behavioral bias. We introduce a 2 × 2 defense-in-depth framework separating internal activation steering from external memory handling. We extract sycophancy steering directions from 100 paired prompts and evaluate four open-weight models across 10 steering coefficients and five memory-defense configurations on MemSyco-Bench (answers for all 1,550 items; defense conditions judged on a fixed 250-item subsample), with three LLM judges. Three of the five configurations are new (rewriting every memory, a Router Gate that keeps, rewrites, or drops each memory, and dropping all memory); the other two are MemSyco's baselines. Selective Router Gate filtering preserves substantially more of MemSyco's average accuracy than complete memory removal, and this separation persists when the models are steered toward sycophancy. On Llama 3.1 8B with Router Gate, mild inverse steering (α = -1.5) lowers judge-averaged sycophancy from 35.80% to 31.32% while average accuracy moves from 43.99% to 43.31%; this reduction has the same direction under all three judges but is not statistically significant (paired p = 0.08 to 0.63 on 149 items). External memory filtering is the part of the design that holds up; our data do not show that inverse steering adds to it.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 18 references that are in the map. First posted on arXiv 5 Oct 2026.

Builds on

14 of 18 references.

References · 14

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2024Qwen2.5 Technical Reportcited by 4,942
  3. 2023Mistral 7Bcited by 3,164
  4. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
  5. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
  6. 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
  7. 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 836
  8. 2025When Truth Is Overridden: Uncovering the Internal Origins of Sycophancy in Large Language Modelscited by 50
  9. 2026PersistBench: When Should Long-Term Memories Be Forgotten by LLMs?cited by 21
  10. 2026Beyond Similarity: Trustworthy Memory Search for Personal AI Agentscited by 12
  11. 2026MemSyco-Bench: Benchmarking Sycophancy in Agent Memorycited by 12
  12. 2026Dissociating the Internal Representations of Sycophancy in LLMscited by 6
2 more
  1. 2026Dual-Stance Evaluation of Sycophancy: The Structure of Agreement and the Limits of Interventioncited by 2
  2. 2026C-DeltaTheta: Circuit-Restricted Weight Arithmetic for Selective Refusalcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026MemGuard: Preventing Memory Contamination in Long-Term Memory-Augmented Large Language Models
  2. 2026MemEvoBench: Benchmarking Safety Risks from Memory Misevolution in LLM Agents
  3. 2025PerProb: Indirectly Evaluating Memorization in Large Language Models ↗
  4. 2025The Landscape of Memorization in LLMs: Mechanisms, Measurement, and Mitigation
  5. 2026What to Admit and How to Present: Governing Persistent Memory in LLM Agents
  6. 2026Hidden in Memory: Sleeper Memory Poisoning in LLM Agents
  7. 2026Memadapter: Counterfactual Adaptation Against Memory-induced Sycophancy
  8. 2025How Memory Management Impacts LLM Agents: An Empirical Study of Experience-Following Behavior