How Do Language Models Choose Between Context and Memory?
Not on the map. Why?
Abstract (arXiv)
When contextual information conflicts with knowledge stored in model parameters, activation directions can be used to decode and steer which source the model follows. However, successful steering does not establish that the unedited model uses those directions to choose between sources, or that they remain effective across tasks. To test these possibilities, we vary the stated authority of contextual claims while holding their content fixed. We first estimate authority directions from prompts in which context and parametric knowledge agree, then test their causal contribution when the two sources conflict. Interchanging naturally occurring activation values along these directions between matched high- and low-authority prompts reproduces 30--68% of the authority-induced shift in source choice across Qwen, Llama, and OLMo models, whereas matched controls reproduce almost none. We next ask what transfers across tasks: the learned direction versus the activation values exchanged along it. Using a direction learned on another task closed 9% of the source-choice gap, compared with 57% when learned on the task being evaluated. Both interventions exchanged activation values from the evaluated task. In a separate experiment, we kept its learned direction but exchanged values taken from another task, which closed 68% of the gap. These results show that authority-related activation values can causally influence source choice across tasks when inserted along directions learned for the task being evaluated.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 28 references that are in the map. First posted on arXiv 1 Sep 2026.
Builds on
25 of 28 references.
References · 25
- 2024Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineeringcited by 63
- 2025MIB: A Mechanistic Interpretability Benchmarkcited by 56
- 2025When Truth Is Overridden: Uncovering the Internal Origins of Sycophancy in Large Language Modelscited by 50
- 2024Competition of Mechanisms: Tracing How Language Models Handle Facts and Counterfactualscited by 40
- 2025Language Models use Lookbacks to Track Beliefscited by 39
- 2025Taming Knowledge Conflicts in Language Modelscited by 30
- 2024Representational Analysis of Binding in Language Modelscited by 28
- 2024Controllable Context Sensitivity and the Knob Behind Itcited by 23
- 2026Interpretability without actionability: mechanistic methods cannot correct language model errors despite near-perfect internal representationscited by 17
- 2026A Mechanistic View of Authority Hierarchy in LLM Sycophancycited by 9
- 2026Who Endorsed It? Measuring Authority Bias Across Expertise Levels in Language Modelscited by 8
- 2026Causality is Key for Interpretability Claims to Generalisecited by 8
13 more
- 2026Causality neq Invariance: Function and Concept Vectors in LLMscited by 8
- 2026Cell-Based Representation of Relational Binding in Language Modelscited by 5
- 2026ContextFocus: Activation Steering for Contextual Faithfulness in Large Language Modelscited by 4
- 2026Observable Patterns Are Not Explanations: A Causal-Geometric Analysis of Latent Reasoning Modelscited by 4
- 2026Certified Interventional Fidelity: Anytime-Valid, Adaptive Evaluation of Causal Claims in Mechanistic Interpretabilitycited by 4
- 2026SHIFT: Gate-Modulated Activation Steering for Knowledge Conflict Mitigation in Retrieval-Augmented Generationcited by 3
- 2026When Does Activation Steering Change What a Model Computes From?cited by 2
- 2026Patch-Effect Graph Kernels for LLM Interpretabilitycited by 1
- 2026Decodable but Not Faithful: Coupling Natural-Language Rationales to Programmatic Verifierscited by 1
- 2026A Mechanistic Lens on Semantic Conflicts: Using Activation Patching to Understand LLM Behaviorcited by 1
- 2026Token-Level Diagnosis of Sycophancy in LLMs with Attribution-Guided Steeringcited by 1
- 2026Test, then Route: How Language Models Execute In-Context Conditional Rules Across Models and Languagescited by 1
- 2026Steering the Language Axis: From Linear Decodability to Causal Controlcited by 1
Built on by
Not cited yet.