mlsanityData to 7 Oct 2026

Simulated Adoption: Decoupling Magnitude and Direction in LLM In-Context Conflict Resolution

arXiv 2602.04918 ↗First posted 4 Feb 2026cs.LG cs.CL cs.CYcited by 0

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) frequently prioritize conflicting in-context information over pre-existing parametric memory, a phenomenon often termed sycophancy or compliance. However, the mechanistic realization of this behavior remains obscure, specifically how the model resolves these knowledge conflicts through compliance, and whether this suppression arises from signal magnitude dilution or directional geometric alteration within the residual stream. To resolve this, we conducted a layer-wise geometric analysis across Qwen-3-4B, Llama-3.1-8B, and GLM-4-9B, decomposing the residual stream updates induced by counter-factual contexts into radial (norm-based) and angular (cosine-based) components. Our empirical results reject the universality of the "Manifold Dilution" hypothesis, as two of the three architectures maintained stable residual norms despite exhibiting significant performance degradation on factual queries. Instead, we observed that compliance is consistently characterized by "Orthogonal Interference," where the conflicting context injects a steering vector that is quasi-orthogonal to the ground-truth direction, effectively rotating the hidden state representation. This suggests that models do not "unlearn" or suppress the magnitude of internal truths but rather employ a mechanism of geometric displacement to bypass the correct unembedding vector, effectively simulating adoption while preserving the original structural magnitude. These findings challenge scalar confidence metrics for detecting hallucinations and underscore the necessity of vectorial monitoring to distinguish between genuine knowledge integration and superficial in-context mimicry.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 18 references that are in the map. First posted on arXiv 4 Feb 2026.

Builds on

17 of 18 references.

References · 17

  1. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
  2. 2023Towards Understanding Sycophancy in Language Modelscited by 988
  3. 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 673
  4. 2023Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflictscited by 333
  5. 2024Knowledge Conflicts for LLMs: A Surveycited by 274
  6. 2023Simple synthetic data reduces sycophancy in large language modelscited by 174
  7. 2024ClashEval: Quantifying the tug-of-war between an LLM's internal prior and external evidencecited by 109
  8. 2024ReDeEP: Detecting Hallucination in Retrieval-Augmented Generation via Mechanistic Interpretabilitycited by 100
  9. 2025When Truth Is Overridden: Uncovering the Internal Origins of Sycophancy in Large Language Modelscited by 46
  10. 2025The Hidden Dimensions of LLM Alignment: A Multi-Dimensional Analysis of Orthogonal Safety Directionscited by 38
  11. 2026Sycophancy Hides Linearly in the Attention Headscited by 21
  12. 2024Analysing the Residual Stream of Language Models Under Knowledge Conflictscited by 15
5 more
  1. 2025An Axiomatic Assessment of Entropy- and Variance-based Uncertainty Quantification in Regressioncited by 9
  2. 2025The Geometries of Truth Are Orthogonal Across Taskscited by 9
  3. 2025Geometry of Decision Making in Language Modelscited by 8
  4. 2026Where Knowledge Collides: A Mechanistic Study of Intra-Memory Knowledge Conflict in Language Modelscited by 5
  5. 2025Unlocking In-Context Learning for Natural Datasets Beyond Language Modellingcited by 4

Built on by

Not cited yet.