mlsanityData to 14 Oct 2026

Localizing Anchoring Pathways in Language Models

arXiv 2606.12818 ↗First posted 11 Jun 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Irrelevant numbers in a prompt can shift language model judgments, producing anchoring effects in numerical reasoning. We study where this anchor-sensitive signal is carried inside language models using a controlled multiple-choice setup with shared answer options. We define a logit-difference metric comparing the correct answer option with the answer option corresponding to the anchor, and validate that it tracks behavioral anchoring. Using attribution-based circuit localization on 7B--8B Qwen and Llama base and instruction-tuned models, we find that edge-level methods recover this signal more faithfully than node-level methods. Low- and high-anchor circuits transfer strongly within a model, suggesting shared pathway structure across anchor direction. However, sparse transfer across base and instruction-tuned variants is less reliable, indicating that post-training changes which pathways matter most. Overall, our results provide a mechanistic account of how anchoring-related decision signals are carried inside language models.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 28 references that are in the map. First posted on arXiv 11 Jun 2026.

Builds on

13 of 28 references.

References · 13

  1. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
  2. 2022Locating and Editing Factual Associations in GPTcited by 2,691
  3. 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,165
  4. 2023Towards Best Practices of Activation Patching in Language Models: Metrics and Methodscited by 359
  5. 2023Attribution Patching Outperforms Automated Circuit Discoverycited by 209
  6. 2023Localizing Model Behavior with Path Patchingcited by 195
  7. 2023Does Circuit Analysis Interpretability Scale? Evidence from Multiple Choice Capabilities in Chinchillacited by 149
  8. 2024Have Faith in Faithfulness: Going Beyond Circuit Overlap When Finding Model Mechanismscited by 149
  9. 2024AtP*: An efficient and scalable method for localizing LLM behaviour to componentscited by 111
  10. 2024Anchoring Bias in Large Language Models: An Experimental Studycited by 37
  11. 2024Answer, Assemble, Ace: Understanding How LMs Answer Multiple Choice Questionscited by 35
  12. 2025How Does Cognitive Bias Affect Large Language Models? A Case Study on the Anchoring Effect in Price Negotiation Simulationscited by 7
1 more
  1. 2025Anchors in the Machine: Behavioral and Attributional Evidence of Anchoring Bias in LLMscited by 3

Built on by

Not cited yet.