Which Attention Heads are like the Human Head? Not the Ones that Compute
Not on the map. Why?
Abstract (arXiv)
Brain-AI alignment is often interpreted as a sign that model and brain perform similar computations. Whether the aligned units are causally involved in model computation is rarely checked. On an abstract pattern-completion task (AAABAAA rightarrow B), we compare LLM attention-head representations with human EEG and test how ablating those heads affects task performance. Alignment and causation dissociate: brain-aligned heads contribute to performance, but their removal is substantially less disruptive than removal of heads selected via attribution patching. We compare two head sets that prior interpretability work defines without reference to the brain: concept vectors (CVs), which represent abstract patterns across formats, and function vectors (FVs), selected for their contribution to correct-answer prediction. Brain alignment shows little association with FV scores, while its association with CV scores varies across models. Among brain-aligned heads, we find recurring attention profiles: one emphasizes distinctive elements (novelty heads), the other repeating elements (repetition heads). The novelty family tracks salience and attends to the same elements that humans look at, yet its removal is less damaging than random ablation on average. Repetition heads contribute modestly to performance and are associated with abstract-pattern representation (CVs). Across 17 models spanning 3B-72B parameters, FV-ranked removal is substantially more disruptive than brain-ranked removal. Brain alignment thus captures how the model reads the stimulus, and only faintly captures how it represents the pattern and solves the task.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 18 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
8 of 18 references.
References · 8
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Pythia: A Suite for Analyzing Large Language Models Across Training and Scalingcited by 1,786
- 2023Function Vectors in Large Language Modelscited by 308
- 2023Neither hype nor gloom do DNNs justicecited by 40
- 2024The LLM Language Network: A Neuroscientific Approach for Identifying Causally Task-Relevant Unitscited by 34
- 2026Causality neq Invariance: Function and Concept Vectors in LLMscited by 8
- 2025Large Language Models Show Signs of Alignment with Human Neurocognition During Abstract Reasoningcited by 2
- 2026When Language Models Lose Their Mind: The Consequences of Brain Misalignmentcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Do Models See in Line with Human Vision? Probing the Correspondence Between LVLM Representations and EEG Signals
- 2026Brain alignment of reasoning and action representations from vision-language and action models during naturalistic gameplay
- 2025Scaling and context steer LLMs along the same computational path as the human brain
- 2026Similar Choices, Different Attention: Cross-Modal Associations in Humans and Vision-Language Models
- 2026Cognitive Expert Language Models Better Align with the Corresponding Brain Systems
- 2026Large Language Models Align with the Human Brain during Creative Thinking
- 2025Uncovering the Computational Ingredients of Human-Like Representations in LLMs
- 2023Instruction-tuning Aligns LLMs to the Human Brain