mlsanityData to 7 Oct 2026

Closure-Validated Circuit Discovery in Attention Heads: Co-activation Proposes, Ablation Disposes

arXiv 2606.09607 ↗First posted 8 Jun 2026cs.LG cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Interpretability increasingly treats groups of components, not individual units, as the basic object, and proposes to find them by clustering co-activation statistics. We ask whether such a cheap signal actually identifies an attention-head circuit. Adapting a sparse-autoencoder clustering recipe to attention heads -- but validating by causal ablation rather than reconstruction -- we cluster heads and then run a closure test: ablate the discovered community and compare per-example damage to matched-random controls. Across two dense 1B-scale models (Pythia 1B, OLMo 1B) and two input distributions, the communities pass closure. In a Mixture-of-Experts model (OLMoE-1B-7B), route-conditional clustering recovers a statistically real signal that nonetheless does not survive closure -- ablation improves loss, the wrong direction. Extending closure across training, attention-target selectivity and participation ratio decouple from function in both directions. We conclude that a cheap signal is a circuit proposal, not a confirmed circuit; closure is what separates them.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 8 of its 11 references that are in the map. First posted on arXiv 8 Jun 2026.

Builds on

8 of 11 references.

References · 8

  1. 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,130
  2. 2023Towards Automated Circuit Discovery for Mechanistic Interpretabilitycited by 700
  3. 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 679
  4. 2024Not All Language Model Features Are One-Dimensionally Linearcited by 201
  5. 2024The Geometry of Categorical and Hierarchical Concepts in Large Language Modelscited by 151
  6. 2025Language Models Use Trigonometry to Do Additioncited by 68
  7. 2026Do Sparse Autoencoders Capture Concept Manifolds?cited by 25
  8. 2026Spectral Probe-Circuits: A Three-Step Recipe for Identifying Attention-Head Circuits in Pretrained Transformerscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Pattern Selectivity is Not Task-Causal Structure: A Cross-Architecture Mechanistic Study of Composed-Task Circuits in 1B-Class Language Models
  2. 2025Causal Head Gating: A Framework for Interpreting Roles of Attention Heads in Transformers
  3. 2026Where Reliability Lives in Vision-Language Models: A Mechanistic Study of Attention, Hidden States, and Causal Circuits
  4. 2026Structural Graph Probing of Vision-Language Models
  5. 2026When Do Attention Circuits Form? Developmental Trajectories of Capability and Attention-Sink Emergence Across Three 1B-ClassArchitectures
  6. 2025Disentangling Recall and Reasoning in Transformer Models through Layer-wise Attention and Activation Analysis
  7. 2025Cognitive Mirrors: Exploring the Diverse Functional Roles of Attention Heads in LLM Reasoning
  8. 2025Thinking Sparks!: Emergent Attention Heads in Reasoning Models During Post Training