Topographic Training Concentrates Causal Circuits Without Improving Neuron Monosemanticity
On the map: Mechanistic interpretability → Interpreting vision and multimodal models
Abstract (arXiv)
Mechanistic interpretability of vision transformers seeks to decompose model computation into human-readable units, but learned representations entangle many concepts in each neuron. Feature superposition is widely treated as the central obstacle to this decomposition, yet most mitigations (sparse autoencoders, dictionary learning) are post-hoc and leave the underlying network unchanged. We ask whether a spatial-locality training loss (TopoLoss) can act as a lightweight, training-time prior that improves interpretability of standard mech-interp tools. Training ViT on ImageNet-100 across multiple TopoLoss weights α, we measure causal sufficiency of topographic clusters via activation patching and feature geometry via sparse autoencoders fit to the same residual stream. At α=1.0, topographic clusters are 2.79× more causally sufficient than random unit sets of the same size, with the effect increasing monotonically in α. SAE L0 sparsity decreases by 11% and dead-feature fraction rises 19-fold, yet standard neuron-level monosemanticity scores are unchanged, indicating that topographic pressure acts at circuit level, concentrating causal mass into spatially local structures without disentangling individual neurons. This dissociation suggests current neuron-level monosemanticity metrics are insensitive to a class of real interpretability gains, and positions cheap architectural priors as a viable training-time complement to post-hoc tooling.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Interpreting vision and multimodal models, one of 13 directions in Mechanistic interpretability. Builds on 7 of its 12 references that are in the map. First posted on arXiv 21 Sep 2026.
Builds on
7 of 12 references.
Closest ancestors · 1
Same direction, newest first
Other references · 6
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2013Visualizing and Understanding Convolutional Networkscited by 2,290
- 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,420
- 2022Toy Models of Superpositioncited by 971
- 2023Towards Automated Circuit Discovery for Mechanistic Interpretabilitycited by 724
- 2025TopoNets: High Performing Vision and Language Models with Brain-Like Topographycited by 10
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Scale Alone Does not Improve Mechanistic Interpretability in Vision Models
- 2026Measuring Monosemanticity in Sparse Autoencoders via Latent Activation Coherence
- 2026MonoLoss: A Training Objective for Interpretable Monosemantic Representations
- 2026Fundamental Limits of Neural Network Sparsification: Evidence from Catastrophic Interpretability Collapse
- 2026Sparse but not Simpler: A Multi-Level Interpretability Analysis of Vision Transformers
- 2026Mechanistically Interpretable Neural Encoding Reveals Fine-Grained Functional Selectivity in Human Visual Cortex
- 2026Sparse Transformer: a Controlled Testbed for Mechanistic Interpretability
- 2024Evaluating Open-Source Sparse Autoencoders on Disentangling Factual Knowledge in GPT-2 Small