Decodable But Not Detachable: Training Data Granularity Determines Parametric Modularity in Large Language Models
Not on the map. Why?
Abstract (arXiv)
Do large language models contain domain-specific parametric shells: concentrated, causally necessary neuron populations whose removal selectively degrades a target domain while sparing others? We apply a uniform causal methodology across two domain granularities, three model families (1.5B to 7B parameters), and eight domains. At the academic subject level, zero neurons exceed 60% domain selectivity across 939,008 combined FFN neurons and causal damage matrices are flat, despite domain identity being linearly decodable above 85% accuracy. At the language and modality level, 0.65--1.14% of neurons exceed 60% selectivity, damage matrices are near-perfectly diagonal (ratios up to 595:1), and shell neuron sets are essentially disjoint (IoU < 0.003). Masking code-selective neurons reduces mathematical reasoning accuracy by 16--24 percentage points across all models; masking Spanish or Chinese neurons leaves it at or below random. Shell strength increases monotonically with scale and shells are spatially interleaved in a pattern that precludes group-level selective quantization. Parametric shells form where and only where training data was modular at the token level.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 20 references that are in the map. First posted on arXiv 10 Aug 2026.
Builds on
14 of 20 references.
References · 14
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
- 2021Program Synthesis with Large Language Modelscited by 3,637
- 2016Pointer Sentinel Mixture Modelscited by 3,096
- 2018Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answeringcited by 2,164
- 2022GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformerscited by 1,919
- 2023AWQ: Activation-aware Weight Quantization for LLM Compression and Accelerationcited by 1,298
- 2021Knowledge Neurons in Pretrained Transformerscited by 601
- 2024Massive Activations in Large Language Modelscited by 294
- 2024Do Llamas Work in English? On the Latent Language of Multilingual Transformerscited by 281
- 2024Language-Specific Neurons: The Key to Multilingual Capabilities in Large Language Modelscited by 126
2 more
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Exploring the Limits of Pruning: Task-Specific Neurons, Model Collapse, and Recovery in Task-Specific Large Language Models
- 2026Neuron Level Analysis of Large Language Model in Legal Domain Reasoning
- 2026Neural networks are more modular than single neurons suggest
- 2024The LLM Language Network: A Neuroscientific Approach for Identifying Causally Task-Relevant Units
- 2026Beyond Language: Format-Agnostic Reasoning Subspaces in Large Language Models
- 2024Can Large Language Models Learn Independent Causal Mechanisms?
- 2024Circuit Compositions: Exploring Modular Structures in Transformer-Based Language Models
- 2025Sparse Neuron Ablation Triggers Catastrophic Collapse of the Language Core in Large Vision-Language Models