Function Lives Where Variance Doesn't: Task-Weighted Charts of a Language Model's Computation
Not on the map. Why?
Abstract (arXiv)
How many dimensions does a language model's computation actually use? The question is ill-posed until one names a functional. Task-weighted charts make it well-posed: low-dimensional coordinate systems fit against a chosen functional of the representation, under the functional's own metric, turning distillation into plain least squares. Across six models from three families, spanning 70m to 7B parameters, next-token prediction needs 70--90% of the residual stream's width to stay within 5% of intact perplexity, a width consumed by the rare tail of language, and the variance profile predicts none of it: two directions carry 90% of GPT-2's activation variance and almost none of its function. Dimension is per-functional: the model's own uncertainty reads from six coordinates where the full predictive distribution needs hundreds; and it grows with depth. The dissociation is exploitable: when only a few dimensions can be kept, charts trained under the functional's metric preserve the model's predictions better than variance-based or optimal linear compression.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 21 references that are in the map. First posted on arXiv 12 Aug 2026.
Builds on
15 of 21 references.
References · 15
- 2016Pointer Sentinel Mixture Modelscited by 3,096
- 2019How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddingscited by 784
- 2020Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuningcited by 671
- 2023Eliciting Latent Predictions from Transformers with the Tuned Lenscited by 623
- 2018Estimating the intrinsic dimension of datasets by a minimal neighborhood informationcited by 250
- 2024SVD-LLM: Truncation-aware Singular Value Decomposition for Large Language Model Compressioncited by 243
- 2022Language model compression with weighted low-rank factorizationcited by 195
- 2026Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnetcited by 191
- 2021All Bark and No Bite: Rogue Dimensions in Transformer Language Models Obscure Representational Qualitycited by 156
- 2023The Truth is in There: Improving Reasoning in Language Models with Layer-Selective Rank Reductioncited by 123
- 2023Future Lens: Anticipating Subsequent Tokens from a Single Hidden Statecited by 121
- 2023The geometry of hidden representations of large transformer modelscited by 112
Built on by
Not cited yet.