mlsanityData to 14 Oct 2026

Function Lives Where Variance Doesn't: Task-Weighted Charts of a Language Model's Computation

arXiv 2609.18989 ↗First posted 12 Aug 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

How many dimensions does a language model's computation actually use? The question is ill-posed until one names a functional. Task-weighted charts make it well-posed: low-dimensional coordinate systems fit against a chosen functional of the representation, under the functional's own metric, turning distillation into plain least squares. Across six models from three families, spanning 70m to 7B parameters, next-token prediction needs 70--90% of the residual stream's width to stay within 5% of intact perplexity, a width consumed by the rare tail of language, and the variance profile predicts none of it: two directions carry 90% of GPT-2's activation variance and almost none of its function. Dimension is per-functional: the model's own uncertainty reads from six coordinates where the full predictive distribution needs hundreds; and it grows with depth. The dissociation is exploitable: when only a few dimensions can be kept, charts trained under the functional's metric preserve the model's predictions better than variance-based or optimal linear compression.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 21 references that are in the map. First posted on arXiv 12 Aug 2026.

Builds on

15 of 21 references.

References · 15

  1. 2016Pointer Sentinel Mixture Modelscited by 3,096
  2. 2019How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddingscited by 784
  3. 2020Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuningcited by 671
  4. 2023Eliciting Latent Predictions from Transformers with the Tuned Lenscited by 623
  5. 2018Estimating the intrinsic dimension of datasets by a minimal neighborhood informationcited by 250
  6. 2024SVD-LLM: Truncation-aware Singular Value Decomposition for Large Language Model Compressioncited by 243
  7. 2022Language model compression with weighted low-rank factorizationcited by 195
  8. 2026Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnetcited by 191
  9. 2021All Bark and No Bite: Rogue Dimensions in Transformer Language Models Obscure Representational Qualitycited by 156
  10. 2023The Truth is in There: Improving Reasoning in Language Models with Layer-Selective Rank Reductioncited by 123
  11. 2023Future Lens: Anticipating Subsequent Tokens from a Single Hidden Statecited by 121
  12. 2023The geometry of hidden representations of large transformer modelscited by 112
3 more
  1. 2026Verbalizable Representations Form a Global Workspace in Language Modelscited by 75
  2. 2024Identifying Functionally Important Features with End-to-End Sparse Dictionary Learningcited by 67
  3. 2026Intrinsic Green's Learning: Supervised Learning on Manifolds via Inverse PDEcited by 1

Built on by

Not cited yet.