mlsanityData to 14 Oct 2026

What, Where, and How: Disentangling the Roles of Task, Language, and Model in Code Model Representations

arXiv 2607.21491 ↗First posted 23 Jul 2026cs.CL cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Do independently trained language models come to represent the same thing in the same way? We answer for code, extending a recently introduced concept-circuit extraction method to a 2x2 design -- Python and Rust crossed with Qwen2.5-Coder-7B and DeepSeek-Coder-V1-6.7B -- and measuring a complete inventory of grammatical concepts (58 Python, 57 Rust) identically in all four cells: the smallest design that separates what depends on the task, the language, and the model. The answer splits into three parts. What earns dedicated circuitry is set by the task: the models agree on which concepts receive circuits (Spearman ρ = 0.638 for Python, 0.673 for Rust, both p < 10-7). Where those circuits sit is set by the model: Qwen processes concepts in a late band (~L17-19), DeepSeek at L6-7, for both languages. How circuits grow across layers is also set by the model: Qwen gives its atomic concepts an early spike that DeepSeek does not. "Are circuits universal?" thus has no single answer: yes for What, no for Where and How -- universality is a property of representational content, not of computational organisation. None of this structure was fixed in advance. The agreement could have landed anywhere between independence and identity; it lands at ρ ≈ 0.65. Rust constructs receive 2-3x more concept-specific circuitry than their Python equivalents, in both models. Both models share neurons between the languages (6/7 and 7/7 paired constructs), DeepSeek 1.94x more than Qwen -- a direction no prior result predicts. And Qwen binds nine keywords of Rust's type-and-trait machinery into one tight neuron cluster (Jaccard 0.535 vs null 0.112, p < 0.001), a semantic dimension invisible in surface syntax. Ablation and linear probes confirm the circuits are functional. All claims are scoped to this 2x2; whether the per-model profile predicts a third model is the designed next test.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 28 references that are in the map. First posted on arXiv 23 Jul 2026.

Builds on

23 of 28 references.

References · 23

  1. 2022Locating and Editing Factual Associations in GPTcited by 2,691
  2. 2019Similarity of Neural Network Representations Revisitedcited by 1,755
  3. 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,420
  4. 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,165
  5. 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,059
  6. 2022Toy Models of Superpositioncited by 971
  7. 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 876
  8. 2023Towards Automated Circuit Discovery for Mechanistic Interpretabilitycited by 724
  9. 2024The Platonic Representation Hypothesiscited by 382
  10. 2023Finding Neurons in a Haystack: Case Studies with Sparse Probingcited by 334
  11. 2024How to use and interpret activation patchingcited by 214
  12. 2026Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnetcited by 191
11 more
  1. 2019Emerging Cross-lingual Structure in Pretrained Language Modelscited by 181
  2. 2023A Toy Model of Universality: Reverse Engineering How Networks Learn Group Operationscited by 144
  3. 2020When Being Unseen from mBERT is just the Beginning: Handling New Languages With Multilingual Language Modelscited by 131
  4. 2024Language-Specific Neurons: The Key to Multilingual Capabilities in Large Language Modelscited by 126
  5. 2024Universal Neurons in GPT2 Language Modelscited by 102
  6. 2022What Do They Capture? -- A Structural Analysis of Pre-Trained Language Models for Source Codecited by 50
  7. 2024Towards Universality: Studying Mechanistic Similarity Across Language Model Architecturescited by 31
  8. 2024The Same But Different: Structural Similarities and Differences in Multilingual Language Modelingcited by 28
  9. 2024Quantifying Feature Space Universality Across Large Language Models via Sparse Autoencoderscited by 27
  10. 2026When Meanings Meet: Investigating the Emergence and Quality of Shared Concept Spaces during Multilingual Language Model Trainingcited by 5
  11. 2026CSP-Atlas: Concept-Specific Neural Circuits in a Sparse Python Transformercited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Causal Syntax Circuits in CodeLMs: Budget and Probe Decide What Looks Localised
  2. 2024Exploring Concept Depth: How Large Language Models Acquire Knowledge and Concept at Different Layers?
  3. 2026Characterizing Model-Native Skills
  4. 2024What Makes Two Language Models Think Alike?
  5. 2026Data-driven Circuit Discovery for Interpretability of Language Models
  6. 2026What do Language Models Learn and When? The Implicit Curriculum Hypothesis
  7. 2024Circuit Compositions: Exploring Modular Structures in Transformer-Based Language Models
  8. 2026Reasoning Models Know What's Important, and Encode It in Their Activations