mlsanityData to 14 Oct 2026

Rethinking Pivot Programming Languages in Code Language Models

arXiv 2609.22988 ↗First posted 19 Sep 2026cs.CLcited by 0

New in LLM reasoning; no direction yet. LLM reasoning

Abstract (arXiv)

Multilingual code language models transfer skills across programming languages (PLs), but whether any PL occupies a privileged pivot position remains contested: geometric analyses point to C-family languages and Go, while behavioral evidence highlights Python. We revisit this question under controls for representational anisotropy and length variation across PLs, two confounds that compromise prior cosine-based analyses. Across three code models on multilingual competitive-programming data, we study three views of cross-PL organization: pairwise PL geometry, PL-English alignment, and pivoted retrieval through candidate PL representation spaces. The results are relation-dependent. Code-code geometry reveals structured language regions but no universal center; code-English alignment favors high-level scripting languages; and pivoted retrieval favors different intermediate spaces for code-to-code and English-to-code transfer. These findings suggest that Python's special role is better understood as English-facing affinity than as universal geometric centrality.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 23 references that are in the map. First posted on arXiv 19 Sep 2026.

Builds on

7 of 23 references.

References · 7

  1. 2023Code Llama: Open Foundation Models for Codecited by 2,139
  2. 2024Qwen2.5-Coder Technical Reportcited by 1,203
  3. 2023Eliciting Latent Predictions from Transformers with the Tuned Lenscited by 623
  4. 2025Neuron-Guided Interpretation of Code LLMs: Where, Why, and How?cited by 5
  5. 2025Beyond Language Boundaries: Uncovering Programming Language Families for Code Language Modelscited by 2
  6. 2026Large Language Models for Multilingual Code Intelligence: A Surveycited by 2
  7. 2025Semantic Pivots Enable Cross-Lingual Transfer in Large Language Modelscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Across Programming Language Silos: A Study on Cross-Lingual Retrieval-augmented Code Generation
  2. 2026Evaluating Language Models on Cross-Language Code Functional Equivalence
  3. 2026Multilingual Language Models Encode Script Over Linguistic Structure
  4. 2025code_transformed: The Influence of Large Language Models on Code
  5. 2025How Language Directions Align with Token Geometry in Multilingual LLMs
  6. 2026Subjective Code Preferences in Experts and Large Language Models ↗
  7. 2026What, Where, and How: Disentangling the Roles of Task, Language, and Model in Code Model Representations
  8. 2025A Study of LLMs' Preferences for Libraries and Programming Languages