Rethinking Pivot Programming Languages in Code Language Models
New in LLM reasoning; no direction yet. LLM reasoning
Abstract (arXiv)
Multilingual code language models transfer skills across programming languages (PLs), but whether any PL occupies a privileged pivot position remains contested: geometric analyses point to C-family languages and Go, while behavioral evidence highlights Python. We revisit this question under controls for representational anisotropy and length variation across PLs, two confounds that compromise prior cosine-based analyses. Across three code models on multilingual competitive-programming data, we study three views of cross-PL organization: pairwise PL geometry, PL-English alignment, and pivoted retrieval through candidate PL representation spaces. The results are relation-dependent. Code-code geometry reveals structured language regions but no universal center; code-English alignment favors high-level scripting languages; and pivoted retrieval favors different intermediate spaces for code-to-code and English-to-code transfer. These findings suggest that Python's special role is better understood as English-facing affinity than as universal geometric centrality.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 23 references that are in the map. First posted on arXiv 19 Sep 2026.
Builds on
7 of 23 references.
References · 7
- 2023Code Llama: Open Foundation Models for Codecited by 2,139
- 2024Qwen2.5-Coder Technical Reportcited by 1,203
- 2023Eliciting Latent Predictions from Transformers with the Tuned Lenscited by 623
- 2025Neuron-Guided Interpretation of Code LLMs: Where, Why, and How?cited by 5
- 2025Beyond Language Boundaries: Uncovering Programming Language Families for Code Language Modelscited by 2
- 2026Large Language Models for Multilingual Code Intelligence: A Surveycited by 2
- 2025Semantic Pivots Enable Cross-Lingual Transfer in Large Language Modelscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Across Programming Language Silos: A Study on Cross-Lingual Retrieval-augmented Code Generation
- 2026Evaluating Language Models on Cross-Language Code Functional Equivalence
- 2026Multilingual Language Models Encode Script Over Linguistic Structure
- 2025code_transformed: The Influence of Large Language Models on Code
- 2025How Language Directions Align with Token Geometry in Multilingual LLMs
- 2026Subjective Code Preferences in Experts and Large Language Models ↗
- 2026What, Where, and How: Disentangling the Roles of Task, Language, and Model in Code Model Representations
- 2025A Study of LLMs' Preferences for Libraries and Programming Languages