mlsanityData to 14 Oct 2026

Zero-Compute Cross-Lingual Transferability Estimation Using Typological Feature Proxies

arXiv 2609.39640 ↗First posted 30 Sep 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Cross-lingual transfer describes how knowledge in a source language benefits a target language. Measuring it quantitatively requires broad multilingual pre-training, as prior work has done with cross-lingual transfer matrices. We ask whether transfer is predictable from freely available typological features, and whether the prominence of high-resource source languages reflects typology or data quality and quantity. We show that typological databases contain cheap and dense signals about cross-lingual transfer. Our typology-only random forest on a 24-language prior-work transfer matrix scores leave-one-language-out ρ=0.705 and R2=0.49, beating a non-typological control at ρ=0.62, which verifies the ability of typology-only predictions to reconstruct costly measured cross-lingual transfer. The signal survives leave-one-script-out and leave-one-family-out protocols, so script and family confounding do not explain the effect. By decomposing the transfer into a typology term and a resource-and-script bias term, we find the best-source ranking sensitive to this bias. In contrast, typology is not affected by this bias, which makes it a zero-compute screening tool that replaces hundreds of training runs with a model fit. Our code is available hrefhttps://github.com/dharmsen/typo-x-ling-transferhere.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 65 references that are in the map. First posted on arXiv 30 Sep 2026.

Builds on

9 of 65 references.

References · 9

  1. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,918
  2. 2023Language Model Tokenizers Introduce Unfairness Between Languagescited by 214
  3. 2020LEEP: A New Measure to Evaluate Transferability of Learned Representationscited by 188
  4. 2021LogME: Practical Assessment of Pre-trained Models for Transfer Learningcited by 172
  5. 2024Scaling Laws for Multilingual Language Modelscited by 23
  6. 2025ATLAS: Adaptive Transfer Scaling Laws for Multilingual Pretraining, Finetuning, and Decoding the Curse of Multilingualitycited by 22
  7. 2022Languages You Know Influence Those You Learn: Impact of Language Characteristics on Multi-Lingual Text-to-Text Transfercited by 11
  8. 2025Untangling the Influence of Typology, Data and Model Architecture on Ranking Transfer Languages for Cross-Lingual POS Taggingcited by 9
  9. 2026ShapleyLaw: A Game-Theoretic Approach to Multilingual Scaling Lawscited by 3

Built on by

Not cited yet.