mlsanityData to 14 Oct 2026

Self-Supervised Lexical Representation Learning for Fast, Large-Scale Phylogenetic Inference

arXiv 2609.05262 ↗First posted 4 Sep 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Computational phylogenetics has become an essential tool in historical linguistics, yet its application at a global scale remains constrained by two factors: the labor-intensive manual annotation of cognacy judgments required for character-based methods and the substantial computational cost of inference on large datasets. This paper introduces a fully self-supervised contrastive learning framework that learns lexical representations directly from raw IPA-transcribed wordlists, without requiring cognacy annotations, alignments, or additional expert input. The model employs a dual contrastive objective: a word-level loss that organizes phonetically similar forms into a coherent space, and an auxiliary language-level loss that encourages the lexical space to reflect broader phonological properties of languages. From the resulting word representations, pairwise language distances are derived and used to infer a global phylogenetic tree of 3,399 language varieties. The inferred tree achieves a generalized quartet distance (GQD) to the Glottolog reference tree competitive with multiple baselines, while requiring only minutes of computation on a standard notebook GPU. Furthermore, the same representations capture diachronic concept stability: variance in pairwise distances across languages yields stability rankings that correlate significantly with established rankings. Ablation studies confirm that both the language-level objective and the use of phonetic feature vectors improved the inferred trees topology with regards to GQD. The framework thus provides a computationally efficient and fully automatic alternative for large-scale phylogenetic inference and offers a unified representation supporting downstream analyses at both the language and concept level.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 59 references that are in the map. First posted on arXiv 4 Sep 2026.

Builds on

24 of 59 references.

References · 24

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  3. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  4. 2019Choosing Transfer Languages for Cross-Lingual Learningcited by 144
  5. 2021ESimCSE: Enhanced Sample Building Method for Contrastive Learning of Unsupervised Sentence Embeddingcited by 74
  6. 2017Learning Language Representations for Typology Predictioncited by 40
  7. 2020Probing Multilingual BERT for Genetic and Typological Signalscited by 27
  8. 2020Bridging Linguistic Typology and Multilingual Machine Translation with Multi-View Language Representationscited by 21
  9. 2024URIEL+: Enhancing Linguistic Inclusion and Usability in a Typological and Multilingual Knowledge Basecited by 21
  10. 2016Continuous multilinguality with language vectorscited by 20
  11. 2019What do Language Representations Really Represent?cited by 17
  12. 2018Global-scale phylogenetic linguistic inference from lexical resourcescited by 15
12 more
  1. 2018Are Automatic Methods for Cognate Detection Good Enough for Phylogenetic Reconstruction in Historical Linguistics?cited by 15
  2. 2024LinguAlchemy: Fusing Typological and Geographical Elements for Unseen Language Generalizationcited by 10
  3. 2025Analyzing the Effect of Linguistic Similarity on Cross-Lingual Transfer: Tasks and Experimental Setups Mattercited by 10
  4. 2023Language Embeddings Sometimes Contain Typological Generalizationscited by 9
  5. 2025Untangling the Influence of Typology, Data and Model Architecture on Ranking Transfer Languages for Cross-Lingual POS Taggingcited by 9
  6. 2017Found in Translation: Reconstructing Phylogenetic Language Trees from Translationscited by 6
  7. 2020Predicting Typological Features in WALS using Language Embeddings and Conditional Probabilities: 'UFAL Submission to the SIGTYP 2020 Shared Taskcited by 6
  8. 2024Generating Feature Vectors from Phonetic Transcriptions in Cross-Linguistic Data Formatscited by 4
  9. 2024data2lang2vec: Data Driven Typological Features Completioncited by 4
  10. 2024Are Sounds Sound for Phylogenetic Reconstruction?cited by 3
  11. 2025Beyond cognacycited by 1
  12. 2025Self-Supervised Borrowing Detection on Multilingual Wordlistscited by 1

Built on by

Not cited yet.