Scaling Self-Supervised Speech Models Uncovers Deep Linguistic Relationships: Evidence from the Pacific Cluster
Not on the map. Why?
Abstract (arXiv)
Similarities between language representations derived from Self-Supervised Speech Models (S3Ms) have been observed to primarily reflect geographic proximity or surface typological similarities driven by recent expansion or contact, potentially missing deeper genealogical signals. We investigate how scaling an S3M-based language identification system from 126 to 4,017 languages reshapes this topology, and find a non-linear effect: phylogenetic recovery stays flat up to the 1K scale, but the 4K model undergoes a qualitative shift, resolving both clear lineages and long-term linguistic contact. Most strikingly, a robust Pacific macro-cluster emerges, grouping genealogically unrelated Papuan, Oceanic, and Australian languages, and we trace its driver to a concentrated encoding that captures shared acoustic signatures such as global energy dynamics. These results suggest that massive S3Ms internalize multiple layers of language history, offering a promising perspective for computational phylogenetics and the study of language contact.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 5 of its 40 references that are in the map. First posted on arXiv 7 Mar 2026.
Builds on
5 of 40 references.
References · 5
- 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 469
- 2023Scaling Speech Technology to 1,000+ Languagescited by 411
- 2025Improving Cross-Lingual Phonetic Representation of Low-Resource Languages Through Language Similarity Analysiscited by 5
- 2025Neighbors and relatives: How do speech embeddings reflect linguistic connections across the world?cited by 3
- 2025Characterization of Speech Similarity Between Australian Aboriginal and High-Resource Languages: A Case Study on Dharawalcited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.