The Cognate Data Bottleneck in Language Phylogenetics
Not on the map. Why?
Abstract (arXiv)
To fully exploit the potential of computational phylogenetic methods for cognate data one needs to leverage specific (complex) models an machine learning-based techniques. However, both approaches require datasets that are substantially larger than the manually collected cognate data currently available. To the best of our knowledge, there exists no feasible approach to automatically generate larger cognate datasets. We substantiate this claim by automatically extracting datasets from BabelNet, a large multilingual encyclopedic dictionary. We demonstrate that phylogenetic inferences on the respective character matrices yield trees that are largely inconsistent with the established gold standard ground truth trees. We also discuss why we consider it as being unlikely to be able to extract more suitable character matrices from other multilingual resources. Phylogenetic data analysis approaches that require larger datasets can therefore not be applied to cognate data. Thus, it remains an open question how, and if these computational approaches can be applied in historical linguistics.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 59 references that are in the map. First posted on arXiv 1 Jul 2025.
Builds on
17 of 59 references.
References · 17
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,312
- 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,067
- 2020XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalizationcited by 742
- 2023The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variantscited by 311
- 2023SIB-200: A Simple, Inclusive, and Big Evaluation Dataset for Topic Classification in 200+ Languages and Dialectscited by 152
- 2022MASSIVE: A 1M-Example Multilingual Natural Language Understanding Dataset with 51 Typologically-Diverse Languagescited by 146
- 2023Glot500: Scaling Multilingual Corpora and Language Models to 500 Languagescited by 116
- 2023XLM-V: Overcoming the Vocabulary Bottleneck in Multilingual Masked Language Modelscited by 88
- 2017BPEmb: Tokenization-free Pre-trained Subword Embeddings in 275 Languagescited by 52
- 2018Global-scale phylogenetic linguistic inference from lexical resourcescited by 15
- 2021Phonetic Word Embeddingscited by 7
5 more
- 2023PWESuite: Phonetic Word Embeddings and Tasks They Facilitatecited by 6
- 2024Automated Cognate Detection as a Supervised Link Prediction Task with Cognate Transformercited by 6
- 2024Are Sounds Sound for Phylogenetic Reconstruction?cited by 3
- 2024A Likelihood Ratio Test of Genetic Relationship among Languagescited by 2
- 2024Computational Approaches for Integrating out Subjectivity in Cognate Synonym Selectioncited by 2
Built on by
Not cited yet.