Deciphering Undersegmented Ancient Scripts Using Phonetic Prior
Not on the map. Why?
Abstract (arXiv)
Most undeciphered lost languages exhibit two characteristics that pose significant decipherment challenges: (1) the scripts are not fully segmented into words; (2) the closest known language is not determined. We propose a decipherment model that handles both of these challenges by building on rich linguistic constraints reflecting consistent patterns in historical sound change. We capture the natural phonological geometry by learning character embeddings based on the International Phonetic Alphabet (IPA). The resulting generative framework jointly models word segmentation and cognate alignment, informed by phonological constraints. We evaluate the model on both deciphered languages (Gothic, Ugaritic) and an undeciphered one (Iberian). The experiments show that incorporating phonetic geometry leads to clear and consistent gains. Additionally, we propose a measure for language closeness which correctly identifies related languages for Gothic and Ugaritic. For Iberian, the method does not show strong evidence supporting Basque as a related language, concurring with the favored position by the current scholarship.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). First posted on arXiv 21 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2023: 3; 2024: 1; 2025: 2; 2026: 3.
9 papers.
- 2025Ancient Script Image Recognition and Processing: A Reviewcited by 6
- 2023DeepScribe: Localization and Classification of Elamite Cuneiform Signs Via Deep Learningcited by 4
- 2023Insightful analysis of historical sources at scales beyond human capabilities using unsupervised Machine Learning and XAIcited by 3
- 2025DongbaMIE: A Multimodal Information Extraction Dataset for Evaluating Semantic Understanding of Dongba Pictogramscited by 3
- 2023Mergen: The First Manchu-Korean Machine Translation Model Trained on Augmented Datacited by 2
- 2024Decipherment-Aware Multilingual Learning in Jointly Trained Language Modelscited by 0
- 2026Curation of a Palaeohispanic Dataset for Machine Learningcited by 0
- 2026We Hebben Een Serieus Translatie: Modeling Intercomprehension as Probabilistic Inferencecited by 0
- 2026Tangut Word Segmentation under Extreme Resource Scarcity: Integrating Traditional Lexicons and Unlabeled Textcited by 0
- 2026Tangut Word Segmentation under Extreme Resource Scarcity: Integrating Traditional Lexicons and Unlabeled Text19 Aug 2026
- 2026We Hebben Een Serieus Translatie: Modeling Intercomprehension as Probabilistic Inference13 Jul 2026
- 2026Curation of a Palaeohispanic Dataset for Machine Learning20 Mar 2026
- 2025Ancient Script Image Recognition and Processing: A Review24 Jun 2025
- 2025DongbaMIE: A Multimodal Information Extraction Dataset for Evaluating Semantic Understanding of Dongba Pictograms5 Mar 2025
- 2024Decipherment-Aware Multilingual Learning in Jointly Trained Language Models11 Jun 2024
- 2023Mergen: The First Manchu-Korean Machine Translation Model Trained on Augmented Data29 Nov 2023
- 2023Insightful analysis of historical sources at scales beyond human capabilities using unsupervised Machine Learning and XAI13 Oct 2023
- 2023DeepScribe: Localization and Classification of Elamite Cuneiform Signs Via Deep Learning2 Jun 2023