Logion: Machine Learning for Greek Philology
Not on the map. Why?
Abstract (arXiv)
This paper presents machine-learning methods to address various problems in Greek philology. After training a BERT model on the largest premodern Greek dataset used for this purpose to date, we identify and correct previously undetected errors made by scribes in the process of textual transmission, in what is, to our knowledge, the first successful identification of such errors via machine learning. Additionally, we demonstrate the model's capacity to fill gaps caused by material deterioration of premodern manuscripts and compare the model's performance to that of a domain expert. We find that best performance is achieved when the domain expert is provided with model suggestions for inspiration. With such human-computer collaborations in mind, we explore the model's interpretability and find that certain attention heads appear to encode select grammatical features of premodern Greek.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 9 of its 28 references that are in the map. First posted on arXiv 1 May 2023.
Builds on
9 of 28 references.
References · 9
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2019What Does BERT Look At? An Analysis of BERT's Attentioncited by 994
- 2019Likelihood Ratios for Out-of-Distribution Detectioncited by 451
- 2019BERT has a Mouth, and It Must Speak: BERT as a Markov Random Field Language Modelcited by 184
- 2021DEMix Layers: Disentangling Domains for Modular Language Modelingcited by 130
- 2019Likelihood Ratios and Generative Classifiers for Unsupervised Out-of-Domain Detection In Task Oriented Dialogcited by 33
- 2019Restoring ancient text using deep learning: a case study on Greek epigraphycited by 25
- 2021Attention Can Reflect Syntactic Structure (If You Let It)cited by 22
Built on by
Citing papers per year: 2023: 1; 2024: 1; 2025: 0; 2026: 1.
3 papers.
- 2023Sentence Embedding Models for Ancient Greek Using Multilingual Knowledge Distillationcited by 6
- 2024Mind the Gap: Analyzing Lacunae with Transformer-Based Transcriptioncited by 0
- 2026The Patrologia Graeca Corpus: OCR, Annotation, and Open Release of Noisy Nineteenth-Century Polytonic Greek Editionscited by 0
- 2026The Patrologia Graeca Corpus: OCR, Annotation, and Open Release of Noisy Nineteenth-Century Polytonic Greek Editions10 Mar 2026
- 2024Mind the Gap: Analyzing Lacunae with Transformer-Based Transcription28 Jun 2024
- 2023Sentence Embedding Models for Ancient Greek Using Multilingual Knowledge Distillation24 Aug 2023