Comparative Analysis of Static and Contextual Embeddings for Analyzing Semantic Changes in Medieval Latin Charters
Not on the map. Why?
Abstract (arXiv)
The Norman Conquest of 1066 C.E. brought profound transformations to England's administrative, societal, and linguistic practices. The DEEDS (Documents of Early England Data Set) database offers a unique opportunity to explore these changes by examining shifts in word meanings within a vast collection of Medieval Latin charters. While computational linguistics typically relies on vector representations of words like static and contextual embeddings to analyze semantic changes, existing embeddings for scarce and historical Medieval Latin are limited and may not be well-suited for this task. This paper presents the first computational analysis of semantic change pre- and post-Norman Conquest and the first systematic comparison of static and contextual embeddings in a scarce historical data set. Our findings confirm that, consistent with existing studies, contextual embeddings outperform static word embeddings in capturing semantic change within a scarce historical corpus.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 19 of its 42 references that are in the map. First posted on arXiv 11 Oct 2024.
Builds on
19 of 42 references.
References · 19
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
- 2018Deep contextualized word representationscited by 2,285
- 2016Enriching Word Vectors with Subword Informationcited by 1,578
- 2016Diachronic Word Embeddings Reveal Statistical Laws of Semantic Changecited by 219
- 2020SemEval-2020 Task 1: Unsupervised Lexical Semantic Change Detectioncited by 105
- 2018Unsupervised Alignment of Embeddings with Wasserstein Procrustescited by 96
- 2020Analysing Lexical Semantic Change with Contextualised Word Representationscited by 92
- 2014Temporal Analysis of Language through Neural Language Modelscited by 53
- 2020Latin BERT: A Contextual Language Model for Classical Philologycited by 43
7 more
- 2019Leveraging Contextual Embeddings for Detecting Diachronic Semantic Shiftcited by 37
- 2021Lexical Semantic Change Discoverycited by 13
- 2022HistBERT: A Pre-trained Language Model for Diachronic Lexical Semantic Analysiscited by 11
- 2020ELMo and BERT in semantic change detection for Russiancited by 8
- 2020SST-BERT at SemEval-2020 Task 1: Semantic Shift Tracing by Clustering in BERT-based Embedding Spacescited by 6
- 2019Empirical Study of Diachronic Word Embeddings for Scarce Datacited by 2
- 2020The Frankfurt Latin Lexicon: From Morphological Expansion and Word Embeddings to SemioGraphscited by 1
Built on by
Citing papers per year: 2024: 1.
1 paper.