Syntactic Language Change in English and German: Metrics, Parsers, and Convergences
Not on the map. Why?
Abstract (arXiv)
Many studies have shown that human languages tend to optimize for lower complexity and increased communication efficiency. Syntactic dependency distance, which measures the linear distance between dependent words, is often considered a key indicator of language processing difficulty and working memory load. The current paper looks at diachronic trends in syntactic language change in both English and German, using corpora of parliamentary debates from the last c. 160 years. We base our observations on five dependency parsers, including the widely used Stanford CoreNLP as well as 4 newer alternatives. Our analysis of syntactic language change goes beyond linear dependency distance and explores 15 metrics relevant to dependency distance minimization (DDM) and/or based on tree graph properties, such as the tree height and degree variance. Even though we have evidence that recent parsers trained on modern treebanks are not heavily affected by data 'noise' such as spelling changes and OCR errors in our historic data, we find that results of syntactic language change are sensitive to the parsers involved, which is a caution against using a single parser for evaluating syntactic language change as done in previous work. We also show that syntactic language change over the time period investigated is largely similar between English and German for the different metrics explored: only 4% of cases we examine yield opposite conclusions regarding upwards and downtrends of syntactic metrics across German and English. We also show that changes in syntactic measures seem to be more frequent at the tails of sentence length distributions. To our best knowledge, ours is the most comprehensive analysis of syntactic language change using modern NLP technology in recent corpora of English and German.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 26 of its 111 references that are in the map. First posted on arXiv 18 Feb 2024.
Builds on
26 of 111 references.
References · 26
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
- 2020Stanza: A Python Natural Language Processing Toolkit for Many Human Languagescited by 719
- 2015Bidirectional LSTM-CRF Models for Sequence Taggingcited by 544
- 2016Deep Biaffine Attention for Neural Dependency Parsingcited by 334
- 2016Diachronic Word Embeddings Reveal Statistical Laws of Semantic Changecited by 219
- 2020Analysing Lexical Semantic Change with Contextualised Word Representationscited by 92
- 2018Survey of Computational Approaches to Lexical Semantic Changecited by 60
- 2017Dynamic Word Embeddingscited by 51
- 2020Efficient Second-Order TreeCRF for Neural Dependency Parsingcited by 48
- 2022Exploring Document-Level Literary Machine Translation with Parallel Paragraphs from World Literaturecited by 45
- 2018Stack-Pointer Networks for Dependency Parsingcited by 36
14 more
- 2019Time-Out: Temporal Referencing for Robust Modeling of Lexical Semantic Changecited by 32
- 2019Training Temporal Word Embeddings with a Compasscited by 22
- 2020The optimality of syntactic dependency distancescited by 15
- 2019Anti dependency distance minimization in short sequences. A graph theoretic approachcited by 13
- 2021Diachronic Analysis of German Parliamentary Proceedings: Ideological Shifts through the Lens of Political Biasescited by 13
- 2014That's sick dude!: Automatic identification of word sense change across different timescalescited by 11
- 2017On the Linearity of Semantic Change: Investigating Meaning Variation via Dynamic Graph Modelscited by 11
- 2024Graph-based Clustering for Detecting Semantic Change Across Time and Languagescited by 10
- 2022FastKASSIM: A Fast Tree Kernel-Based Syntactic Similarity Metriccited by 9
- 2023Cross-lingual Cross-temporal Summarization: Dataset, Models, Evaluationcited by 8
- 2016The scarcity of crossing dependencies: a direct outcome of a specific constraint?cited by 7
- 2022Natural Language Syntax Complies with the Free-Energy Principlecited by 7
- 2015Crossings as a side effect of dependency lengthscited by 3
- 2019Semantic Change and Emerging Tropes In a Large Corpus of New High German Poetrycited by 3
Built on by
Citing papers per year: 2024: 2; 2025: 1.
3 papers.
- 2025Model Misalignment and Language Change: Traces of AI-Associated Language in Unscripted Spoken Englishcited by 4
- 2024Exploring Diachronic and Diatopic Changes in Dialect Continua: Tasks, Datasets and Challengescited by 0
- 2024Exploring Sound Change Over Time: A Review of Computational and Human Perceptioncited by 0
- 2025Model Misalignment and Language Change: Traces of AI-Associated Language in Unscripted Spoken English1 Aug 2025
- 2024Exploring Sound Change Over Time: A Review of Computational and Human Perception6 Jul 2024
- 2024Exploring Diachronic and Diatopic Changes in Dialect Continua: Tasks, Datasets and Challenges4 Jul 2024