A Computational Approach to Language Contact -- A Case Study of Persian
Not on the map. Why?
Abstract (arXiv)
We investigate structural traces of language contact in the intermediate representations of a monolingual language model. Focusing on Persian (Farsi) as a historically contact-rich language, we probe the representations of a Persian-trained model when exposed to languages with varying degrees and types of contact with Persian. Our methodology quantifies the amount of linguistic information encoded in intermediate representations and assesses how this information is distributed across model components for different morphosyntactic features. The results show that universal syntactic information is largely insensitive to historical contact, whereas morphological features such as Case and Gender are strongly shaped by language-specific structure, suggesting that contact effects in monolingual language models are selective and structurally constrained.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 6 of its 30 references that are in the map. First posted on arXiv 28 Jan 2026.
Builds on
6 of 30 references.
References · 6
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,059
- 2020A Theory of Usable Information Under Computational Constraintscited by 162
- 2020Finding Universal Grammatical Relations in Multilingual BERTcited by 110
- 2020ParsBERT: Transformer-based Model for Persian Language Understandingcited by 93
- 2018Modeling Language Variation and Universals: A Survey on Typological Linguistics for Natural Language Processingcited by 63
Built on by
Citing papers per year: 2026: 1.
1 paper.