# UDPipe at EvaLatin 2020: Contextualized Embeddings and Treebank Embeddings

arXiv: https://arxiv.org/abs/2006.03687 · HTML: https://mlsanity.com/paper/2006.03687/

## Key facts

- Cited by 6 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 5 Jun 2020.

## Built on by (most cited first, 6 of 6)

- [Domain Adaptation in Neural Machine Translation using a Qualia-Enriched FrameNet](https://mlsanity.com/paper/2202.10287/) (2022)
- ['UFAL LatinPipe at EvaLatin 2024: Morphosyntactic Analysis of Latin](https://mlsanity.com/paper/2404.05839/) (2024)
- [Latin Treebanks in Review: An Evaluation of Morphological Tagging Across Time](https://mlsanity.com/paper/2408.06675/) (2024)
- [Construction and educational application of a linguistically grounded dependency treebank for Uyghur](https://mlsanity.com/paper/2507.21536/) (2025)
- [Detecting Latin in Historical Books with Large Language Models: A Multimodal Benchmark](https://mlsanity.com/paper/2510.19585/) (2025)
- [THIVLVC: Retrieval Augmented Dependency Parsing for Latin](https://mlsanity.com/paper/2604.05564/) (2026)

## Abstract (arXiv)

We present our contribution to the EvaLatin shared task, which is the first evaluation campaign devoted to the evaluation of NLP tools for Latin. We submitted a system based on UDPipe 2.0, one of the winners of the CoNLL 2018 Shared Task, The 2018 Shared Task on Extrinsic Parser Evaluation and SIGMORPHON 2019 Shared Task. Our system places first by a wide margin both in lemmatization and POS tagging in the open modality, where additional supervised data is allowed, in which case we utilize all Universal Dependency Latin treebanks. In the closed modality, where only the EvaLatin training data is allowed, our system achieves the best performance in lemmatization and in classical subtask of POS tagging, while reaching second place in cross-genre and cross-time settings. In the ablation experiments, we also evaluate the influence of BERT and XLM-RoBERTa contextualized embeddings, and the treebank encodings of the different flavors of Latin treebanks.