# A Second Wave of UD Hebrew Treebanking and Cross-Domain Parsing

arXiv: https://arxiv.org/abs/2210.07873 · HTML: https://mlsanity.com/paper/2210.07873/

## Key facts

- Cited by 10 papers in the map (data through 14 Oct 2026).
- Builds on 9 of its 23 references that are in the map.
- First posted on arXiv 14 Oct 2022.

## Builds on (most cited first, 9 of 9)

- [Unsupervised Cross-lingual Representation Learning at Scale](https://mlsanity.com/paper/1911.02116/) (2019)
- [Stanza: A Python Natural Language Processing Toolkit for Many Human Languages](https://mlsanity.com/paper/2003.07082/) (2020)
- [Deep Biaffine Attention for Neural Dependency Parsing](https://mlsanity.com/paper/1611.01734/) (2016)
- [Predictive Biases in Natural Language Processing Models: A Conceptual Framework and Overview](https://mlsanity.com/paper/1912.11078/) (2019)
- [Trankit: A Light-Weight Transformer-based Toolkit for Multilingual Natural Language Processing](https://mlsanity.com/paper/2101.03289/) (2021)
- [All Roads Lead to UD: Converting Stanford and Penn Parses to English Universal Dependencies with Multilayer Annotations](https://mlsanity.com/paper/1909.00522/) (2019)
- [A Cross-Genre Ensemble Approach to Robust Reddit Part of Speech Tagging](https://mlsanity.com/paper/2004.14312/) (2020)
- [How Universal is Genre in Universal Dependencies?](https://mlsanity.com/paper/2112.04971/) (2021)
- [A Characterwise Windowed Approach to Hebrew Morphological Segmentation](https://mlsanity.com/paper/1808.07214/) (2018)

## Built on by (most cited first, 10 of 10)

- [DictaBERT: A State-of-the-Art BERT Suite for Modern Hebrew](https://mlsanity.com/paper/2308.16687/) (2023)
- [Why Can't Discourse Parsing Generalize? A Thorough Investigation of the Impact of Data Diversity](https://mlsanity.com/paper/2302.06488/) (2023)
- [UCxn: Typologically Informed Annotation of Constructions Atop Universal Dependencies](https://mlsanity.com/paper/2403.17748/) (2024)
- [Splintering Nonconcatenative Languages for Better Tokenization](https://mlsanity.com/paper/2503.14433/) (2025)
- [Explicit Morphological Knowledge Improves Pre-training of Language Models for Hebrew](https://mlsanity.com/paper/2311.00658/) (2023)
- [Are UD Treebanks Getting More Consistent? A Report Card for English UD](https://mlsanity.com/paper/2302.00636/) (2023)
- [The Knesset Corpus: An Annotated Corpus of Hebrew Parliamentary Proceedings](https://mlsanity.com/paper/2405.18115/) (2024)
- [A UD Treebank for Bohairic Coptic](https://mlsanity.com/paper/2504.18386/) (2025)
- [Dicta-LM 3.0: Advancing The Frontier of Hebrew Sovereign LLMs](https://mlsanity.com/paper/2602.02104/) (2026)
- [Datasets for Verb Alternations across Languages: BLM Templates and Data Augmentation Strategies](https://mlsanity.com/paper/2603.15295/) (2026)

## Abstract (arXiv)

Foundational Hebrew NLP tasks such as segmentation, tagging and parsing, have relied to date on various versions of the Hebrew Treebank (HTB, Sima'an et al. 2001). However, the data in HTB, a single-source newswire corpus, is now over 30 years old, and does not cover many aspects of contemporary Hebrew on the web. This paper presents a new, freely available UD treebank of Hebrew stratified from a range of topics selected from Hebrew Wikipedia. In addition to introducing the corpus and evaluating the quality of its annotations, we deploy automatic validation tools based on grew (Guillaume, 2021), and conduct the first cross domain parsing experiments in Hebrew. We obtain new state-of-the-art (SOTA) results on UD NLP tasks, using a combination of the latest language modelling and some incremental improvements to existing transformer based approaches. We also release a new version of the UD HTB matching annotation scheme updates from our new corpus.