# Restoring Hebrew Diacritics Without a Dictionary

arXiv: https://arxiv.org/abs/2105.05209 · HTML: https://mlsanity.com/paper/2105.05209/

## Key facts

- Cited by 10 papers in the map (data through 14 Oct 2026).
- Builds on 9 of its 25 references that are in the map.
- First posted on arXiv 11 May 2021.

## Builds on (most cited first, 9 of 9)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [Language (Technology) is Power: A Critical Survey of "Bias" in NLP](https://mlsanity.com/paper/2005.14050/) (2020)
- [Cyclical Learning Rates for Training Neural Networks](https://mlsanity.com/paper/1506.01186/) (2015)
- [Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraints](https://mlsanity.com/paper/1707.09457/) (2017)
- [Multilingual Part-of-Speech Tagging with Bidirectional Long Short-Term Memory Models and Auxiliary Loss](https://mlsanity.com/paper/1604.05529/) (2016)
- [Filling Gender & Number Gaps in Neural Machine Translation with Black-box Context Injection](https://mlsanity.com/paper/1903.03467/) (2019)
- [What's Wrong with Hebrew NLP? And How to Make it Right](https://mlsanity.com/paper/1908.05453/) (2019)
- [Nakdan: Professional Hebrew Diacritizer](https://mlsanity.com/paper/2005.03312/) (2020)

## Built on by (most cited first, 10 of 10)

- [Don't Touch My Diacritics](https://mlsanity.com/paper/2410.24140/) (2024)
- [Correcting diacritics and typos with a ByT5 transformer model](https://mlsanity.com/paper/2201.13242/) (2022)
- [Splintering Nonconcatenative Languages for Better Tokenization](https://mlsanity.com/paper/2503.14433/) (2025)
- [Critical Confabulation: Can LLMs Hallucinate for Social Good?](https://mlsanity.com/paper/2511.07722/) (2025)
- [Accent Placement Models for Rigvedic Sanskrit Text](https://mlsanity.com/paper/2511.23088/) (2025)
- [ReNikud: Audio-Supervised Hebrew Grapheme-to-Phoneme Conversion](https://mlsanity.com/paper/2606.20179/) (2026)
- [MenakBERT -- Hebrew Diacriticizer](https://mlsanity.com/paper/2410.02417/) (2024)
- [Phonikud: Overcoming Phonetic Underspecification for Hebrew Text-To-Speech](https://mlsanity.com/paper/2506.12311/) (2025)
- [Hebrew Diacritics Restoration using Visual Representation](https://mlsanity.com/paper/2510.26521/) (2025)
- [The Degree of Language Diacriticity and Its Effect on Tasks](https://mlsanity.com/paper/2603.27653/) (2026)

## Abstract (arXiv)

We demonstrate that it is feasible to diacritize Hebrew script without any human-curated resources other than plain diacritized text. We present NAKDIMON, a two-layer character level LSTM, that performs on par with much more complicated curation-dependent systems, across a diverse array of modern Hebrew sources.