Character-Level Transformer for Tajik-Persian Transliteration with a Parallel Lexical Corpus
Not on the map. Why?
Abstract (arXiv)
This study addresses automatic transliteration from Tajik (Cyrillic script) to Persian (Perso-Arabic script). We present a curated, lexicographically verified parallel corpus of 52,152 Tajik--Persian words and short phrases, compiled from printed dictionaries, encyclopedic sources, and manually verified online resources. To the best of our knowledge, this is one of the largest publicly available word-level corpora for Tajik--Persian transliteration. Using this corpus, we train a character-level sequence-to-sequence Transformer model and evaluate it using Character Error Rate (CER) and exact-match accuracy. The Transformer achieves a CER of 0.3216 and an exact-match accuracy of 0.3133, outperforming both dictionary-based rule-based and recurrent neural baselines. With beam search (k=3), performance further improves to CER 0.3182 and accuracy 0.3215. We describe the data collection and preprocessing pipeline, model architecture, and experimental protocol, and report a part-of-speech analysis showing performance differences across lexical categories. All preprocessing scripts, deterministic splits into training, validation, and test sets, and training configurations are released to support reproducibility and further research on Tajik and related Persian dialects. The corpus supports research in character-level transliteration, cross-script NLP, and lexicographic applications.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 4 of its 14 references that are in the map. First posted on arXiv 9 May 2026.
Builds on
4 of 14 references.
References · 4
- 2017Attention Is All You Needcited by 59,932
- 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,486
- 2020Persian Ezafe Recognition Using Transformers and Its Role in Part-Of-Speech Taggingcited by 4
- 2025Connecting the Persian-speaking World through Transliterationcited by 4
Built on by
Citing papers per year: 2026: 2.
2 papers.