PersianPunc: A Large-Scale Dataset and BERT-Based Approach for Persian Punctuation Restoration
Not on the map. Why?
Abstract (arXiv)
Punctuation restoration is essential for improving the readability and downstream utility of automatic speech recognition (ASR) outputs, yet remains underexplored for Persian despite its importance. We introduce PersianPunc, a large-scale, high-quality dataset of 17 million samples for Persian punctuation restoration, constructed through systematic aggregation and filtering of existing textual resources. We formulate punctuation restoration as a token-level sequence labeling task and fine-tune ParsBERT to achieve strong performance. Through comparative evaluation, we demonstrate that while large language models can perform punctuation restoration, they suffer from critical limitations: over-correction tendencies that introduce undesired edits beyond punctuation insertion (particularly problematic for speech-to-text pipelines) and substantially higher computational requirements. Our lightweight BERT-based approach achieves a macro-averaged F1 score of 91.33% on our test set while maintaining efficiency suitable for real-time applications. We make our dataset (https://huggingface.co/datasets/MohammadJRanjbar/persian-punctuation-restoration) and model (https://huggingface.co/MohammadJRanjbar/parsbert-persian-punctuation) publicly available to facilitate future research in Persian NLP and provide a scalable framework applicable to other morphologically rich, low-resource languages.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 7 of its 23 references that are in the map. First posted on arXiv 5 Mar 2026.
Builds on
7 of 23 references.
References · 7
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020ParsBERT: Transformer-based Model for Persian Language Understandingcited by 92
- 2018Punctuation Prediction Model for Conversational Speechcited by 20
- 2021Automatic punctuation restoration with BERT modelscited by 12
- 2021ViraPart: A Text Refinement Framework for Automatic Speech Recognition and Natural Language Processing Tasks in Persiancited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.