Arabic Sentence Segmentation Across Genres and Punctuation Conditions
Not on the map. Why?
Abstract (arXiv)
Sentence segmentation in Arabic is challenging due to ambiguous and inconsistent punctuation, with many texts lacking reliable sentence boundary markers. Existing approaches rely heavily on punctuation cues and are typically evaluated on well-formed text, limiting their robustness in realistic Arabic settings. To address this, we introduce AraSEG, a genre-diverse sentence segmentation corpus spanning eight genres and a wide range of punctuation and document structure conditions. Using AraSEG, we evaluate LLMs, lightweight encoder models, and dependency parser-based models under increasingly challenging segmentation settings. Our experiments show that lightweight encoders, and even dependency parser-based models, outperform LLMs under the hardest conditions. We further investigate the effects of training data size and genre diversity, finding that performance eventually saturates and cross-genre generalization remains challenging. We also demonstrate that accurate sentence segmentation substantially improves downstream dependency parsing. We make our code, data, and models publicly available.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 12 of its 55 references that are in the map. First posted on arXiv 6 Jun 2026.
Builds on
12 of 55 references.
References · 12
- 2016Deep Biaffine Attention for Neural Dependency Parsingcited by 334
- 2021The Interplay of Variant, Size, and Task Type in Arabic Pre-trained Language Modelscited by 118
- 2024ArabicMMLU: Assessing Massive Multitask Language Understanding in Arabiccited by 87
- 2024Segment Any Text: A Universal Approach for Robust, Efficient and Adaptable Sentence Segmentationcited by 41
- 2020PySBD: Pragmatic Sentence Boundary Disambiguationcited by 38
- 2023Advancements in Arabic Grammatical Error Detection and Correction: An Empirical Investigationcited by 22
- 2023Where's the Point? Self-Supervised Multilingual Punctuation-Agnostic Sentence Segmentationcited by 17
- 2025A Large and Balanced Corpus for Fine-grained Arabic Readability Assessmentcited by 8
- 2025Sentence-level Reward Model can Generalize Better for Aligning LLM from Human Preferencecited by 5
- 2026Think in Sentences: Explicit Sentence Boundaries Enhance Language Model's Capabilitiescited by 3
- 2025Paragraph Segmentation Revisited: Towards a Standard Task for Structuring Speechcited by 2
- 2026Linear Semantic Segmentation for Low-Resource Spoken Dialectscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.