mlsanityData to 14 Oct 2026

Linear Semantic Segmentation for Low-Resource Spoken Dialects

arXiv 2605.06276 ↗First posted 7 May 2026cs.CL cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Semantic segmentation is a core component of discourse analysis, yet existing models are primarily developed and evaluated on high-resource written text, limiting their effectiveness on low-resource spoken varieties. In particular, dialectal Arabic exhibits informal syntax, code-switching, and weakly marked discourse structure that challenge standard segmentation approaches. In this paper, we introduce a new multi-genre benchmark (more than 1000 samples) for semantic segmentation in conversational Arabic, focusing on dialectal discourse. The benchmark covers transcribed casual telephone conversations, code-switched podcasts, broadcast news, and expressive dialogue from novels, and was annotated and validated by native Arabic annotators. Using this benchmark, we show that segmentation models performing well on MSA news genres degrade on dialectal transcribed speech. We further propose a segmentation model that targets local semantic coherence and robustness to discourse discontinuities, consistently outperforming strong baselines on dialectal non-news genres. The benchmark and approach generalize to other low-resource spoken languages.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 22 of its 52 references that are in the map. First posted on arXiv 7 May 2026.

Builds on

22 of 52 references.

References · 22

  1. 2020AraBERT: Transformer-based Model for Arabic Language Understandingcited by 362
  2. 2020ARBERT & MARBERT: Deep Bidirectional Transformers for Arabiccited by 166
  3. 2025EmbeddingGemma: Powerful and Lightweight Text Representationscited by 139
  4. 2021DialogLM: Pre-trained Model for Long Dialogue Understanding and Summarizationcited by 72
  5. 2024ALLaM: Large Language Models for Arabic and Englishcited by 55
  6. 2020Text Segmentation by Cross Segment Attentioncited by 54
  7. 2020Topic-Aware Multi-turn Dialogue Modelingcited by 46
  8. 2020A Panoramic Survey of Natural Language Processing in the Arab Worldcited by 45
  9. 2020Two-Level Transformer and Auxiliary Coherence Modeling for Improved Text Segmentationcited by 41
  10. 2024Segment Any Text: A Universal Approach for Robust, Efficient and Adaptable Sentence Segmentationcited by 41
  11. 2023Uncovering the Potential of ChatGPT for Discourse Analysis in Dialogue: An Empirical Studycited by 24
  12. 2024From Text Segmentation to Smart Chaptering: A Novel Benchmark for Structuring Video Transcriptionscited by 16
10 more
  1. 2025NileChat: Towards Linguistically Diverse and Culturally Aware LLMs for Local Communitiescited by 13
  2. 2024Mixat: A Data Set of Bilingual Emirati-English Speechcited by 12
  3. 2024Swan and ArabicMTEB: Dialect-Aware, Arabic-Centric, Cross-Lingual, and Cross-Cultural Embedding Models and Benchmarkscited by 10
  4. 2024Enhancing Semantic Similarity Understanding in Arabic NLP with Nested Embedding Learningcited by 7
  5. 2025Nile-Chat: Egyptian Language Models for Arabic and Latin Scriptscited by 7
  6. 2024Recent Trends in Linear Text Segmentation: a Surveycited by 6
  7. 2022Topic Segmentation in the Wild: Towards Segmentation of Semi-structured & Unstructured Chatscited by 5
  8. 2025CoCo-CoLa: Evaluating and Improving Language Adherence in Multilingual LLMscited by 4
  9. 2023Variation and Instability in Dialect-Based Embedding Spacescited by 3
  10. 2025GemMaroc: Unlocking Darija Proficiency in LLMs with Minimal Datacited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.