USTHB at NADI 2023 shared task: Exploring Preprocessing and Feature Engineering Strategies for Arabic Dialect Identification
Not on the map. Why?
Abstract (arXiv)
In this paper, we conduct an in-depth analysis of several key factors influencing the performance of Arabic Dialect Identification NADI'2023, with a specific focus on the first subtask involving country-level dialect identification. Our investigation encompasses the effects of surface preprocessing, morphological preprocessing, FastText vector model, and the weighted concatenation of TF-IDF features. For classification purposes, we employ the Linear Support Vector Classification (LSVC) model. During the evaluation phase, our system demonstrates noteworthy results, achieving an F1 score of 62.51%. This achievement closely aligns with the average F1 scores attained by other systems submitted for the first subtask, which stands at 72.91%.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 8 of its 30 references that are in the map. First posted on arXiv 16 Dec 2023.
Builds on
8 of 30 references.
References · 8
- 2020NADI 2020: The First Nuanced Arabic Dialect Identification Shared Taskcited by 47
- 2021NADI 2021: The Second Nuanced Arabic Dialect Identification Shared Taskcited by 32
- 2023NADI 2023: The Fourth Nuanced Arabic Dialect Identification Shared Taskcited by 29
- 2022NADI 2022: The Third Nuanced Arabic Dialect Identification Shared Taskcited by 23
- 2023ArAIEval Shared Task: Persuasion Techniques and Disinformation Detection in Arabic Textcited by 19
- 2022Overview of the WANLP 2022 Shared Task on Propaganda Detection in Arabiccited by 18
- 2020Combating Disinformation in a Social Media Agecited by 17
- 2020Machine Generation and Detection of Arabic Manipulated and Fake Newscited by 16
Built on by
Citing papers per year: 2024: 3.
3 papers.
- 2024dzFinNlp at AraFinNLP: Improving Intent Detection in Financial Conversational Agentscited by 0
- 2024dzStance at StanceEval2024: Arabic Stance Detection based on Sentence Transformerscited by 0
- 2024dzNLP at NADI 2024 Shared Task: Multi-Classifier Ensemble with Weighted Voting and TF-IDF Featurescited by 0
- 2024dzNLP at NADI 2024 Shared Task: Multi-Classifier Ensemble with Weighted Voting and TF-IDF Features18 Jul 2024
- 2024dzStance at StanceEval2024: Arabic Stance Detection based on Sentence Transformers18 Jul 2024
- 2024dzFinNlp at AraFinNLP: Improving Intent Detection in Financial Conversational Agents18 Jul 2024