mlsanityData to 14 Oct 2026

Some Dialects Are More Equal Than Others: Non-Prestigious Arabic Dialectal Bias in LLMs

arXiv 2609.23955 ↗First posted 21 Sep 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Previous work on Egyptian Arabic in NLP has focused largely on the prestigious Cairene Egyptian Arabic (CEA) dialect, resulting in a lack of representation for the less prestigious Sa'idi Egyptian Arabic (SEA) dialect both in LLM and resource development. Does this lack of representation influence an LLM's view of the acceptability of SEA (upstream), and does an upstream bias against SEA lead to worse performance (downstream)? We investigate the upstream effect of SEA dialectal features on LLM preferences in a Targeted Syntactic Evaluation (TSE) task which reveals a significant bias against SEA across multiple LLMs. We then analyze the effect of these same features on downstream model performance on MMLU benchmarks and show that models experience a degradation in performance when presented with SEA. This work highlights the need for further exploration on how sub-dialectal variation impacts language technologies.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 31 references that are in the map. First posted on arXiv 21 Sep 2026.

Builds on

11 of 31 references.

References · 11

  1. 2016Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependenciescited by 354
  2. 2024ArabicMMLU: Assessing Massive Multitask Language Understanding in Arabiccited by 88
  3. 2024Linguistic Bias in ChatGPT: Language Models Reinforce Dialect Discriminationcited by 56
  4. 2024AraDiCE: Benchmarks for Dialectal and Cultural Capabilities in LLMscited by 46
  5. 2024Assessing Dialect Fairness and Robustness of Large Language Models in Reasoning Taskscited by 22
  6. 2024Social Bias in Large Language Models For Bangla: An Empirical Study on Gender and Religious Biascited by 13
  7. 2025Large Language Models Discriminate Against Speakers of German Dialectscited by 13
  8. 2022JASMINE: Arabic GPT Models for Few-Shot Learningcited by 11
  9. 2025Nile-Chat: Egyptian Language Models for Arabic and Latin Scriptscited by 7
  10. 2025DialectalArabicMMLU: Benchmarking Dialectal Capabilities in Arabic and Multilingual Language Modelscited by 6
  11. 2025Analyzing Dialectical Biases in LLMs for Knowledge and Reasoning Benchmarkscited by 5

Built on by

Not cited yet.