mlsanityData to 14 Oct 2026

Computational Orientalism: Measuring Structural Discourse Bias in Large Language Models Using the Middle East Cultural Sensitivity Score (MECSS)

arXiv 2608.18100 ↗First posted 9 Jun 2026cs.CL cs.AI cs.CYcited by 0

Not on the map. Why?

Abstract (arXiv)

AI systems now shape how hundreds of millions of people learn about cultures other than their own. When someone asks one of these systems about the Middle East, they do not receive neutral facts. They receive a representation shaped by the frameworks embedded in training data, and that data is overwhelmingly Western and English-language. This paper asks whether that representation is Orientalist in Said's sense: whether it denies agency to Middle Eastern actors, treats Western frameworks as neutral while marking non-Western knowledge as particular, and explains the region through categories it did not produce. Standard fairness metrics cannot answer this, because they detect explicit prejudice rather than structural framing. This paper introduces the Middle East Cultural Sensitivity Score (MECSS), a framework that turns Said's seven Orientalist operations into measurable dimensions, and the term "Said-washing" for a specific failure: a model that disclaims generalization, then reproduces the structure it disclaimed. Across 280 conversations (1,120 exchanges), GPT-4 and Falcon3-7B-Instruct both reproduce Orientalist patterns systematically, through structural positioning rather than open stereotyping. GPT-4 scores moderately (mean MECSS 1.73); Falcon3-7B-Instruct scores higher (2.18), even though it was built in Abu Dhabi and trained with Arabic content. This is evidence against the assumption that building a model regionally makes it less Orientalist, though the models differ in size as well as origin, so geography cannot be isolated as the cause. Epistemic Center, the treatment of Western frameworks as unmarked universals, scores near the top of the scale for both models. Said-washing appears in 87.9% of GPT-4 conversations, a pattern existing metrics cannot see. Reducing this bias requires changing what models learn from, not only adding languages or relocating institutions.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 27 references that are in the map. First posted on arXiv 9 Jun 2026.

Builds on

15 of 27 references.

References · 15

  1. 2023Bias and Fairness in Large Language Models: A Surveycited by 639
  2. 2019The Woman Worked as a Babysitter: On Biases in Language Generationcited by 541
  3. 2021BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generationcited by 412
  4. 2023Having Beer after Prayer? Measuring Cultural Bias in Large Language Modelscited by 153
  5. 2023Cultural Bias and Cultural Alignment of Large Language Modelscited by 149
  6. 2020Decolonial AI: Decolonial Theory as Sociotechnical Foresight in Artificial Intelligencecited by 101
  7. 2024Measuring Political Bias in Large Language Models: What Is Said and How It Is Saidcited by 89
  8. 2019Fairwashing: the risk of rationalizationcited by 81
  9. 2024Measuring Implicit Bias in Explicitly Unbiased Large Language Modelscited by 51
  10. 2025Multilingual != Multicultural: Evaluating Gaps Between Multilingual Capabilities and Cultural Alignment in LLMscited by 39
  11. 2025Break the Checkbox: Challenging Closed-Style Evaluations of Cultural Alignment in LLMscited by 26
  12. 2025Fluent but Foreign: Even Regional LLMs Lack Cultural Alignmentcited by 10
3 more
  1. 2025The Cultural Gene of Large Language Models: A Study on the Impact of Cross-Corpus Training on Model Values and Biasescited by 4
  2. 2024Data-Augmentation-Based Dialectal Adaptation for LLMscited by 3
  3. 2025Rethinking AI Cultural Alignmentcited by 3

Built on by

Not cited yet.