mlsanityData to 7 Oct 2026

Cultural Awareness is Represented but Not Decoded: Tracing Mythological Knowledge across 18 Open-Source LLMs

arXiv 2608.02486 ↗First posted 3 Aug 2026cs.CL cs.CY cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Open-source LLMs reliably name Zeus, Jupiter, and Thor, but recover their counterparts in less-represented traditions like Finnish, Slavic, Egyptian, or Chinese mythology far less consistently. We ask where inside the model this cultural default is produced. On a parallel cross-cultural substrate of Thompson-motif entities, we instrument 18 open-source LLMs from 8 architecture families with linear probing, logit lens, activation patching, and output extraction. The residual stream cleanly distinguishes cultures, well above a name-string baseline, yet the decoder collapses culturally-specific tokens onto dominant-tradition ones. The failure is at readout, not at representation. Asking the same question in the target culture's native language versus English produces failures that cluster within language but decouple across language: the decoder is gated on prompt language. We release a per-entity (probe, output) decomposition framework, a citation-anchored cross-cultural ground truth, a within- versus cross-mode correlation test for language-conditioned readout, and per-entity predictions for all 18 models.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 71 references that are in the map. First posted on arXiv 3 Aug 2026.

Builds on

20 of 71 references.

References · 20

  1. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  2. 2019Language Models as Knowledge Bases?cited by 1,922
  3. 2022GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformerscited by 1,838
  4. 2018Datasheets for Datasetscited by 1,371
  5. 2016Understanding intermediate layers using linear classifier probescited by 1,279
  6. 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,130
  7. 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 831
  8. 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 673
  9. 2019Designing and Interpreting Probes with Control Taskscited by 608
  10. 2023Eliciting Latent Predictions from Transformers with the Tuned Lenscited by 579
  11. 2023The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variantscited by 300
  12. 2024Do Llamas Work in English? On the Latent Language of Multilingual Transformerscited by 275
8 more
  1. 2021Quality at a Glance: An Audit of Web-Crawled Multilingual Datasetscited by 241
  2. 2022Challenges and Strategies in Cross-Cultural NLPcited by 216
  3. 2023Finding Alignments Between Interpretable Causal Variables and Distributed Neural Representationscited by 197
  4. 2023Do All Languages Cost the Same? Tokenization in the Era of Commercial Language Modelscited by 186
  5. 2024Towards Measuring and Modeling "Culture" in LLMs: A Surveycited by 166
  6. 2024How Does Quantization Affect Multilingual LLMs?cited by 41
  7. 2021Endangered Languages are not Low-Resourced!cited by 14
  8. 2026Compressed code: the hidden effects of quantization and distillation on programming tokenscited by 1

Built on by

Not cited yet.