CAMMAR: Culture-Aware Matryoshka for Metaphorical Arabic Representations
Not on the map. Why?
Abstract (arXiv)
Metaphor in Arabic is a culturally grounded mechanism for constructing meaning, encoding cultural knowledge that shapes interpretation. Yet current Arabic language models typically collapse lexical, cultural, and metaphorical information into a single representational space, a phenomenon we term "semantic smearing". We introduce CAMMAR (Culture-Aware Matryoshka for Metaphorical Arabic Representations), a representation learning framework that organizes meaning into nested lexical, cultural, and metaphorical embedding subspaces through a staged semantic curriculum. The design implements compositional principles of Al-Jurjani's theory of nazum, modeling figurative meaning as compositionally grounded in prior semantic relations, and yields a training-free geometric measure of metaphoricity based on the distance between lexical and metaphorical representations. Evaluated on a new span-annotated Arabic metaphor set as word-matched figurative/literal pairs, the geometric readout detects metaphor well above chance when the inter-layer geometry is shaped by paired supervision (AUC up to 0.84; figurative outscores its literal counterpart for the same word in 82.6% of pairs), but sits at chance under an unsupervised domain contrast alone, a clean separation between a legible-under-supervision regime and a non-emergent one. A controlled ablation shows that grounding the lexical layer in morphological roots gives a small but consistent gain, an effect absent from direct probing that reflects the layer's quality as a measurement anchor. We will release the datasets, cultural concept inventory, and code upon acceptance.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 34 references that are in the map. First posted on arXiv 17 Jul 2026.
Builds on
13 of 34 references.
References · 13
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,393
- 2021MelBERT: Metaphor Detection via Contextualized Late Interaction using Metaphorical Identification Theoriescited by 46
- 2025Jawaher: A Multidialectal Dataset of Arabic Proverbs for LLM Benchmarkingcited by 18
- 2025Fann or Flop: A Multigenre, Multiera Benchmark for Arabic Poetry Understanding in LLMscited by 15
- 2025SMEC: Rethinking Matryoshka Representation Learning for Retrieval Embedding Compressioncited by 13
- 2025Metaphor and Large Language Models: When Surface Features Matter More than Deep Understandingcited by 8
- 2024Enhancing Semantic Similarity Understanding in Arabic NLP with Nested Embedding Learningcited by 7
- 2024Meta4XNLI: A Crosslingual Parallel Corpus for Metaphor Detection and Interpretationcited by 5
- 2024Matryoshka Representation Learning for Recommendationcited by 5
- 2025Evaluating the Creativity of LLMs in Persian Literary Text Generationcited by 4
Built on by
Not cited yet.