mlsanityData to 7 Oct 2026

CAMMAR: Culture-Aware Matryoshka for Metaphorical Arabic Representations

arXiv 2607.15847 ↗First posted 17 Jul 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Metaphor in Arabic is a culturally grounded mechanism for constructing meaning, encoding cultural knowledge that shapes interpretation. Yet current Arabic language models typically collapse lexical, cultural, and metaphorical information into a single representational space, a phenomenon we term "semantic smearing". We introduce CAMMAR (Culture-Aware Matryoshka for Metaphorical Arabic Representations), a representation learning framework that organizes meaning into nested lexical, cultural, and metaphorical embedding subspaces through a staged semantic curriculum. The design implements compositional principles of Al-Jurjani's theory of nazum, modeling figurative meaning as compositionally grounded in prior semantic relations, and yields a training-free geometric measure of metaphoricity based on the distance between lexical and metaphorical representations. Evaluated on a new span-annotated Arabic metaphor set as word-matched figurative/literal pairs, the geometric readout detects metaphor well above chance when the inter-layer geometry is shaped by paired supervision (AUC up to 0.84; figurative outscores its literal counterpart for the same word in 82.6% of pairs), but sits at chance under an unsupervised domain contrast alone, a clean separation between a legible-under-supervision regime and a non-emergent one. A controlled ablation shows that grounding the lexical layer in morphological roots gives a small but consistent gain, an effect absent from direct probing that reflects the layer's quality as a measurement anchor. We will release the datasets, cultural concept inventory, and code upon acceptance.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 34 references that are in the map. First posted on arXiv 17 Jul 2026.

Builds on

13 of 34 references.

References · 13

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  3. 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,393
  4. 2021MelBERT: Metaphor Detection via Contextualized Late Interaction using Metaphorical Identification Theoriescited by 46
  5. 2025Jawaher: A Multidialectal Dataset of Arabic Proverbs for LLM Benchmarkingcited by 18
  6. 2025Fann or Flop: A Multigenre, Multiera Benchmark for Arabic Poetry Understanding in LLMscited by 15
  7. 2025SMEC: Rethinking Matryoshka Representation Learning for Retrieval Embedding Compressioncited by 13
  8. 2025Metaphor and Large Language Models: When Surface Features Matter More than Deep Understandingcited by 8
  9. 2024Enhancing Semantic Similarity Understanding in Arabic NLP with Nested Embedding Learningcited by 7
  10. 2024Meta4XNLI: A Crosslingual Parallel Corpus for Metaphor Detection and Interpretationcited by 5
  11. 2024Matryoshka Representation Learning for Recommendationcited by 5
  12. 2025Evaluating the Creativity of LLMs in Persian Literary Text Generationcited by 4
1 more
  1. 2026Metaphors' journeys across time and genre: tracking the evolution of literary metaphors with temporal embeddingscited by 1

Built on by

Not cited yet.