mlsanityData to 14 Oct 2026

Tears or Cheers? Benchmarking LLMs via Culturally Elicited Distinct Affective Responses

arXiv 2601.13024 ↗First posted 19 Jan 2026cs.CLcited by 6

Not on the map. Why?

Abstract (arXiv)

Culture serves as a fundamental determinant of human affective processing and profoundly shapes how individuals perceive and interpret emotional stimuli. Despite this intrinsic link extant evaluations regarding cultural alignment within Large Language Models primarily prioritize declarative knowledge such as geographical facts or established societal customs. These benchmarks remain insufficient to capture the subjective interpretative variance inherent to diverse sociocultural lenses. To address this limitation, we introduce CEDAR, a multimodal benchmark constructed entirely from scenarios capturing Culturally underlinetextscElicited underlinetextscDistinct underlinetextscAffective underlinetextscResponses. To construct CEDAR, we implement a novel pipeline that leverages LLM-generated provisional labels to isolate instances yielding cross-cultural emotional distinctions, and subsequently derives reliable ground-truth annotations through rigorous human evaluation. The resulting benchmark comprises 10,962 instances across seven languages and 14 fine-grained emotion categories, with each language including 400 multimodal and 1,166 text-only samples. Comprehensive evaluations of 17 representative multilingual models reveal a dissociation between language consistency and cultural alignment, demonstrating that culturally grounded affective understanding remains a significant challenge for current models.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 41 of its 68 references that are in the map. First posted on arXiv 19 Jan 2026.

Builds on

41 of 68 references.

References · 41

  1. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  2. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  3. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
  4. 2024Aya Model: An Instruction Finetuned Open-Access Multilingual Language Modelcited by 295
  5. 2023HuatuoGPT, towards Taming Language Model to Be a Doctorcited by 214
  6. 2023Having Beer after Prayer? Measuring Cultural Bias in Large Language Modelscited by 153
  7. 2024CVQA: Culturally-diverse Multilingual Visual Question Answering Benchmarkcited by 120
  8. 2024Modular Pluralism: Pluralistic Alignment via Multi-LLM Collaborationcited by 113
  9. 2024Benchmarking Vision Language Models for Cultural Understandingcited by 101
  10. 2024CultureBank: An Online Community-Driven Knowledge Base Towards Culturally Aware Language Technologiescited by 98
  11. 2023When the Majority is Wrong: Modeling Annotator Disagreement for Subjective Taskscited by 90
  12. 2024Massively Multi-Cultural Knowledge Acquisition & LM Benchmarkingcited by 63
29 more
  1. 2024CULTURE-GEN: Revealing Global Cultural Perception in Language Models through Natural Language Promptingcited by 55
  2. 2023Knowledge of cultural moral norms in large language modelscited by 51
  3. 2024Evaluating Cultural and Social Awareness of LLM Web Agentscited by 45
  4. 2025Aya Vision: Advancing the Frontier of Multilingual Multimodalitycited by 33
  5. 2024PsycoLLM: Enhancing LLM for Psychological Understanding and Evaluationcited by 26
  6. 2025Omni-Emotion: Extending Video MLLM with Detailed Face and Audio Modeling for Multimodal Emotion Analysiscited by 26
  7. 2025Break the Checkbox: Challenging Closed-Style Evaluations of Cultural Alignment in LLMscited by 26
  8. 2024FoodieQA: A Multimodal Dataset for Fine-Grained Understanding of Chinese Food Culturecited by 25
  9. 2025Psyche-R1: Towards Reliable Psychological LLMs through Unified Empathy, Expertise, and Reasoningcited by 20
  10. 2024JMMMU: A Japanese Massive Multi-discipline Multimodal Understanding Benchmark for Culture-aware Evaluationcited by 19
  11. 2024No Culture Left Behind: ArtELingo-28, a Benchmark of WikiArt with Captions in 28 Languagescited by 19
  12. 2025Commonsense Reasoning in Arab Culturecited by 16
  13. 2025GIMMICK -- Globally Inclusive Multimodal Multitask Cultural Knowledge Benchmarkingcited by 16
  14. 2025CARE: Multilingual Human Preference Learning for Cultural Awarenesscited by 15
  15. 2025CulturalFrames: Assessing Cultural Expectation Alignment in Text-to-Image Models and Evaluation Metricscited by 15
  16. 2025CULEMO: Cultural Lenses on Emotion -- Benchmarking LLMs for Cross-Cultural Emotion Understandingcited by 14
  17. 2025NileChat: Towards Linguistically Diverse and Culturally Aware LLMs for Local Communitiescited by 13
  18. 2025Beyond Emotion Recognition: A Multi-Turn Multimodal Emotion Understanding and Reasoning Benchmarkcited by 12
  19. 2024CROPE: Evaluating In-Context Adaptation of Vision and Language Models to Culture-Specific Conceptscited by 11
  20. 2025Can LLMs Express Personality Across Cultures? Introducing CulturalPersonas for Evaluating Trait Alignmentcited by 9
  21. 2025Seeing Culture: A Benchmark for Visual Reasoning and Groundingcited by 9
  22. 2025Add-One-In: Incremental Sample Selection for Large Language Models via a Choice-Based Greedy Paradigmcited by 6
  23. 2025Hanfu-Bench: A Multimodal Benchmark on Cross-Temporal Cultural Understanding and Transcreationcited by 5
  24. 2025A Culturally-diverse Multilingual Multimodal Video Benchmark & Modelcited by 5
  25. 2025PakBBQ: A Culturally Adapted Bias Benchmark for QAcited by 4
  26. 2025A Structured Framework for Evaluating and Enhancing Interpretive Capabilities of Multimodal LLMs in Culturally Situated Taskscited by 4
  27. 2025JETHICS: Japanese Ethics Understanding Evaluation Datasetcited by 3
  28. 2025CultureCLIP: Empowering CLIP with Cultural Awareness through Synthetic Images and Contextualized Captionscited by 3
  29. 2025Culture Cartography: Mapping the Landscape of Cultural Knowledgecited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.