Tears or Cheers? Benchmarking LLMs via Culturally Elicited Distinct Affective Responses
Not on the map. Why?
Abstract (arXiv)
Culture serves as a fundamental determinant of human affective processing and profoundly shapes how individuals perceive and interpret emotional stimuli. Despite this intrinsic link extant evaluations regarding cultural alignment within Large Language Models primarily prioritize declarative knowledge such as geographical facts or established societal customs. These benchmarks remain insufficient to capture the subjective interpretative variance inherent to diverse sociocultural lenses. To address this limitation, we introduce CEDAR, a multimodal benchmark constructed entirely from scenarios capturing Culturally underlinetextscElicited underlinetextscDistinct underlinetextscAffective underlinetextscResponses. To construct CEDAR, we implement a novel pipeline that leverages LLM-generated provisional labels to isolate instances yielding cross-cultural emotional distinctions, and subsequently derives reliable ground-truth annotations through rigorous human evaluation. The resulting benchmark comprises 10,962 instances across seven languages and 14 fine-grained emotion categories, with each language including 400 multimodal and 1,166 text-only samples. Comprehensive evaluations of 17 representative multilingual models reveal a dissociation between language consistency and cultural alignment, demonstrating that culturally grounded affective understanding remains a significant challenge for current models.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 41 of its 68 references that are in the map. First posted on arXiv 19 Jan 2026.
Builds on
41 of 68 references.
References · 41
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
- 2024Aya Model: An Instruction Finetuned Open-Access Multilingual Language Modelcited by 295
- 2023HuatuoGPT, towards Taming Language Model to Be a Doctorcited by 214
- 2023Having Beer after Prayer? Measuring Cultural Bias in Large Language Modelscited by 153
- 2024CVQA: Culturally-diverse Multilingual Visual Question Answering Benchmarkcited by 120
- 2024Modular Pluralism: Pluralistic Alignment via Multi-LLM Collaborationcited by 113
- 2024Benchmarking Vision Language Models for Cultural Understandingcited by 101
- 2024CultureBank: An Online Community-Driven Knowledge Base Towards Culturally Aware Language Technologiescited by 98
- 2023When the Majority is Wrong: Modeling Annotator Disagreement for Subjective Taskscited by 90
- 2024Massively Multi-Cultural Knowledge Acquisition & LM Benchmarkingcited by 63
29 more
- 2024CULTURE-GEN: Revealing Global Cultural Perception in Language Models through Natural Language Promptingcited by 55
- 2023Knowledge of cultural moral norms in large language modelscited by 51
- 2024Evaluating Cultural and Social Awareness of LLM Web Agentscited by 45
- 2025Aya Vision: Advancing the Frontier of Multilingual Multimodalitycited by 33
- 2024PsycoLLM: Enhancing LLM for Psychological Understanding and Evaluationcited by 26
- 2025Omni-Emotion: Extending Video MLLM with Detailed Face and Audio Modeling for Multimodal Emotion Analysiscited by 26
- 2025Break the Checkbox: Challenging Closed-Style Evaluations of Cultural Alignment in LLMscited by 26
- 2024FoodieQA: A Multimodal Dataset for Fine-Grained Understanding of Chinese Food Culturecited by 25
- 2025Psyche-R1: Towards Reliable Psychological LLMs through Unified Empathy, Expertise, and Reasoningcited by 20
- 2024JMMMU: A Japanese Massive Multi-discipline Multimodal Understanding Benchmark for Culture-aware Evaluationcited by 19
- 2024No Culture Left Behind: ArtELingo-28, a Benchmark of WikiArt with Captions in 28 Languagescited by 19
- 2025Commonsense Reasoning in Arab Culturecited by 16
- 2025GIMMICK -- Globally Inclusive Multimodal Multitask Cultural Knowledge Benchmarkingcited by 16
- 2025CARE: Multilingual Human Preference Learning for Cultural Awarenesscited by 15
- 2025CulturalFrames: Assessing Cultural Expectation Alignment in Text-to-Image Models and Evaluation Metricscited by 15
- 2025CULEMO: Cultural Lenses on Emotion -- Benchmarking LLMs for Cross-Cultural Emotion Understandingcited by 14
- 2025NileChat: Towards Linguistically Diverse and Culturally Aware LLMs for Local Communitiescited by 13
- 2025Beyond Emotion Recognition: A Multi-Turn Multimodal Emotion Understanding and Reasoning Benchmarkcited by 12
- 2024CROPE: Evaluating In-Context Adaptation of Vision and Language Models to Culture-Specific Conceptscited by 11
- 2025Can LLMs Express Personality Across Cultures? Introducing CulturalPersonas for Evaluating Trait Alignmentcited by 9
- 2025Seeing Culture: A Benchmark for Visual Reasoning and Groundingcited by 9
- 2025Add-One-In: Incremental Sample Selection for Large Language Models via a Choice-Based Greedy Paradigmcited by 6
- 2025Hanfu-Bench: A Multimodal Benchmark on Cross-Temporal Cultural Understanding and Transcreationcited by 5
- 2025A Culturally-diverse Multilingual Multimodal Video Benchmark & Modelcited by 5
- 2025PakBBQ: A Culturally Adapted Bias Benchmark for QAcited by 4
- 2025A Structured Framework for Evaluating and Enhancing Interpretive Capabilities of Multimodal LLMs in Culturally Situated Taskscited by 4
- 2025JETHICS: Japanese Ethics Understanding Evaluation Datasetcited by 3
- 2025CultureCLIP: Empowering CLIP with Cultural Awareness through Synthetic Images and Contextualized Captionscited by 3
- 2025Culture Cartography: Mapping the Landscape of Cultural Knowledgecited by 2
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Expressing Social Emotions: Misalignment Between LLMs and Human Cultural Emotion Normscited by 1
- 2026MMHBench: A Multi-Perspective Benchmark for Mental Health Understanding in Long-Form Videoscited by 1
- 2026Surfacing the Unsaid: CUE-Bench for Affective Stance in Chinese Discoursecited by 1
- 2026CogEvolution: A Human-like Generative Educational Agent to Simulate Student's Cognitive Evolutioncited by 0
- 2026ShredBench: Evaluating the Semantic Reasoning Capabilities of Multimodal LLMs in Document Reconstructioncited by 0
- 2026ArtECulture: Benchmarking Culture-Conditioned Visual Emotion Understanding in Multimodal Large Language Modelscited by 0
- 2026Surfacing the Unsaid: CUE-Bench for Affective Stance in Chinese Discourse11 Aug 2026
- 2026ArtECulture: Benchmarking Culture-Conditioned Visual Emotion Understanding in Multimodal Large Language Models4 Aug 2026
- 2026MMHBench: A Multi-Perspective Benchmark for Mental Health Understanding in Long-Form Videos30 Jul 2026
- 2026ShredBench: Evaluating the Semantic Reasoning Capabilities of Multimodal LLMs in Document Reconstruction26 Apr 2026
- 2026Expressing Social Emotions: Misalignment Between LLMs and Human Cultural Emotion Norms18 Apr 2026
- 2026CogEvolution: A Human-like Generative Educational Agent to Simulate Student's Cognitive Evolution16 Apr 2026