ArtECulture: Benchmarking Culture-Conditioned Visual Emotion Understanding in Multimodal Large Language Models
On the map: Multimodal LLMs / vision-language models → Multimodal emotion understanding
Abstract (arXiv)
Existing visual emotion understanding methods typically ignore cultural variations in emotional perception. We introduce culture-conditioned visual emotion understanding, a task that predicts the culture-specific emotional perception of a given image and explains the underlying rationale. Although related benchmarks exist, they are limited by inconsistent individual annotations, which hinder the derivation of majority-supported culture-level emotion labels, and imbalanced cultural coverage. Thus, we present ArtECulture, a benchmark containing 6,792 artworks with culture-specific emotion labels and explanations across English, Chinese, and Arabic cultures, with balanced Western and non-Western content. Evaluations of 16 open- and closed-source Multimodal Large Language Models (MLLMs) under a zero-shot setting reveal that the task remains challenging, with the best model achieving below 50% accuracy. To address this limitation, we introduce a retrieval-augmented culture-conditioned emotion understanding framework, which leverages a concept-based cultural emotion knowledge base to inject explicit cultural knowledge into MLLMs without additional training. The framework improves both culturally aligned emotion prediction and grounded explanation generation. Our benchmark and code will be publicly released.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal emotion understanding, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 21 of its 31 references that are in the map. First posted on arXiv 4 Aug 2026.
Builds on
21 of 31 references.
Closest ancestors · 3
Same direction, newest first
- 2025Emotion-Coherent Reasoning for Multimodal LLMs via Emotional Rationale Verifier27 Oct
- 2025MME-Emotion: A Holistic Evaluation Benchmark for Emotional Intelligence in Multimodal Large Language Models11 Aug
- 2025Evaluating Vision-Language Models for Emotion Recognition8 Feb
Other references · 18
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2021Visually Grounded Reasoning across Languages and Culturescited by 188
- 2024Benchmarking Vision Language Models for Cultural Understandingcited by 100
- 2023EmoSet: A Large-scale Visual Emotion Dataset with Rich Attributescited by 81
- 2016Building a Large Scale Dataset for Image Emotion Recognition: The Fine Print and The Benchmarkcited by 71
- 2015SentiCap: Generating Image Descriptions with Sentimentscited by 48
- 2024EmoVIT: Revolutionizing Emotion Insights with Visual Instruction Tuningcited by 42
- 2018Contemplating Visual Emotions: Understanding and Overcoming Dataset Biascited by 41
- 2022It is Okay to Not Be Okay: Overcoming Emotional Bias in Affective Image Captioning by Contrastive Data Collectioncited by 36
- 2024FindingEmo: An Image Dataset for Emotion Recognition in the Wildcited by 20
- 2024No Culture Left Behind: ArtELingo-28, a Benchmark of WikiArt with Captions in 28 Languagescited by 19
- 2025Grounding Multilingual Multimodal LLMs With Cultural Knowledgecited by 16
6 more
- 2025CULEMO: Cultural Lenses on Emotion -- Benchmarking LLMs for Cross-Cultural Emotion Understandingcited by 14
- 2025SemEval-2025 Task 11: Bridging the Gap in Text-Based Emotion Detectioncited by 9
- 2024CVLUE: A New Benchmark Dataset for Chinese Vision-Language Understanding Evaluationcited by 8
- 2025RAVENEA: A Benchmark for Multimodal Retrieval-Augmented Visual Culture Understandingcited by 8
- 2026Tears or Cheers? Benchmarking LLMs via Culturally Elicited Distinct Affective Responsescited by 6
- 2026MVEI & EmObserver: Empowering MLLM-Oriented Visual Emotional Intelligence via Emotion Statement Judgementcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Seeing is Not Understanding: A Benchmark on Perception-Cognition Disparities in Large Language Models
- 2024Training A Small Emotional Vision Language Model for Visual Art Comprehension
- 2025Customizing Visual Emotion Evaluation for MLLMs: An Open-vocabulary, Multifaceted, and Scalable Approach
- 2024EmoLLM: Multimodal Emotional Understanding Meets Large Language Models
- 2026MultiEmo-Bench: Multi-label Visual Emotion Analysis for Multi-modal Large Language Models
- 2025CultureVLM: Characterizing and Improving Cultural Understanding of Vision-Language Models for over 100 Countries
- 2024Creating a Lens of Chinese Culture: A Multimodal Dataset for Chinese Pun Rebus Art Understanding
- 2026Do Emotion Concepts Generalize Across Sources, Modalities, and Architectures in Vision-Language Models?