Attribute-Grounded Selective Reasoning for Artwork Emotion Understanding with Multimodal Large Language Models
On the map: LLM reasoning → Audio-language model reasoning
Abstract (arXiv)
Multimodal large language models (MLLMs) can produce fluent artwork emotion explanations, but they often suffer from attribute flooding: they enumerate many visible formal attributes without identifying which cues actually support the affective judgment. We therefore formulate artwork emotion understanding as Attribute-Grounded Selective Reasoning (AGSR), where predefined formal attributes serve as evidence units and only emotionally operative attributes should enter the final interpretation. To make this problem measurable, we extend EmoArt, originally introduced at ACM MM 2025 as a 132,664-artwork resource with content, formal-attribute, valence-arousal, and emotion annotations, by adding a 1,400-artwork human salience extension annotated by 15 art-trained annotators. This extension provides instance-level supervision for distinguishing attributes that are merely present from those that are emotionally salient. We further propose FAB-G (Formal-Attribute Bottleneck-Guided reasoning), a supervised multi-agent framework that first predicts attribute-level salience and then constrains downstream emotional analysis to the retained cues. Experiments show that FAB-G yields consistent gains in emotion, arousal, and valence prediction, achieves stronger agreement with human-marked salient attributes under Dice and Tversky metrics, and produces substantially more compact final explanations than prompting-based baselines. Cross-dataset evaluation further suggests that attribute-grounded salience selection transfers beyond the source distribution of EmoArt, while also revealing attribute-specific boundary cases. The dataset and project page are available at https://zhiliangzhang.github.io/EmoArt-130k/
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Audio-language model reasoning, one of 17 directions in LLM reasoning. Builds on 16 of its 25 references that are in the map. First posted on arXiv 15 May 2026.
Builds on
16 of 25 references.
References · 16
- 2023Visual Instruction Tuningcited by 7,869
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2017AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wildcited by 492
- 2025Kimi-VL Technical Reportcited by 388
- 2021ArtEmis: Affective Language for Visual Artcited by 104
- 2023EmoSet: A Large-scale Visual Emotion Dataset with Rich Attributescited by 82
- 2018How to Read Paintings: Semantic Art Understanding with Multi-Modal Retrievalcited by 74
- 2016Building a Large Scale Dataset for Image Emotion Recognition: The Fine Print and The Benchmarkcited by 71
- 2025AffectGPT: A New Dataset, Model, and Benchmark for Emotion Understanding with Multimodal Large Language Modelscited by 44
- 2024EmoVIT: Revolutionizing Emotion Insights with Visual Instruction Tuningcited by 43
4 more
- 2018Contemplating Visual Emotions: Understanding and Overcoming Dataset Biascited by 41
- 2024FindingEmo: An Image Dataset for Emotion Recognition in the Wildcited by 22
- 2025AffectGPT-R1: Leveraging Reinforcement Learning for Open-Vocabulary Multimodal Emotion Recognitioncited by 15
- 2025EmoArt: A Multidimensional Dataset for Emotion-Aware Artistic Generationcited by 11
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026ArtSociety: Multi-Agent Multimodal Collaboration for Art Emotion Understanding
- 2026From Surface to Depth: Towards Cognitive Appraisal Reasoning in Multimodal Emotion Understanding
- 2025Reasoning Like Experts: Leveraging Multimodal Large Language Models for Drawing-based Psychoanalysis
- 2026How AI Experiences Art: Emergent Aesthetic Structure in a Self-Supervised Multimodal Embedding Space
- 2026ArtECulture: Benchmarking Culture-Conditioned Visual Emotion Understanding in Multimodal Large Language Models
- 2026EMO-R3: Reflective Reinforcement Learning for Emotional Reasoning in Multimodal Large Language Models
- 2024EmoLLM: Multimodal Emotional Understanding Meets Large Language Models
- 2025Why We Feel: Breaking Boundaries in Emotional Reasoning with Multimodal Large Language Models