ArtSociety: Multi-Agent Multimodal Collaboration for Art Emotion Understanding
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
The AffectiveArt Multidimensional Art Emotion Understanding task asks to jointly predict an artwork's fine-grained emotion (12 classes, 1549:1 head-to-tail ratio), binary valence/arousal, and five attribute-grounded descriptions -- sub-tasks that exhibit strong empirical trade-offs, so the single-model solutions we tried do not jointly optimize all of them well. We present ArtSociety, a multi-agent framework that assembles heterogeneous multimodal experts -- a DINOv2-Giant vision agent (A1), a scene-grounded CoT fine-tuned MLLM (A2), and three closed-source reasoning agents (A3-A5) -- and coordinates them with two training-free controllers: (i) a rare-class-aware voting arbiter that lowers the agreement threshold for tail emotions, exploiting decorrelated error patterns across agent families; and (ii) a description-first reasoning agent whose DESCRIBE-then-CLASSIFY chain of thought forces visual evidence before label commitment, yielding near-perfect grounded descriptions. A task-routing policy directs the hard emotion task to the full five-agent ensemble while assigning the near-saturated valence/arousal and generative description tasks to the single strongest reasoning agent. On the official test set (1,000 artworks), ArtSociety achieves an Overall Score of 0.8870 (Classification 0.7789, Description 0.9952). An eleven-variant ablation study reveals that, once method and scale saturate at around 0.76, the decisive gains come from agent collaboration and data-side supervision -- a 30B MoE model trained on older data does not outperform an 8B model trained on better data. Code is available at https://github.com/swordlidev/ArtSociety
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 12 of its 31 references that are in the map. First posted on arXiv 3 Sep 2026.
Builds on
12 of 31 references.
References · 12
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
- 2019Class-Balanced Loss Based on Effective Number of Samplescited by 1,245
- 2017AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wildcited by 492
- 2024Mixture-of-Agents Enhances Large Language Model Capabilitiescited by 438
- 2021ArtEmis: Affective Language for Visual Artcited by 104
- 2023EmoSet: A Large-scale Visual Emotion Dataset with Rich Attributescited by 82
- 2016Building a Large Scale Dataset for Image Emotion Recognition: The Fine Print and The Benchmarkcited by 71
- 2022It is Okay to Not Be Okay: Overcoming Emotional Bias in Affective Image Captioning by Contrastive Data Collectioncited by 36
- 2024FindingEmo: An Image Dataset for Emotion Recognition in the Wildcited by 22
- 2025EmoArt: A Multidimensional Dataset for Emotion-Aware Artistic Generationcited by 11
- 2025EmoVLM-KD: Fusing Distilled Expertise with Vision-Language Models for Visual Emotion Analysiscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Attribute-Grounded Selective Reasoning for Artwork Emotion Understanding with Multimodal Large Language Models
- 2026How AI Experiences Art: Emergent Aesthetic Structure in a Self-Supervised Multimodal Embedding Space
- 2026AffectAgent: Collaborative Multi-Agent Reasoning for Retrieval-Augmented Multimodal Emotion Recognition
- 2026A-MAR: Agent-based Multimodal Art Retrieval for Fine-Grained Artwork Understanding
- 2025Multimodal LLMs Can Reason about Aesthetics in Zero-Shot
- 2025Artificial Intelligence Can Emulate Human Normative Judgments on Emotional Visual Scenes ↗
- 2026From Surface to Depth: Towards Cognitive Appraisal Reasoning in Multimodal Emotion Understanding
- 2026ProFocus: Interpreting Affective Experience in Artistic Images with Progressive Visual Focusing