mlsanityData to 14 Oct 2026

ProFocus: Interpreting Affective Experience in Artistic Images with Progressive Visual Focusing

arXiv 2608.13974 ↗First posted 14 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Interpreting the emotional responses triggered by images is central to achieving emotional intelligence. Compared with natural images, visual art is intentionally created to elicit emotional responses from its viewers through abstract concepts and visual metaphors, making affective interpretation particularly challenging. However, most existing methods rely on general-purpose visual embeddings (e.g., CLIP), failing to capture the nuanced cues underlying artistic emotion. To address this gap, we propose ProFocus, a novel framework that models affective experience in artistic images via progressive visual focusing. The key idea is to model visual representation learning inspired by a hierarchical cognitive theory of human aesthetic appreciation. Technically, ProFocus contains two core components: a Hierarchical Art Critic (HAC) and a Progressive Hint Fusion (PHF) module. HAC leverages multimodal large language models to generate structured linguistic priors at three cognitive levels--atmospheric style, narrative subjects, and concrete details--thereby translating artistic perception into coherent semantic guidance. Building upon these priors, PHF departs from conventional cross-modal fusion by sequentially injecting the hierarchical hints into visual features, enabling a progressive focusing process that mirrors human perception. This design allows the model to capture subtle affective cues and produce more faithful explanations. Extensive experiments on the ArtEmis v1.0 and v2.0 datasets demonstrate that ProFocus consistently outperforms state-of-the-art methods in both emotion recognition and affective explanation. Project page: https://github.com/Zhang-Zhiyan/ProFocus.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 55 references that are in the map. First posted on arXiv 14 Aug 2026.

Builds on

26 of 55 references.

References · 26

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  2. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  3. 2023Qwen Technical Reportcited by 3,344
  4. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  5. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  6. 2015An Introduction to Convolutional Neural Networkscited by 514
  7. 2015A Neural Algorithm of Artistic Stylecited by 483
  8. 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 467
  9. 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 255
  10. 2021ArtEmis: Affective Language for Visual Artcited by 104
  11. 2023EmoSet: A Large-scale Visual Emotion Dataset with Rich Attributescited by 82
  12. 2018How to Read Paintings: Semantic Art Understanding with Multi-Modal Retrievalcited by 74
14 more
  1. 2022NLX-GPT: A Model for Natural Language Explanations in Vision and Vision-Language Taskscited by 60
  2. 2022MDAN: Multi-level Dependent Attention Network for Visual Emotion Analysiscited by 29
  3. 2021Stimuli-Aware Visual Emotion Analysiscited by 26
  4. 2024Affective Computing in the Era of Large Language Models: A Survey from the NLP Perspectivecited by 25
  5. 2024Enriching Multimodal Sentiment Analysis through Textual Emotional Descriptions of Visual-Audio Contentcited by 25
  6. 2025CMMCoT: Enhancing Complex Multi-Image Comprehension via Multi-Modal Chain-of-Thought and Memory Augmentationcited by 23
  7. 2022Affection: Learning Affective Explanations for Real-World Visual Datacited by 19
  8. 2025Benchmarking and Bridging Emotion Conflicts for Multimodal Emotion Reasoningcited by 12
  9. 2025Beyond Emotion Recognition: A Multi-Turn Multimodal Emotion Understanding and Reasoning Benchmarkcited by 12
  10. 2015The Cross-Depiction Problem: Computer Vision Algorithms for Recognising Objects in Artwork and in Photographscited by 10
  11. 2025VidEmo: Affective-Tree Reasoning for Emotion-Centric Video Foundation Modelscited by 6
  12. 2024Training A Small Emotional Vision Language Model for Visual Art Comprehensioncited by 4
  13. 2026Omni-Perception Policy Optimization for Multimodal Emotion Reasoningcited by 3
  14. 2026Benchmarking Dynamic Affective Reasoning: A Viewer-Centric Video Emotion Datasetcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026EmoStyle: Affective Conditioning of Style-Specialist Experts for Emotional Image Generation
  2. 2025EmoStyle: Emotion-Driven Image Stylization
  3. 2026ArtSociety: Multi-Agent Multimodal Collaboration for Art Emotion Understanding
  4. 2025EmoArt: A Multidimensional Dataset for Emotion-Aware Artistic Generation
  5. 2026Attribute-Grounded Selective Reasoning for Artwork Emotion Understanding with Multimodal Large Language Models
  6. 2026ArtECulture: Benchmarking Culture-Conditioned Visual Emotion Understanding in Multimodal Large Language Models
  7. 2026EmoScene: A Dual-space Dataset for Controllable Affective Image Generation
  8. 2025EmoCtrl: Controllable Emotional Image Content Generation