mlsanityData to 14 Oct 2026

VAEER: Visual Attention-Inspired Emotion Elicitation Reasoning

arXiv 2505.24342 ↗First posted 30 May 2025cs.CV cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Images shared online strongly influence emotions and public well-being. Understanding the emotions an image elicits is therefore vital for fostering healthier and more sustainable digital communities, especially during public crises. We study Visual Emotion Elicitation (VEE), predicting the set of emotions that an image evokes in viewers. We introduce VAEER, an interpretable multi-label VEE framework that combines attention-inspired cue extraction with knowledge-grounded reasoning. VAEER isolates salient visual foci and contextual signals, aligns them with structured affective knowledge, and performs per-emotion inference to yield transparent, emotion-specific rationales. Across three heterogeneous benchmarks, including social imagery and disaster-related photos, VAEER achieves state-of-the-art results with up to 19% per-emotion improvements and a 12.3% average gain over strong CNN and VLM baselines. Our findings highlight interpretable multi-label emotion elicitation as a scalable foundation for responsible visual media analysis and emotionally sustainable online ecosystems.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 13 of its 54 references that are in the map. First posted on arXiv 30 May 2025.

Builds on

13 of 54 references.

References · 13

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
  3. 2023LLaVA-Plus: Learning to Use Tools for Creating Multimodal Agentscited by 193
  4. 2019Context-Aware Emotion Recognition Networkscited by 99
  5. 2023EmoSet: A Large-scale Visual Emotion Dataset with Rich Attributescited by 82
  6. 2020Context Based Emotion Recognition using EMOTIC Datasetcited by 73
  7. 2020EmotiCon: Context-Aware Multimodal Emotion Recognition using Frege's Principlecited by 50
  8. 2024EMO-LLaMA: Enhancing Facial Emotion Understanding with Instruction Tuningcited by 28
  9. 2024GPT as Psychologist? Preliminary Evaluations for GPT-4V on Visual Affective Computingcited by 22
  10. 2020Visual Sentiment Analysis from Disaster Images in Social Mediacited by 14
  11. 2023Unlocking the Emotional World of Visual Media: An Overview of the Science, Research, and Impact of Understanding Emotioncited by 12
  12. 2024Visual Prompting in LLMs for Enhancing Emotion Recognitioncited by 12
1 more
  1. 2023StyleEDL: Style-Guided High-order Attention Network for Image Emotion Distribution Learningcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025EmoVerse: A MLLMs-Driven Emotion Representation Dataset for Interpretable Visual Emotion Analysis
  2. 2026InsightVQA: High-Dimensional Emotion-Cognitive Visual Question Answering Benchmark
  3. 2026MVEI & EmObserver: Empowering MLLM-Oriented Visual Emotional Intelligence via Emotion Statement Judgement
  4. 2026Visual Affect Analysis: Predicting Emotions of Image Viewers with Vision-Language Models
  5. 2024StimuVAR: Spatiotemporal Stimuli-aware Video Affective Reasoning with Multimodal Large Language Models
  6. 2026ArtECulture: Benchmarking Culture-Conditioned Visual Emotion Understanding in Multimodal Large Language Models
  7. 2026EmoScene: A Dual-space Dataset for Controllable Affective Image Generation
  8. 2025Why We Feel: Breaking Boundaries in Emotional Reasoning with Multimodal Large Language Models