EEmo-Logic: A Unified Dataset and Multi-Stage Framework for Comprehensive Image-Evoked Emotion Assessment
Not on the map. Why?
Abstract (arXiv)
Understanding the multi-dimensional attributes and intensity nuances of image-evoked emotions is pivotal for advancing machine empathy and empowering diverse human-computer interaction applications. However, existing models are still limited to coarse-grained emotion perception or deficient reasoning capabilities. To bridge this gap, we introduce EEmoDB, the largest image-evoked emotion understanding dataset to date. It features 5 analysis dimensions spanning 5 distinct task categories, facilitating comprehensive interpretation. Specifically, we compile 1.2M question-answering (QA) pairs (EEmoDB-QA) from 125K images via automated generation, alongside a 36K dataset (EEmoDB-Assess) curated from 25K images for fine-grained assessment. Furthermore, we propose EEmo-Logic, an all-in-one multimodal large language model (MLLM) developed via instruction fine-tuning and task-customized group relative preference optimization (GRPO) with novel reward design. Extensive experiments demonstrate that EEmo-Logic achieves robust performance in in-domain and cross-domain datasets, excelling in emotion QA and fine-grained assessment. The dataset and code are available at https://github.com/workerred/EEmo-Logic.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 54 of its 90 references that are in the map. First posted on arXiv 1 Feb 2026.
Builds on
54 of 90 references.
References · 54
- 2017Attention Is All You Needcited by 59,932
- 2023GPT-4 Technical Reportcited by 18,132
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2025Qwen3 Technical Reportcited by 8,195
- 2023Visual Instruction Tuningcited by 7,792
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2025Qwen2.5-VL Technical Reportcited by 5,418
38 more
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
- 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,105
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
- 2016Semantic Understanding of Scenes through the ADE20K Datasetcited by 1,063
- 2025OpenAI GPT-5 System Cardcited by 910
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
- 2022Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distributioncited by 722
- 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 718
- 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 571
- 2017AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wildcited by 490
- 2021Towards Emotional Support Dialog Systemscited by 294
- 2024mPLUG-Owl3: Towards Long Image-Sequence Understanding in Multi-Modal Large Language Modelscited by 285
- 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 247
- 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 233
- 2021Delving into Deep Imbalanced Regressioncited by 157
- 2020DFEW: A Large-Scale Database for Recognizing Dynamic Facial Expressions in the Wildcited by 128
- 2021ArtEmis: Affective Language for Visual Artcited by 103
- 2025R1-Omni: Explainable Omni-Multimodal Emotion Recognition with Reinforcement Learningcited by 99
- 2025Q-Insight: Understanding Image Quality via Visual Reinforcement Learningcited by 93
- 2025Unified Multimodal Chain-of-Thought Reward Model through Reinforcement Fine-Tuningcited by 86
- 2023EmoSet: A Large-scale Visual Emotion Dataset with Rich Attributescited by 81
- 2016Building a Large Scale Dataset for Image Emotion Recognition: The Fine Print and The Benchmarkcited by 71
- 2024AesBench: An Expert Benchmark for Multimodal Large Language Models on Image Aesthetics Perceptioncited by 63
- 2025HumanOmni: A Large Vision-Speech Language Model for Human-Centric Video Understandingcited by 58
- 2025AffectGPT: A New Dataset, Model, and Benchmark for Emotion Understanding with Multimodal Large Language Modelscited by 43
- 2024EmoVIT: Revolutionizing Emotion Insights with Visual Instruction Tuningcited by 42
- 2024UNIAA: A Unified Multi-modal Image Aesthetic Assessment Baseline and Benchmarkcited by 39
- 2024On the Out-Of-Distribution Generalization of Multimodal Large Language Modelscited by 30
- 2025VQ-Insight: Teaching VLMs for AI-Generated Video Quality Understanding via Progressive Visual Reinforcement Learningcited by 26
- 2024FindingEmo: An Image Dataset for Emotion Recognition in the Wildcited by 20
- 2022Affection: Learning Affective Explanations for Real-World Visual Datacited by 19
- 2025AffectGPT-R1: Leveraging Reinforcement Learning for Open-Vocabulary Multimodal Emotion Recognitioncited by 15
50 most cited of 54 All 54 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026MVEI & EmObserver: Empowering MLLM-Oriented Visual Emotional Intelligence via Emotion Statement Judgementcited by 1
- 2026InsightVQA: High-Dimensional Emotion-Cognitive Visual Question Answering Benchmarkcited by 0
- 2026E3mo-Bench: A Scalable Benchmark for Multimodal Evoked and Expressed Emotion Understanding via Bayesian Pairwise Alignmentcited by 0
- 2026E3mo-Bench: A Scalable Benchmark for Multimodal Evoked and Expressed Emotion Understanding via Bayesian Pairwise Alignment11 Aug 2026
- 2026MVEI & EmObserver: Empowering MLLM-Oriented Visual Emotional Intelligence via Emotion Statement Judgement23 Jul 2026
- 2026InsightVQA: High-Dimensional Emotion-Cognitive Visual Question Answering Benchmark1 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2025Customizing Visual Emotion Evaluation for MLLMs: An Open-vocabulary, Multifaceted, and Scalable Approach
- 2026Emotion-LLaMAv2 and MMEVerse: A New Framework and Benchmark for Multimodal Emotion Understanding
- 2025EmoVLM-KD: Fusing Distilled Expertise with Vision-Language Models for Visual Emotion Analysis
- 2024EmoLLM: Multimodal Emotional Understanding Meets Large Language Models
- 2025Why We Feel: Breaking Boundaries in Emotional Reasoning with Multimodal Large Language Models
- 2026EmoS: A High-Fidelity Multimodal Benchmark for Fine-grained Streaming Emotional Understanding
- 2025Evaluating Vision-Language Models for Emotion Recognition
- 2025Seeing is Not Understanding: A Benchmark on Perception-Cognition Disparities in Large Language Models