InsightVQA: High-Dimensional Emotion-Cognitive Visual Question Answering Benchmark
Not on the map. Why?
Abstract (arXiv)
Visual emotion understanding requires models not only to recognize emotional states, but also to why they arise and perform higher-level cognitive reasoning. However, existing benchmarks mainly focus on emotion recognition, offering limited support for grounded understanding and response-oriented analysis. To address this gap, we introduce InsightVQA, a large-scale dataset for hierarchical visual question answering on emotion understanding and cognitive reasoning. Building from 351K images collected from six public sources, we apply a rigorous multi-stage filtering pipeline to curate 138K high-confidence images. Each image is annotated at three hierarchical levels: perception QA for emotion and valence recognition, grounded understanding QA constructed from visual trigger extraction through constraint-guided generation, and cognition QA centered on response intent prediction and sequential insight reasoning. In total, InsightVQA contains 725K QA pairs. We further present InsightVQA-Bench, a high-quality evaluation benchmark comprising 30K samples for fine-grained evaluation. To support evaluation, we introduce InsightNet, an emotion-tuned baseline for MLLMs. Results demonstrate that InsightVQA poses significant challenges for grounded emotion understanding and reasoning.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 49 references that are in the map. First posted on arXiv 1 Jun 2026.
Builds on
21 of 49 references.
References · 21
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,516
- 2015VQA: Visual Question Answeringcited by 2,506
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
- 2022Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distributioncited by 739
- 2017AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wildcited by 492
- 2023EmoSet: A Large-scale Visual Emotion Dataset with Rich Attributescited by 82
- 2020Context Based Emotion Recognition using EMOTIC Datasetcited by 73
9 more
- 2016Building a Large Scale Dataset for Image Emotion Recognition: The Fine Print and The Benchmarkcited by 71
- 2023Learning Emotion Representations from Verbal and Nonverbal Communicationcited by 31
- 2025EEmo-Bench: A Benchmark for Multi-modal Large Language Models on Image Evoked Emotion Assessmentcited by 15
- 2025FaceBench: A Multi-View Multi-Level Facial Attribute VQA Dataset for Benchmarking Face Perception MLLMscited by 12
- 2024MOSABench: Multi-Object Sentiment Analysis Benchmark for Evaluating Multimodal Large Language Models Understanding of Complex Imagecited by 9
- 2026Unveiling the Cognitive Compass: Theory-of-Mind-Guided Multimodal Emotion Reasoningcited by 8
- 2023Affective Visual Dialog: A Large-Scale Benchmark for Emotional Reasoning Based on Visually Grounded Conversationscited by 4
- 2025EmoCaliber: Advancing Reliable Visual Emotion Comprehension via Confidence Verbalization and Calibrationcited by 4
- 2026EEmo-Logic: A Unified Dataset and Multi-Stage Framework for Comprehensive Image-Evoked Emotion Assessmentcited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Seeing is Not Understanding: A Benchmark on Perception-Cognition Disparities in Large Language Models
- 2025Customizing Visual Emotion Evaluation for MLLMs: An Open-vocabulary, Multifaceted, and Scalable Approach
- 2025The Quest for Visual Understanding: A Journey Through the Evolution of Visual Question Answering
- 2024A Comprehensive Survey on Visual Question Answering Datasets and Algorithms
- 2025EmoVerse: A MLLMs-Driven Emotion Representation Dataset for Interpretable Visual Emotion Analysis
- 2025Why We Feel: Breaking Boundaries in Emotional Reasoning with Multimodal Large Language Models
- 2024VQA2: Visual Question Answering for Video Quality Assessment
- 2025Exploring Advanced Techniques for Visual Question Answering: A Comprehensive Comparison