GRACE: Boosting Video MLLMs with Grounded Action-Centric Evidence for Viewer Sentiment Prediction
Not on the map. Why?
Abstract (arXiv)
Viewer sentiment prediction in video advertisements aims to infer the latent affective response evoked in the audience. To bridge the gap between what is shown and what is felt, models must deduce hidden viewer emotions from explicit visual narratives, concrete character-object interactions, and visible textual cues. However, standard Multimodal Large Language Models (MLLMs) typically rely on holistic frame representations, which leave these fine-grained, affect-relevant events implicit and complicate precise emotional reasoning. To address this, we propose a grounded action-centric evidence augmentation framework that enhances video MLLMs' clue extraction and comprehension by introducing explicit event structure and localized visual evidence. Our method extracts temporally ordered subject-verb-object (SVO) triplets and auxiliary visible textual cues from action-centric video descriptions, grounds subject and object entities as visual entity crops, and then enables the MLLM to perform clue-enhanced emotional reasoning based on these extracted structured clues. In this way, action triplets specify "what happens", while grounded visual entity crops anchor "who or what participates in each event" to concrete visual evidence. Experiments on the Pitts dataset show consistent improvements over Qwen2.5-VL and Qwen3-VL baselines. Ablation studies, cross-dataset evaluation on AdsQA, and transfer experiments on an emotion-focused TVQA subset further support the effectiveness and generalization of our approach.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 30 references that are in the map. First posted on arXiv 15 Jun 2026.
Builds on
18 of 30 references.
References · 18
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,402
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,109
- 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 583
- 2018TVQA: Localized, Compositional Video Question Answeringcited by 467
- 2017Automatic Understanding of Image and Video Advertisementscited by 68
- 2023Action Scene Graphs for Long-Form Understanding of Egocentric Videoscited by 51
- 2024MECD: Unlocking Multi-Event Causal Discovery in Video Reasoningcited by 23
- 2024STEP: Enhancing Video-LLMs' Compositional Reasoning by Spatio-Temporal Graph-guided Self-Trainingcited by 22
6 more
- 2025AdsQA: Towards Advertisement Video Understandingcited by 13
- 2025Commonsense Video Question Answering through Video-Grounded Entailment Tree Reasoningcited by 12
- 2023Few-shot Action Recognition via Intra- and Inter-Video Information Maximizationcited by 7
- 2025MECD+: Unlocking Event-Level Causal Graph Discovery for Video Reasoningcited by 5
- 2025CSTA: Spatial-Temporal Causal Adaptive Learning for Exemplar-Free Video Class-Incremental Learningcited by 5
- 2025Looking Beyond Visible Cues: Implicit Video Question Answering via Dual-Clue Reasoningcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Customizing Visual Emotion Evaluation for MLLMs: An Open-vocabulary, Multifaceted, and Scalable Approach
- 2024StimuVAR: Spatiotemporal Stimuli-aware Video Affective Reasoning with Multimodal Large Language Models
- 2025EmoCaliber: Advancing Reliable Visual Emotion Comprehension via Confidence Verbalization and Calibration
- 2026Benchmarking Dynamic Affective Reasoning: A Viewer-Centric Video Emotion Dataset
- 2026Video2Reaction: Training Foundation Video Models to Predict Audience Reaction
- 2026AffectSeek: Agentic Affective Understanding in Long Videos under Vague User Queries
- 2025VidEmo: Affective-Tree Reasoning for Emotion-Centric Video Foundation Models
- 2024HumanVBench: Probing Human-Centric Video Understanding in MLLMs with Automatically Synthesized Benchmarks