VISTA: Value-Informed Event Appraisal for Multimodal Emotion Conflict
Not on the map. Why?
Abstract (arXiv)
Conflicting emotional cues can be individually valid: a subdued voice may reflect a blocked goal while a smile satisfies a social obligation. Their interpretation depends on what the event means to the person. We introduce VISTA (Value-Informed Semantic Trust Arbitration), a learned seven-field appraisal interface that conditions modality arbitration on concerns, event relations, and expression conditions while retaining a joint-evidence residual. A log-odds decomposition separates emotion expectation from cue diagnosticity, motivating an interface that lets appraisal change how evidence is interpreted. With a shared Qwen2.5-Omni-7B backbone and matched training examples and steps, VISTA reaches 64.5% conflict accuracy on CA-MER, improving on modality gating by 2.5 percentage points on conflict and 0.2 on consistency. Shuffling appraisal across scenes or removing its decision connection reduces this benefit. A common frozen-backbone probe reaches 0.600 macro CCC for appraisal readout, compared with 0.505 for emotion-only fine-tuning. Evaluations across five benchmarks connect recognition under increasing conflict with appraisal readout and downstream decision use. Together, the analyses and experiments support scene-specific appraisal as an intermediate representation that helps interpret conflicting emotional evidence.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 29 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
16 of 29 references.
References · 16
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,081
- 2020Concept Bottleneck Modelscited by 1,022
- 2025Qwen2.5-Omni Technical Reportcited by 704
- 2019Multimodal Transformer for Unaligned Multimodal Language Sequencescited by 637
- 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 636
- 2022Post-hoc Concept Bottleneck Modelscited by 289
- 2020MISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment Analysiscited by 262
- 2022Balanced Multimodal Learning via On-the-fly Gradient Modulationcited by 259
- 2022Make Acoustic and Visual Cues Matter: CH-SIMS v2.0 Dataset and AV-Mixup Consistent Modulecited by 43
- 2021ValueNet: A New Dataset for Human Value Driven Dialogue Systemcited by 34
- 2025Benchmarking and Bridging Emotion Conflicts for Multimodal Emotion Reasoningcited by 12
4 more
- 2024THERADIA WoZ: An Ecological Corpus for Appraisal-based Affect Research in Healthcarecited by 2
- 2024Evaluation of data inconsistency for multi-modal sentiment analysiscited by 2
- 2026CAREBench: Evaluating LLMs' Emotion Understanding by Assessing Cognitive Appraisal Reasoningcited by 2
- 2026EmoMM: Benchmarking and Steering MLLM for Multimodal Emotion Recognition under Conflict and Missingnesscited by 1
Built on by
Not cited yet.