mlsanityData to 7 Oct 2026

VISTA: Value-Informed Event Appraisal for Multimodal Emotion Conflict

arXiv 2609.37324 ↗First posted 29 Sep 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Conflicting emotional cues can be individually valid: a subdued voice may reflect a blocked goal while a smile satisfies a social obligation. Their interpretation depends on what the event means to the person. We introduce VISTA (Value-Informed Semantic Trust Arbitration), a learned seven-field appraisal interface that conditions modality arbitration on concerns, event relations, and expression conditions while retaining a joint-evidence residual. A log-odds decomposition separates emotion expectation from cue diagnosticity, motivating an interface that lets appraisal change how evidence is interpreted. With a shared Qwen2.5-Omni-7B backbone and matched training examples and steps, VISTA reaches 64.5% conflict accuracy on CA-MER, improving on modality gating by 2.5 percentage points on conflict and 0.2 on consistency. Shuffling appraisal across scenes or removing its decision connection reduces this benefit. A common frozen-backbone probe reaches 0.600 macro CCC for appraisal readout, compared with 0.505 for emotion-only fine-tuning. Evaluations across five benchmarks connect recognition under increasing conflict with appraisal readout and downstream decision use. Together, the analyses and experiments support scene-specific appraisal as an intermediate representation that helps interpret conflicting emotional evidence.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 29 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

16 of 29 references.

References · 16

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,081
  3. 2020Concept Bottleneck Modelscited by 1,022
  4. 2025Qwen2.5-Omni Technical Reportcited by 704
  5. 2019Multimodal Transformer for Unaligned Multimodal Language Sequencescited by 637
  6. 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 636
  7. 2022Post-hoc Concept Bottleneck Modelscited by 289
  8. 2020MISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment Analysiscited by 262
  9. 2022Balanced Multimodal Learning via On-the-fly Gradient Modulationcited by 259
  10. 2022Make Acoustic and Visual Cues Matter: CH-SIMS v2.0 Dataset and AV-Mixup Consistent Modulecited by 43
  11. 2021ValueNet: A New Dataset for Human Value Driven Dialogue Systemcited by 34
  12. 2025Benchmarking and Bridging Emotion Conflicts for Multimodal Emotion Reasoningcited by 12
4 more
  1. 2024THERADIA WoZ: An Ecological Corpus for Appraisal-based Affect Research in Healthcarecited by 2
  2. 2024Evaluation of data inconsistency for multi-modal sentiment analysiscited by 2
  3. 2026CAREBench: Evaluating LLMs' Emotion Understanding by Assessing Cognitive Appraisal Reasoningcited by 2
  4. 2026EmoMM: Benchmarking and Steering MLLM for Multimodal Emotion Recognition under Conflict and Missingnesscited by 1

Built on by

Not cited yet.