mlsanityData to 7 Oct 2026

Stage-Adaptive Reliability Modeling for Continuous Valence-Arousal Estimation

arXiv 2603.11468 ↗First posted 12 Mar 2026cs.MM cs.AI cs.SDcited by 1

Not on the map. Why?

Abstract (arXiv)

Continuous valence-arousal estimation in real-world environments is challenging due to inconsistent modality reliability and interaction-dependent variability in audio-visual signals. Existing approaches primarily focus on modeling temporal dynamics, often overlooking the fact that modality reliability can vary substantially across interaction stages. To address this issue, we propose SAGE, a Stage-Adaptive reliability modeling framework that explicitly estimates and calibrates modality-wise confidence during multimodal integration. SAGE introduces a reliability-aware fusion mechanism that dynamically rebalances audio and visual representations according to their stage-dependent informativeness, preventing unreliable signals from dominating the prediction process. By separating reliability estimation from feature representation, the proposed framework enables more stable emotion estimation under cross-modal noise, occlusion, and varying interaction conditions. Extensive experiments on the Aff-Wild2 benchmark demonstrate that SAGE consistently improves concordance correlation coefficient scores compared with existing multimodal fusion approaches, highlighting the effectiveness of reliability-driven modeling for continuous affect prediction.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 24 of its 46 references that are in the map. First posted on arXiv 12 Mar 2026.

Builds on

24 of 46 references.

References · 24

  1. 2019Expression, Affect, Action Unit Recognition: Aff-Wild2, Multi-Task Learning and ArcFacecited by 222
  2. 2018Deep Affect Prediction in-the-wild: Aff-Wild Database and Challenge, Deep Architectures, and Beyondcited by 216
  3. 2020Analysing Affective Behavior in the First ABAW 2020 Competitioncited by 178
  4. 2021Affect Analysis in-the-wild: Valence-Arousal, Expressions, Action Units and a Unified Frameworkcited by 174
  5. 2021Distribution Matching for Heterogeneous Multi-Task Learning: a Large-scale Face Studycited by 168
  6. 2021Analysing Affective Behavior in the second ABAW2 Competitioncited by 163
  7. 2022ABAW: Valence-Arousal Estimation, Expression Recognition, Action Unit Detection & Multi-Task Learning Challengescited by 156
  8. 2019Face Behavior a la carte: Expressions, Affect and Action Units in a Single Networkcited by 155
  9. 2022ABAW: Learning from Synthetic Data & Multi-Task Learning Challengescited by 110
  10. 2023ABAW: Valence-Arousal Estimation, Expression Recognition, Action Unit Detection & Emotional Reaction Intensity Estimation Challengescited by 110
  11. 2018Aff-Wild2: Extending the Aff-Wild Database for Affect Recognitioncited by 80
  12. 2024The 6th Affective Behavior Analysis in-the-wild (ABAW) Competitioncited by 78
12 more
  1. 2024Distribution Matching for Multi-Task Learning of Classification Tasks: a Large-Scale Study on Faces & Beyondcited by 60
  2. 20247th ABAW Competition: Multi-Task Learning and Compound Expression Recognitioncited by 53
  3. 2019Exploiting multi-CNN features in CNN-RNN based Dimensional Emotion Recognition on the OMG in-the-wild Datasetcited by 39
  4. 2022A Joint Cross-Attention Model for Audio-Visual Fusion in Dimensional Emotion Recognitioncited by 33
  5. 2023Multi-modal Facial Affective Analysis based on Masked Autoencodercited by 23
  6. 2023Leveraging TCN and Transformer for effective visual-audio fusion in continuous emotion recognitioncited by 20
  7. 2024Behaviour4All: in-the-wild Facial Behaviour Analysis Toolkitcited by 16
  8. 2021Continuous Emotion Recognition with Audio-visual Leader-follower Attentive Fusioncited by 15
  9. 2024Recursive Joint Cross-Modal Attention for Multimodal Fusion in Dimensional Emotion Recognitioncited by 15
  10. 2025DVD: A Comprehensive Dataset for Advancing Violence Detection in Real-World Scenarioscited by 13
  11. 2025MAVEN: Multi-modal Attention for Valence-Arousal Emotion Networkcited by 8
  12. 2024Cross-Attention is Not Always Needed: Dynamic Cross-Attention for Audio-Visual Dimensional Emotion Recognitioncited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.