MICACL: Multi-Instance Category-Aware Contrastive Learning for Long-Tailed Dynamic Facial Expression Recognition
Not on the map. Why?
Abstract (arXiv)
Dynamic facial expression recognition (DFER) faces significant challenges due to long-tailed category distributions and complexity of spatio-temporal feature modeling. While existing deep learning-based methods have improved DFER performance, they often fail to address these issues, resulting in severe model induction bias. To overcome these limitations, we propose a novel multi-instance learning framework called MICACL, which integrates spatio-temporal dependency modeling and long-tailed contrastive learning optimization. Specifically, we design the Graph-Enhanced Instance Interaction Module (GEIIM) to capture intricate spatio-temporal between adjacent instances relationships through adaptive adjacency matrices and multiscale convolutions. To enhance instance-level feature aggregation, we develop the Weighted Instance Aggregation Network (WIAN), which dynamically assigns weights based on instance importance. Furthermore, we introduce a Multiscale Category-aware Contrastive Learning (MCCL) strategy to balance training between major and minor categories. Extensive experiments on in-the-wild datasets (i.e., DFEW and FERV39k) demonstrate that MICACL achieves state-of-the-art performance with superior robustness and generalization.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 42 references that are in the map. First posted on arXiv 4 Sep 2025.
Builds on
17 of 42 references.
References · 17
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
- 2021Deep Long-Tailed Learning: A Surveycited by 417
- 2016Multiple Instance Learning: A Survey of Problem Characteristics and Applicationscited by 164
- 2020DFEW: A Large-Scale Database for Recognizing Dynamic Facial Expressions in the Wildcited by 128
- 2019Context-Aware Emotion Recognition Networkscited by 99
- 2022FERV39k: A Large-Scale Multi-Scene Dataset for Facial Expression Recognition in Videoscited by 69
- 2022Intensity-Aware Loss for Dynamic Facial Expression Recognition in the Wildcited by 41
- 2017Spatial-Temporal Recurrent Neural Network for Emotion Recognitioncited by 38
- 2022Spatio-Temporal Transformer for Dynamic Facial Expression Recognition in the Wildcited by 29
- 2022NR-DFERNet: Noise-Robust Network for Dynamic Facial Expression Recognitioncited by 27
- 2024DGR-MIL: Exploring Diverse Global Representation in Multiple Instance Learning for Whole Slide Image Classificationcited by 25
5 more
- 2025Learning from Heterogeneity: Generalizing Dynamic Facial Expression Recognition via Distributionally Robust Optimizationcited by 19
- 2024WiOpen: A Robust Wi-Fi-based Open-set Gesture Recognition Frameworkcited by 16
- 2023LOGO-Former: Local-Global Spatio-Temporal Transformer for Dynamic Facial Expression Recognitioncited by 15
- 2023ReSup: Reliable Label Noise Suppression for Facial Expression Recognitioncited by 14
- 2024FacialPulse: An Efficient RNN-based Depression Detection via Temporal Facial Landmarkscited by 9
Built on by
Not cited yet.