mlsanityData to 14 Oct 2026

Lightweight Models for Emotional Analysis in Video

arXiv 2503.10530 ↗First posted 13 Mar 2025cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

In this study, we present an approach for efficient spatiotemporal feature extraction using MobileNetV4 and a multi-scale 3D MLP-Mixer-based temporal aggregation module. MobileNetV4, with its Universal Inverted Bottleneck (UIB) blocks, serves as the backbone for extracting hierarchical feature representations from input image sequences, ensuring both computational efficiency and rich semantic encoding. To capture temporal dependencies, we introduce a three-level MLP-Mixer module, which processes spatial features at multiple resolutions while maintaining structural integrity. Experimental results on the ABAW 8th competition demonstrate the effectiveness of our approach, showing promising performance in affective behavior analysis. By integrating an efficient vision backbone with a structured temporal modeling mechanism, the proposed framework achieves a balance between computational efficiency and predictive accuracy, making it well-suited for real-time applications in mobile and embedded computing environments.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 36 references that are in the map. First posted on arXiv 13 Mar 2025.

Builds on

25 of 36 references.

References · 25

  1. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  2. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  3. 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,446
  4. 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 903
  5. 2017AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wildcited by 492
  6. 2019Expression, Affect, Action Unit Recognition: Aff-Wild2, Multi-Task Learning and ArcFacecited by 222
  7. 2018Deep Affect Prediction in-the-wild: Aff-Wild Database and Challenge, Deep Architectures, and Beyondcited by 216
  8. 2020Analysing Affective Behavior in the First ABAW 2020 Competitioncited by 178
  9. 2021Affect Analysis in-the-wild: Valence-Arousal, Expressions, Action Units and a Unified Frameworkcited by 174
  10. 2021Distribution Matching for Heterogeneous Multi-Task Learning: a Large-scale Face Studycited by 168
  11. 2021Analysing Affective Behavior in the second ABAW2 Competitioncited by 163
  12. 2022ABAW: Valence-Arousal Estimation, Expression Recognition, Action Unit Detection & Multi-Task Learning Challengescited by 156
13 more
  1. 2019Face Behavior a la carte: Expressions, Affect and Action Units in a Single Networkcited by 155
  2. 2022ABAW: Learning from Synthetic Data & Multi-Task Learning Challengescited by 110
  3. 2023ABAW: Valence-Arousal Estimation, Expression Recognition, Action Unit Detection & Emotional Reaction Intensity Estimation Challengescited by 110
  4. 2024MobileNetV4 -- Universal Models for the Mobile Ecosystemcited by 99
  5. 2024The 6th Affective Behavior Analysis in-the-wild (ABAW) Competitioncited by 78
  6. 2017End-to-End Multimodal Emotion Recognition using Deep Neural Networkscited by 70
  7. 2024Distribution Matching for Multi-Task Learning of Classification Tasks: a Large-Scale Study on Faces & Beyondcited by 60
  8. 20247th ABAW Competition: Multi-Task Learning and Compound Expression Recognitioncited by 53
  9. 2018Measuring Depression Symptom Severity from Spoken Language and 3D Facial Expressionscited by 21
  10. 2018End2You -- The Imperial Toolkit for Multimodal Profiling by End-to-End Learningcited by 12
  11. 2021Speech Emotion Recognition using Semantic Informationcited by 11
  12. 2024HSEmotion Team at the 6th ABAW Competition: Facial Expressions, Valence-Arousal and Emotion Intensity Predictioncited by 8
  13. 2024Enhancing Facial Expression Recognition through Dual-Direction Attention Mixed Feature Networks: Application to 7th ABAW Challengecited by 8

Built on by

Not cited yet.