Explainable graph attention network for stress recognition (StressGAT) via differential action units
Not on the map. Why?
Abstract (arXiv)
Stress is a dynamic process characterized by significant individual variability in facial expression. Traditional architectures, such as Recurrent Neural Networks (RNNs) and Convolutional Neural Networks (CNNs), often overlook person-specific baselines or lack the representational capacity to model the non-linear temporal progression of distress due to sequential bottlenecks and rigid grid-based constraints. Furthermore, many deep learning models lack the interpretability required for clinical deployment. This study introduces StressGAT, a Graph Attention Network that leverages the relational inductive bias of graph modeling to capture complex facial dynamics that indicate acute stress. By using Differential Action Units, the framework normalizes individual responses relative to neutral baselines to achieve personalized recognition. The proposed model achieves 88.62% accuracy on a diverse stress-induction cohort (58 participants) using a subject-independent, Leave-One-Subject-Out (LOSO) cross-validation protocol. Beyond predictive accuracy, the architecture integrates a Multiple Instance Learning (MIL) attention mechanism to identify peak stress intervals and reveal distinct expressivity phenotypes. By simultaneously optimizing for accuracy and interpretability, this framework provides a robust, explainable solution for personalized affective monitoring.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 13 of its 57 references that are in the map. First posted on arXiv 23 Jul 2026.
Builds on
13 of 57 references.
References · 13
- 2021How Attentive are Graph Attention Networks?cited by 835
- 2021TransFER: Learning Relation-aware Facial Expression Representations with Transformerscited by 85
- 2016DAiSEE: Towards User Engagement Recognition in the Wildcited by 39
- 2023Do I Have Your Attention: A Large Scale Engagement Prediction Dataset and Baselinescited by 17
- 2023Unlocking the Emotional World of Visual Media: An Overview of the Science, Research, and Impact of Understanding Emotioncited by 12
- 2024Static for Dynamic: Towards a Deeper Understanding of Dynamic Facial Expressions Using Static Expression Datacited by 9
- 2024Engagement Measurement Based on Facial Landmarks and Spatial-Temporal Graph Convolutional Networkscited by 7
- 2026A Unified Tokenization Framework for Pain Recognition using Heterogeneous 3D Modalitiescited by 7
- 2026ReFace: Reorganizing Facial Spatiotemporal Representations for Improved Pain Assessmentcited by 7
- 2023Employing Multimodal Machine Learning for Stress Detectioncited by 5
- 2026Combining Facial Videos and Biosignals for Stress Estimation During Drivingcited by 4
- 2025Action Unit Enhance Dynamic Facial Expression Recognitioncited by 3
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Beyond the Raw Waveform: Fusing Visual Representations of EDA for Stress Detectioncited by 3
- 2026A Multi-Scale Temporal Framework with Dynamic Fusion for EEG-Based Emotion Recognitioncited by 2
- 2026FUSE: Frame-Unified Stress Estimation from Facial Videocited by 0
- 2026MUPA2E: Multimodal Unified Perception with Asymmetric Attention for Emotion Assessmentcited by 0
- 2026UNWIND: Any-Length Facial Video for Stress Detection without Temporal Windowingcited by 0
- 2026UNWIND: Any-Length Facial Video for Stress Detection without Temporal Windowing26 Aug 2026
- 2026MUPA2E: Multimodal Unified Perception with Asymmetric Attention for Emotion Assessment17 Aug 2026
- 2026FUSE: Frame-Unified Stress Estimation from Facial Video11 Aug 2026
- 2026Beyond the Raw Waveform: Fusing Visual Representations of EDA for Stress Detection10 Aug 2026
- 2026A Multi-Scale Temporal Framework with Dynamic Fusion for EEG-Based Emotion Recognition10 Aug 2026