An Intelligent Decision Support System for Emotion Monitoring using Microscopic Fixational Dynamics
Not on the map. Why?
Abstract (arXiv)
The rising prevalence of psychological disorders necessitates effective emotion monitoring, yet current methods relying on facial or physiological signals often suffer from intrusiveness and privacy issues. This paper proposes an intelligent decision support system and pervasive edge-computing framework that leverages smart glasses and a companion smartphone to infer emotional states from microscopic visual fixation patterns. Moving beyond traditional macroscopic gaze metrics, the proposed system extracts and decomposes three distinct neurophysiological micro-movements: microsaccades, ocular drifts, and ocular microtremors. We introduce an interpretable hybrid artificial intelligence pipeline combining a multi-head attention mechanism, extreme gradient boosting, and a support vector machine to extract deep temporal features, quantify their physiological importance, and perform efficient on-device classification. Through an extensive evaluation involving 60 volunteers, we rigorously validate the framework under a strict leave-one-subject-out cross-validation protocol across both controlled and naturalistic mobile scenarios. Ablation studies unequivocally demonstrate that these fixational micro-movements are substantially more discriminative for emotion inference than traditional macroscopic features. Furthermore, aligned with contemporary affective science, the system incorporates a few-shot personalization mechanism to bridge universal physiological baselines with individual emotional heterogeneity, achieving a highly robust personalized F1-score of 83.6%. This work establishes a physiologically interpretable, unobtrusive, and deployable paradigm for continuous real-time emotion monitoring.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 6 of its 80 references that are in the map. First posted on arXiv 1 Sep 2026.
Builds on
6 of 80 references.
References · 6
- 2020A Transformer-based Framework for Multivariate Time Series Representation Learningcited by 450
- 2022ABAW: Valence-Arousal Estimation, Expression Recognition, Action Unit Detection & Multi-Task Learning Challengescited by 156
- 2014Pupil: An Open Source Platform for Pervasive Eye Tracking and Mobile Gaze-based Interactioncited by 43
- 2022EEG based Emotion Recognition: A Tutorial and Reviewcited by 43
- 2022Gaze-enhanced Crossmodal Embeddings for Emotion Recognitioncited by 4
- 2023A Novel Exploitative and Explorative GWO-SVM Algorithm for Smart Emotion Recognitioncited by 1
Built on by
Not cited yet.