Pseudo-Label Augmentation for Affect Sensing in Small Collaborative Groups
Not on the map. Why?
Abstract (arXiv)
Physiological affect sensing in naturalistic group interaction is often limited by sparse labels rather than sensor data: wearable devices produce many time windows, while self-reports are collected only a few times per session. Using GroupAffect-4, a four-person collaborative dataset with wearable physiology, eye tracking, Big Five personality, and post-task VAD labels, we study pseudo-label augmentation for affect sensing under sparse supervision. We compare no augmentation, Gaussian Process pseudo-labelling, personality-aware trust weighting, and joint personality-plus-confidence weighting within a shared target-construction pipeline. Results show that pseudo-label augmentation improves over the labelled-only baseline in the known-team setting. However, the narrow range of Big Five cosine similarities (0.91-0.99) makes fine-grained personality weighting ineffective; personality similarity functions mainly as a same-team filter rather than a calibrated trust signal. With smoothing, augmented SVM variants are effectively tied on Valence and Arousal, while the joint personality-plus-confidence variant gives the highest Dominance score. Cross-subject LOSO transfer remains encouraging, especially for Arousal, whereas strict session-isolated LOGO removes the augmentation benefit. Given only 10 groups, LOGO should be interpreted as a conservative lower bound on unseen-group transfer. Overall, the results suggest that pseudo-label augmentation can make better use of sparsely labelled collaborative affect data, while personality information is most useful as a within-team selection mechanism.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 46 references that are in the map. First posted on arXiv 13 Sep 2026.
Builds on
13 of 46 references.
References · 13
- 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,085
- 2021Time-Series Representation Learning via Temporal and Contextual Contrastingcited by 345
- 2017Data Augmentation of Wearable Sensor Data for Parkinson's Disease Monitoring using Convolutional Neural Networkscited by 131
- 2020An Empirical Survey of Data Augmentation for Time Series Classification with Neural Networkscited by 128
- 2014Label Distribution Learningcited by 124
- 2020K-EmoCon, a multimodal sensor dataset for continuous emotion recognition in naturalistic conversationscited by 30
- 2015SALSA: A Novel Dataset for Multimodal Group Behavior Analysiscited by 27
- 2022A Survey on Physiological Signal Based Emotion Recognitioncited by 12
- 2025Advancing Face-to-Face Emotion Communication: A Multimodal Dataset (AFFEC)cited by 4
- 2025MuMTAffect: A Multimodal Multitask Affective Framework for Personality and Emotion Recognition from Physiological Signalscited by 4
- 2024Dynamics of Collective Group Affect: Group-level Annotations and the Multimodal Modeling of Convergence and Divergencecited by 2
- 2025Modelling the Interplay of Eye-Tracking Temporal Dynamics and Personality for Emotion Detection in Face-to-Face Settingscited by 2
Built on by
Not cited yet.