Beyond the Raw Waveform: Fusing Visual Representations of EDA for Stress Detection
Not on the map. Why?
Abstract (arXiv)
Electrodermal activity (EDA) is widely used in automatic stress detection, yet most pipelines treat it only as a raw one-dimensional waveform. This study examines whether complementary visual representations of EDA provide useful information for stress classification and whether their fusion im- proves recognition performance. Six image-based representations are derived from each EDA recording: an unwrapped short-time Fourier transform (STFT) phase spectrogram, an instantaneous-frequency map computed from that phase, a power spectral density (PSD) spectrogram, a continuous wavelet transform scalogram, a recurrence plot, and a rendered waveform trace. The selected representations are stacked as channels of a single multichannel input, together with the raw waveform, and processed by a shared asymmetric-attention architecture. Experiments on a 58-subject stress dataset show that representation fusion improves over the raw waveform. The best configuration, which combines five representations while excluding the unwrapped phase spectrogram, reaches 70.97% test accuracy, compared with 67.36% for the raw waveform. The single PSD spectrogram achieves 69.44%, remaining close to the best-fused configuration at a lower computational cost. The results show that alternative visual forms of the same EDA signal can provide useful inductive biases for stress detection, and that a compact selection of complementary representations can be more effective than the raw waveform alone.
Key facts. Cited by 3 papers in the map (data through 13 Oct 2026). Builds on 12 of its 41 references that are in the map. First posted on arXiv 10 Aug 2026.
Builds on
12 of 41 references.
References · 12
- 2024Twins-PainViT: Towards a Modality-Agnostic Vision Transformer Framework for Multimodal Automatic Pain Assessment using Facial Videos and fNIRScited by 14
- 2024Synthetic Thermal and RGB Videos for Automatic Pain Assessment utilizing a Vision-MLP Architecturecited by 12
- 2025Efficient Pain Recognition via Respiration Signals: A Single Cross-Attention Transformer Multi-Window Fusion Pipelinecited by 11
- 2025PainFormer: a Vision Foundation Model for Automatic Pain Assessmentcited by 10
- 2025Multi-Representation Diagrams for Pain Recognition: Integrating Various Electrodermal Activity Signals into a Single Imagecited by 9
- 2025Tiny-BioMoE: a Lightweight Embedding Model for Biosignal Analysiscited by 8
- 2024Multi-task Neural Networks for Pain Intensity Estimation using Electrocardiogram and Demographic Factorscited by 7
- 2026A Lightweight Transformer for Pain Recognition from Brain Activitycited by 7
- 2026A Unified Tokenization Framework for Pain Recognition using Heterogeneous 3D Modalitiescited by 7
- 2026ReFace: Reorganizing Facial Spatiotemporal Representations for Improved Pain Assessmentcited by 7
- 2026Explainable graph attention network for stress recognition (StressGAT) via differential action unitscited by 5
- 2026Towards a Unified Modality-Agnostic Multimodal Framework for Cognitive Workload Assessmentcited by 5
Built on by
Citing papers per year: 2026: 3.
3 papers.