mlsanityData to 7 Oct 2026

Modeling cognitive load as a self-supervised brain rate with electroencephalography and deep learning

arXiv 2209.10992 ↗First posted 21 Sep 2022eess.SP cs.AI cs.HCcited by 1

Not on the map. Why?

Abstract (arXiv)

The principal reason for measuring mental workload is to quantify the cognitive cost of performing tasks to predict human performance. Unfortunately, a method for assessing mental workload that has general applicability does not exist yet. This research presents a novel self-supervised method for mental workload modelling from EEG data employing Deep Learning and a continuous brain rate, an index of cognitive activation, without requiring human declarative knowledge. This method is a convolutional recurrent neural network trainable with spatially preserving spectral topographic head-maps from EEG data to fit the brain rate variable. Findings demonstrate the capacity of the convolutional layers to learn meaningful high-level representations from EEG data since within-subject models had a test Mean Absolute Percentage Error average of 11%. The addition of a Long-Short Term Memory layer for handling sequences of high-level representations was not significant, although it did improve their accuracy. Findings point to the existence of quasi-stable blocks of learnt high-level representations of cognitive activation because they can be induced through convolution and seem not to be dependent on each other over time, intuitively matching the non-stationary nature of brain responses. Across-subject models, induced with data from an increasing number of participants, thus containing more variability, obtained a similar accuracy to the within-subject models. This highlights the potential generalisability of the induced high-level representations across people, suggesting the existence of subject-independent cognitive activation patterns. This research contributes to the body of knowledge by providing scholars with a novel computational method for mental workload modelling that aims to be generally applicable, does not rely on ad-hoc human-crafted models supporting replicability and falsifiability.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 9 of its 86 references that are in the map. First posted on arXiv 21 Sep 2022.

Builds on

9 of 86 references.

References · 9

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  3. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  4. 2019Self-supervised Visual Feature Learning with Deep Neural Networks: A Surveycited by 656
  5. 2015Beyond Short Snippets: Deep Networks for Video Classificationcited by 233
  6. 2020Uncovering the structure of clinical EEG signals with self-supervised learningcited by 109
  7. 2017Appearance-and-Relation Networks for Video Classificationcited by 61
  8. 2016Mental State Recognition via Wearable EEGcited by 8
  9. 2022An Evaluation of the EEG alpha-to-theta and theta-to-alpha band Ratios as Indexes of Mental Workloadcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.