mlsanityData to 14 Oct 2026

EEG-based Cognitive Load Classification using Feature Masked Autoencoding and Emotion Transfer Learning

arXiv 2308.00246 ↗First posted 1 Aug 2023cs.LG cs.AI cs.HCcited by 6

Not on the map. Why?

Abstract (arXiv)

Cognitive load, the amount of mental effort required for task completion, plays an important role in performance and decision-making outcomes, making its classification and analysis essential in various sensitive domains. In this paper, we present a new solution for the classification of cognitive load using electroencephalogram (EEG). Our model uses a transformer architecture employing transfer learning between emotions and cognitive load. We pre-train our model using self-supervised masked autoencoding on emotion-related EEG datasets and use transfer learning with both frozen weights and fine-tuning to perform downstream cognitive load classification. To evaluate our method, we carry out a series of experiments utilizing two publicly available EEG-based emotion datasets, namely SEED and SEED-IV, for pre-training, while we use the CL-Drive dataset for downstream cognitive load classification. The results of our experiments show that our proposed approach achieves strong results and outperforms conventional single-stage fully supervised learning. Moreover, we perform detailed ablation and sensitivity studies to evaluate the impact of different aspects of our proposed solution. This research contributes to the growing body of literature in affective computing with a focus on cognitive load, and opens up new avenues for future research in the field of cross-domain transfer learning using self-supervised pre-training.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 24 of its 50 references that are in the map. First posted on arXiv 1 Aug 2023.

Builds on

24 of 50 references.

References · 24

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  5. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  6. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  7. 2020Exploring Simple Siamese Representation Learningcited by 2,866
  8. 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,423
  9. 2017Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answeringcited by 1,312
  10. 2014How transferable are features in deep neural networks?cited by 1,225
  11. 2019Self-supervised Visual Feature Learning with Deep Neural Networks: A Surveycited by 657
  12. 2021Masked Feature Prediction for Self-Supervised Visual Pre-Trainingcited by 576
12 more
  1. 2019Learning Deep Transformer Models for Machine Translationcited by 309
  2. 2021BENDR: using transformers and a contrastive self-supervised learning task to learn from massive amounts of EEG datacited by 199
  3. 2020Self-supervised ECG Representation Learning for Emotion Recognitioncited by 99
  4. 2022MAEEG: Masked Auto-encoder for EEG Representation Learningcited by 62
  5. 2021A Transformer Architecture for Stress Detection from ECGcited by 27
  6. 2023Multimodal Brain-Computer Interface for In-Vehicle Driver Cognitive Load Measurement: Dataset and Baselinescited by 13
  7. 20233D Feature Prediction for Masked-AutoEncoder-Based Point Cloud Pretrainingcited by 13
  8. 2019Classification of Hand Movements from EEG using a Deep Attention-based LSTM Networkcited by 12
  9. 2022PARSE: Pairwise Alignment of Representations in Semi-Supervised EEG Learning for Emotion Recognitioncited by 12
  10. 2020Detection of Maternal and Fetal Stress from the Electrocardiogram with Self-Supervised Representation Learningcited by 8
  11. 2020Spatio-Temporal EEG Representation Learning on Riemannian Manifold and Euclidean Spacecited by 7
  12. 2023Partial Label Learning for Emotion Recognition from EEGcited by 3

Built on by

Cited by year

Citing papers per year: 2024: 2; 2025: 4.

6 papers.